KR100812505B1 - Apparatus for transmitting substitution images and control method thereof - Google Patents

Abstract

An apparatus for transmitting a substitute image and its control method are provided to solve a problem that a user should select a menu for transmitting a substitute image and set an image to be transmitted during video call communication, thereby automatically changing a mode during video call communication without interrupting transmission of user's own image. A camera unit(206) converts an optical signal with respect to a subject into image data. A luminance analyzing unit(302) analyzes luminance information with respect to the optical signal received in the camera unit and transmits a substitute image instead of the captured image data according to the analyzed luminance information. The luminance analyzing unit determines whether the analyzed luminance information is smaller than a pre-set threshold value, and the substitute image is transmitted when the luminance information is smaller than the pre-set threshold value. The luminance analyzing unit calculates the difference between current luminance information and previous luminance information. If the difference between the two luminance information is greater than the pre-set first threshold value, the luminance analyzing unit determines that the current luminance information is smaller than the pre-set second threshold value.

Description

Apparatus for transmitting substitution images and control method

1 is a flow chart showing a substitute image providing process according to the prior art.

2 is a view showing a state of use of a mobile communication terminal according to an embodiment of the present invention.

3 is a block diagram showing an internal configuration of a mobile communication terminal according to an embodiment of the present invention.

4 is a flowchart illustrating a process of providing a substitute image according to an embodiment of the present invention.

5 is a diagram illustrating a configuration of an alternative image providing system according to another exemplary embodiment of the present invention.

6 is a flowchart illustrating a process of providing a substitute image according to another embodiment of the present invention.

* Description of the major reference numerals in the drawings *

200: display unit 202: command keypad unit

204: number keypad portion 206: camera portion

300: RF module 302: luminance analyzer

304: control unit 306: storage unit

310: video codec 312: audio codec

The present invention relates to an alternative video transmission apparatus and a control method thereof, and more particularly, to an apparatus and a control method thereof capable of automatically transmitting an alternative video during a video call.

In recent years, mobile communication technology has moved from 2G to 3G, and high speed downlink packet access (HSDPA) technology has been implemented to enable the transmission and reception of multimedia data at high speed.

Accordingly, multimedia services such as video call and video on demand (VOD) have been commercialized in recent years.

In particular, video call is a service that is receiving the most attention in the 3rd generation mobile communication in that it is possible to send and receive voice while watching each other, and can give a reality to the user who is calling.

In a video call, a camera photographed on a mobile communication terminal photographs a user and transmits the captured image to a counterpart's mobile communication terminal. However, always transmitting video does not always provide convenience. There may be a moment during which a video call is not desired, and in this case, a substitute video is transmitted to the counterpart according to a user's selection.

1 is a flowchart illustrating an alternative image providing process according to the prior art.

1 illustrates a process of transmitting a substitute video during a video call by a mobile communication terminal according to the related art.

Referring to FIG. 1, when starting a video call (step 100), the mobile communication terminal transmits an image captured by a camera (step 102).

The mobile terminal determines whether the user selects an alternative video mode key during the video call (step 104).

If the user selects an alternative video mode key, the mobile communication terminal extracts the alternative video and transmits it to the other party (step 106), and terminates the video call according to the user's call termination key selection (step 108).

According to the prior art, the transmission of the substitute image is performed according to the user's key selection. That is, in the related art, a user must select a menu for transmitting a substitute video during a video call and set a video to be transmitted.

However, transmitting a substitute video during a video call has a problem that annoys the user. That is, in most cases, stopping the user's own image transmission is made suddenly. In this case, it is a problem to require the user to switch modes while selecting a menu.

In order to solve the problems of the prior art as described above, the present invention proposes an apparatus, a system for transmitting a substitute video and a control method thereof capable of transmitting a substitute video by automatically switching modes during a video call.

In order to achieve the above object, according to a preferred embodiment of the present invention, a mobile communication terminal for providing a video call service, comprising: a camera unit for converting an optical signal for a subject into image data; And a luminance analyzer analyzing the luminance information of the optical signal introduced into the camera to transmit a substitute image instead of the image data photographed according to the analyzed luminance information.

According to another aspect of the present invention, a method for controlling transmission of a substitute image in a mobile communication terminal providing a video call service, the method comprising the steps of: (a) outputting brightness information on an optical signal introduced into a camera unit; (b) analyzing the output luminance information; And (c) transmitting a substitute image instead of the captured image based on the analysis information.

According to another aspect of the invention there is provided a computer readable recording medium having recorded thereon a program for performing the above method.

According to another aspect of the present invention, a method for transmitting a replacement video in a mobile communication system that provides a video call service to a plurality of mobile communication terminals, the method comprising: (a) transmitting a replacement video according to a change in luminance information from the first mobile communication terminal; Receiving a request; And (b) extracting a preset substitute image and transmitting the extracted substitute image to a second mobile communication terminal, wherein the mobile communication terminal analyzes luminance information of an optical signal introduced into a camera unit and analyzes the luminance information on the analyzed luminance information. Accordingly, there is provided an alternative video transmission method comprising requesting the replacement video transmission.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In describing the drawings, similar reference numerals are used for similar elements.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, the same reference numerals will be used for the same means regardless of the reference numerals in order to facilitate the overall understanding.

2 is a diagram illustrating a state of use of a mobile communication terminal according to an embodiment of the present invention.

As shown in FIG. 2, the mobile communication terminal according to the present invention may include a display unit 200, a command keypad unit 202, a number keypad unit 204, and a camera unit 206.

2 illustrates a slide-type mobile communication terminal, but it will be understood by those skilled in the art that a flip type terminal, a folder type terminal, and a bar type terminal may also be included in the scope of the present invention.

The display unit 200 displays various information such as menu information, communication information, and image information in response to a user's request. In the case of using the camera mode, a photographed image of the subject may be displayed, and in the video call mode, image information of the calling party may be displayed.

The display unit 200 may be implemented using a display device such as a liquid crystal display (LCD), organic light emitting diodes (OLED), or the like.

The command keypad 202 is provided with various kinds of command buttons. A menu button, a call button, a call end button, and the like may be provided as key buttons of the command keypad 202.

The number keypad 204 is provided with number buttons and is used, for example, when selecting a telephone number or a specific number of a menu.

The camera unit 206 includes a lens, an image sensor, and the like. The image sensor converts an optical signal for a subject input through the lens into an electrical signal and outputs the electrical signal.

The image sensor may include a charge coupled device (CCD) including a plurality of unit pixels and a complementary metal oxide semiconductor (CMOS) sensor.

On the other hand, the camera unit 206 may further include an image processor for processing the RGB data which is an electrical signal output from the image sensor. In general, the image processor interpolates and corrects the RGB data and outputs the image data (YUV data) including luminance and chromaticity information.

During a video call, the mobile communication terminal transmits an image of the user captured by the camera unit 206 to the mobile communication terminal of another user. According to an exemplary embodiment of the present invention, the mobile communication terminal automatically switches modes and transmits a substitute image to the counterpart when a predetermined condition is satisfied without a user's separate key selection.

As shown in FIG. 2, the automatic switching to the alternative image transmission mode may be performed when the optical signal entering the camera unit 206 is blocked as the user covers the camera unit 206 with the hand 208 or the like. have.

That is, the mobile communication terminal according to the present invention switches the mode to the transmission of the replacement image when the light entering the camera unit 206 is cut off during the video call and the luminance information of the optical signal is lowered below the predetermined threshold.

With reference to Figures 3 and 4 looks at in more detail with respect to automatic mode switching according to the present invention.

3 is a block diagram showing an internal configuration of a mobile communication terminal according to an embodiment of the present invention.

As shown in FIG. 3, the mobile communication terminal according to the present invention includes an RF module 300, a luminance analyzer 302, a controller 304, a storage unit 306, a keypad unit 308, and a video codec ( 310, an audio codec 312, a microphone 314, and a speaker 316.

In addition, as described in FIG. 2, the mobile communication terminal may include a camera unit 206 and a display unit 200.

The RF module 300 performs a process of extracting a baseband signal by receiving and demodulating a voice signal and image data of a counterpart received from an antenna.

In addition, the RF module 300 modulates the user's voice and photographed image data, and allows the modulated high frequency signal to be transmitted through the antenna.

The luminance analyzer 302 is connected to the camera unit 206 and performs a process of analyzing luminance information (contrast information) of an optical signal introduced into the camera unit 206.

The image sensor may output an electrical signal in units of frames, and the luminance analyzer 302 determines whether luminance information corresponding to each frame is less than or equal to a preset threshold.

When a user making a video call covers the camera unit 206 with his hand, the luminance information may be sharply lowered in a specific frame as light input to the image sensor is blocked.

When the luminance information is lowered below the threshold, the luminance analyzer 302 outputs a predetermined signal to the controller 304 so that a substitute image, rather than a captured image, may be transmitted.

The controller 304 controls the overall operation of the mobile communication terminal. For example, a control process for transmitting / receiving an audio signal and transmitting / receiving an image signal is performed. In particular, according to the present invention, the control unit may automatically switch to an alternative image transmission mode according to the information analyzed by the luminance analyzer 302.

The storage unit 306 may store a substitute image to be transmitted to the counterpart when the automatic mode is switched, where the substitute image may include a still image as well as a video.

When the luminance analyzer 302 determines that the luminance information is lower than the threshold, the controller 304 controls the replacement image stored in the storage 306 to be transmitted through the RF module 300.

The keypad unit 308 includes the command keypad unit 202 and the number keypad unit 204, and generates and provides a key event signal corresponding to a key pressed by the user to the controller 304.

The controller 304 controls the display 200 to display a menu corresponding to the key event signal.

Meanwhile, when the user selects transmission of the photographed image again through the keypad 308 after switching to the alternative image transmission mode through analysis of the luminance information, the controller 304 controls the photographed image to be transmitted.

The retransmission process of the captured image may be performed according to the luminance analysis of the luminance analyzer 302.

The luminance analyzer 302 may determine the luminance information of the frame received after a predetermined time has passed after switching to the alternative image transmission mode. If the current luminance information is higher than the preset threshold, that is, it is determined that the optical signal is not blocked, the controller 304 outputs a message for inquiring the image 200 to be retransmitted to the display unit 200 and the user. If you agree, you can send the captured images again.

The video codec 310 encodes the image of the photographed user and also decodes the image transmitted from the counterpart. The encoded image is transmitted to the counterpart via the RF module 300, and the decoded counterpart image is output through the display unit 200.

The audio codec 312 encodes the voice of the user input from the microphone 312, and also decodes the voice provided from the counterpart and transmits it through the speaker 314.

In this case, the controller 304 may control the user's voice and video to be synchronized with each other during a video call, and for this purpose, the encoded voice and video may be mixed to be synchronized to be transmitted to the counterpart. In addition, the mixed signals of the audio and video received through one line are separated in synchronization to control them to be decoded by the video codec 310 and the audio codec 312, respectively.

4 is a flowchart illustrating a process of providing a substitute image according to an embodiment of the present invention.

4, when starting a video call (step 400), the camera unit 206 is driven (step 402).

The mobile communication terminal transmits the captured image through the camera unit 206 during the video call (step 404).

During the video call, the luminance analyzer 302 of the mobile communication terminal receives luminance information (step 406). The luminance information may be a luminance level for each frame output from the image sensor.

The luminance analyzer 302 calculates the luminance information difference based on the received luminance information (step 408).

Here, the luminance information difference may be a luminance level difference between the current input frame and the previous frame.

Thereafter, the luminance analyzer 302 determines whether the luminance information difference is greater than a preset first threshold (step 410). Here, the determination of the luminance analyzer 302 may be a process of determining whether the current frame is much darker than the previous frame.

If the difference in the luminance information is greater than the preset first threshold, the luminance analyzer determines whether the luminance information of the current frame is less than or equal to the preset second threshold (step 412).

If the luminance information is less than or equal to the preset second threshold, the mobile communication terminal stops transmitting the captured image and transmits the substitute image (step 414).

In this case, the replacement image is transmitted by extracting the replacement image stored in the storage unit 306.

In the above description, the replacement image is transmitted from the mobile communication terminal. However, the extraction and transmission of the replacement image may be performed in the mobile communication network.

5 is a diagram illustrating a configuration of an alternative image providing system according to another exemplary embodiment of the present invention.

As shown in FIG. 5, the image providing system according to the present invention corresponds to a mobile communication system, and includes a plurality of mobile communication terminals 500, a node B 502, a radio network controller 504, and an exchanger ( The mobile switching center (MSC) 506 may include a home location register (HLR) 508 and an additional service server 510.

5 shows a portion of a WCDMA network, which is a 3G network, where NodeB 502 is responsible for transmitting and receiving data over the air interface.

The node B 502 sets up a wireless physical channel necessary for exchanging data (voice and video data for a video call) with the mobile communication terminal 500 according to the control information transmitted from the RNC 504, and transmits from the higher protocol. The data is converted into a wireless environment and transmitted to the mobile communication terminal 500. In addition, the data received from the mobile communication terminal 500 transmits to the upper protocol of the RNC (504).

The RNC 504 dynamically allocates radio resources and performs a switching function of data transmitted to each NodeB. In this case, the RNC 504 is directly connected to a core network including the MSC 506 and serves as an access point of a service for all services provided through the core network.

Switch 506 is responsible for mobility control, location registration / management, authentication, roaming, and the like.

The home location register 508 provides detailed information about the subscriber and the location information of the mobile communication terminal 500 according to the request of the exchange 506, and the exchange 506 is linked with the home location register 508. It performs functions such as call routing and call roaming.

As shown in FIG. 3, the mobile terminal 500 according to the present invention analyzes the luminance information of the optical signal introduced into the camera unit during a video call to determine whether the optical signal input to the camera unit 206 is blocked, such as covering a hand. Can be determined.

According to another embodiment of the present invention, when the mobile communication terminal 500 determines that the luminance information is lowered below a preset threshold, that is, when it is determined that the optical signal is blocked, the mobile communication terminal 500 changes the switch 506. The alternative video request signal may be transmitted to the side.

In another embodiment of the present invention, the substitute image corresponding to each user may be stored in the supplementary service server 510 connected to the switch 506, and the switch 506 may be replaced from the mobile communication terminal 500 as described above. When the video request signal is received, the substitute video set to correspond to the user or commonly set for all users may be extracted from the additional service server 510 and transmitted to the mobile communication terminal of another user.

In the above description, the switch 506 transmits the replacement video when the replacement video is transmitted. However, when the exchange 506 transmits the replacement video, the image transmitted from the first mobile communication terminal is lower than the preset threshold, that is, the image is very dark. It may determine this by itself and transmit the replacement image to the second mobile communication terminal.

6 is a flowchart illustrating a process of providing a substitute image according to another embodiment of the present invention.

FIG. 6 is a diagram for describing a case in which a substitute image is transmitted according to a change in luminance information of a first mobile communication terminal during a video call.

Referring to FIG. 6, the mobile communication network mediates a video call between the first mobile communication terminal and the second mobile communication terminal at the request of each user (step 600).

During the video call, the first mobile communication terminal 500 determines whether there is a change in luminance information on the optical signal introduced into the camera unit 206 (step 602).

Here, the determination of the change of the luminance information is a process of determining whether the luminance information introduced into the camera unit 206 is lowered below a preset threshold.

In operation 602, the calculation of the difference between the luminance information of the current frame and the luminance information of the past frame may be preceded.

When the luminance information is lowered below a preset threshold, the first mobile communication terminal 500 transmits a replacement video transmission request to the mobile communication network (step 604).

When there is a replacement video transmission request, the switch 506 of the mobile communication network determines whether the subscriber of the first mobile communication terminal is an alternative video transmission service subscriber (step 606), and if the subscriber is a service subscriber, replaces it with a second mobile communication terminal. The image is transmitted (step 608).

On the other hand, after the transmission of the replacement image, the first mobile communication terminal can again determine whether the brightness is changed (step 610).

Step 610 may be a process of determining whether an optical signal is input to the camera unit 202 again after a predetermined time elapses.

When the optical signal is input again, the first mobile communication terminal 500 transmits the captured image to the second mobile communication terminal through the mobile communication network (steps 612 to 614).

Preferred embodiments of the present invention described above are disclosed for purposes of illustration, and those skilled in the art will be able to make various modifications, changes, and additions within the spirit and scope of the present invention. Additions should be considered to be within the scope of the following claims.

As described above, according to the present invention, there is an advantage that can provide convenience to the user because it automatically switches to the alternative image mode.

Claims (10)

       In the mobile communication terminal providing a video call service,        A camera unit for converting an optical signal for a subject into image data; And        And a luminance analyzer analyzing the luminance information of the optical signal introduced into the camera to transmit a substitute image instead of the image data photographed according to the analyzed luminance information.        The method of claim 1,        The luminance analyzer determines whether the analyzed luminance information is equal to or less than a preset threshold,        And the substitute image is transmitted when the luminance information is equal to or less than a preset threshold.        The method of claim 1,        The luminance analyzer calculates a difference between the current luminance information and the previous luminance information, and determines whether the current luminance information is less than or equal to a preset second threshold when the luminance information difference is greater than a preset first threshold. Mobile communication terminal.        The method of claim 2,        The luminance analyzer analyzes the luminance information of the optical signal introduced into the camera unit after a predetermined time elapses after the transmission of the replacement image, and transmits the captured image data when the luminance information is greater than or equal to a preset threshold. Characterized in a mobile communication terminal.        In the method for controlling the transmission of the substitute video in a mobile communication terminal providing a video call service,        (a) outputting luminance information on the optical signal introduced into the camera unit;        (b) analyzing the output luminance information; And        and transmitting a substitute image instead of the captured image based on the analysis information.        The method of claim 5,        The step (b) includes determining whether the brightness information is less than or equal to a preset threshold,        And the substitute image is transmitted when the luminance information is equal to or less than a preset threshold.        The method of claim 5,        In step (b),        (b1) calculating a difference between the current luminance information and the previous luminance information;        (b2) determining whether the luminance information difference is greater than a first predetermined threshold; And        and (b3) determining whether the current luminance information is less than or equal to a preset second threshold when the difference in luminance information is greater than a preset first threshold.        A computer-readable recording medium having recorded thereon a program for performing the method according to any one of claims 5 to 7.        A method of transmitting a substitute video in a mobile communication system that provides a video call service to a plurality of mobile communication terminal,        (a) mediating a video call between a plurality of mobile communication terminals; And        (b) if there is a change in the luminance information of the optical signal introduced into the first mobile communication terminal, extracting a preset substitute image and transmitting the same to the second mobile communication terminal,        And the mobile communication terminal analyzes the luminance information of the optical signal introduced into the camera unit and requests the replacement image transmission according to the analyzed luminance information.        The method of claim 9,        Receiving a captured image transmission request according to the change of the brightness information in the first mobile communication terminal during the replacement image further comprising:        The request for transmitting the captured image according to the change of the luminance information is performed when it is determined that the optical signal is re-input to the camera unit after a predetermined time elapses after transmitting the alternate image.

Images