KR20040096350A - Apparatus for processing video and audio in telecommunication terminal - Google Patents

Abstract

PURPOSE: A video and voice processing device in a communication terminal is provided to collect video information by using a camera mounted on a terminal while collecting voice information in real time through a microphone, and to synthesize the collected video information with the voice information to store the synthesized information in a memory. CONSTITUTION: A key input unit(19) is used for a user input. A controller(12) processes photographed videos and outputted voices into integrated-type information by simultaneously generating a photographing drive control signal and a voice input/end control signal, and controls a simultaneous outputting of the voices while reproducing the videos. A memory(20) stores the integrated-type information. A video processor(16) processes the photographed videos into signals, and outputs the processed video signals through an LCD(17). A voice processor(13) processes a voice inputted by driving a microphone(14) into a signal, processes a voice mapped with the videos, and outputs the processed voice in real time through a speaker(15) while the corresponding videos are reproduced.

Description

Apparatus for processing video and audio in telecommunication terminal

The present invention relates to a video and audio processing apparatus in a communication terminal, and more particularly, to record and store audio together at the same time when capturing a subject in a mobile communication terminal equipped with a camera (video information + audio information), and later play and Transmission to other terminals is possible.

Nowadays, from mobile pagers to cellular phones, personal mobile phones (PCS), IMT-2000 (International Mobile Telecommunication) and UMTS (Universal Mobile Telecommunication Service) based mobile communications in recent years The communication environment is developing at a tremendous speed, and with the development of mobile communication terminals, the search for additional services available through the terminals is actively being developed.

In particular, the development of ultra-high speed mobile communication to IMT-2000 and UMTS, which is actively progressing at home and abroad, foretells the growth of data communication field using wireless network, and among these data communication areas, which are currently receiving the most attention. It is the transmission and reception of various information through the wireless Internet, and as the transmission speed of wireless data transmission and reception is improved, it is possible to transmit and receive images with large data sizes.

In addition, due to the development of hardware, communication terminal devices using the transmitted images are being developed. In recent years, a communication system is provided to provide the mobile communication speed so that there is no shortage of video transmission. It is a situation that is commercialized.

In general, the photographing using a portable terminal device with a built-in camera function is mainly a function of capturing and storing a subject and later viewing it through a display device (LCD) or transmitting it to another terminal through communication. However, at this time, only the video information may be collected through the camera, the audio information may be collected independently or the text information may be input after the video information is collected (photographed), and the atmosphere or detailed description at the time of collecting the video information may be displayed in real time. There is no function to record (attach) audio information at the same time with image information in order to express accurately.

Therefore, if the terminal equipped with the camera has a function capable of reflecting the environmental elements (voice information such as the atmosphere or the detailed description) at the time of capturing in real time from the subject imaging stage, it can be used very conveniently with the camera function. There will be.

The present invention has been proposed to meet the above demands, and records and stores audio in real time together with an image when capturing a subject in a mobile communication terminal equipped with a camera (video information + audio information), and later video and audio. It is an object of the present invention to provide a video and audio processing device capable of simultaneous playback and transmission to other terminals.

1 is a block diagram of an embodiment of a video and audio processing apparatus in a communication terminal according to the present invention;

* Explanation of symbols on the main parts of the drawing

11: RF unit 12: control unit

13: voice processing unit 14: microphone

15: speaker 16: image processing unit

17: LCD 18: Camera

19: key input unit 20: memory

In order to achieve the above object, the present invention provides a video and audio processing apparatus in a terminal equipped with a camera, comprising: user input means for user input; According to the user's key operation, the imaging drive control signal and the audio input / end control signal are simultaneously generated to process the captured image and the uttered audio into integrated information, and the video reproduction control signal and the audio output control signal are simultaneously generated. Control means for simultaneously outputting and controlling the corresponding audio during the video reproduction time; Storage means for storing the integrated information mixed with video and audio; Image processing means for driving a camera according to the imaging driving control signal to signal-process the captured image, and for outputting a screen by processing the corresponding image according to the video reproduction control signal; And driving a voice input apparatus according to the voice input / end control signal to process the input voice, and process a voice mapped to the corresponding image according to the voice output control signal to process the corresponding image through the voice output apparatus. It characterized in that it comprises a voice processing means for outputting in real time during the video playback time.

In addition, the present invention is characterized in that it further comprises a communication means for communicating with the other terminal the integrated information mixed with video and audio under the control of the control means.

The present invention collects the voice in real time through the microphone of the terminal at the same time or immediately after the image capturing in a mobile communication terminal equipped with a camera and stores it together with the image information, and when the image information is later displayed on the LCD or transmitted to another terminal Simultaneously output or transmit voice information along with information.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an embodiment of a video and audio processing apparatus in a communication terminal according to the present invention.

It should be noted that the subject image capturing and voice simultaneous recording function according to the present invention can be selectively used according to the user's menu selection when the camera mode is operated on the terminal equipped with the camera. That is, in the camera mode, not only the imaging of the subject is possible according to the user's menu selection (video function), but also the voice recording is possible simultaneously with the subject imaging (video + audio function).

Hereinafter, a function (image function) that can only capture a subject during the camera mode operation will be omitted, and a function (image + audio function) capable of capturing a voice simultaneously with capturing a subject according to a user's selection will be described. Accordingly, the camera mode operation in the following should be understood as a " video + audio function " capable of simultaneously capturing a subject and recording a voice.

As shown in FIG. 1, the video and audio processing apparatus in the communication terminal according to the present invention includes a key input unit 19 for user input (subject image capture and audio input keys, voice end keys, video and audio playback keys). And an imaging drive control signal and an audio input / end control signal are simultaneously generated according to the user's key operation to process the captured image and the uttered audio into integrated information (video information + audio information), and the video reproduction control signal. And a control unit 12 for simultaneously generating and outputting an audio output control signal and controlling the output of the corresponding audio during the video playback time and the integrated information (video information + audio information) in which the video and audio are mixed. A memory 20 and a camera 18 according to an imaging drive control signal to signal-process the captured image, and signal-process the corresponding image according to an image reproduction control signal to display the LCD ( 17) the image processor 16 for outputting the screen and the microphone 14 is driven according to the voice input / end control signal to signal the input voice, and the voice mapped to the corresponding video according to the audio output control signal. And a sound processor 13 for signal processing to output in real time during the image playback time of the corresponding image through the speaker 15. Further, the control unit 12 further includes an RF unit 11 for wirelessly communicating with other terminals through the wireless network the integrated information (video information + audio information) in which video and audio are mixed. In this case, the integrated information (video information + audio information) in which video and audio are mixed can be transmitted to a PC through a USB port or the like.

The present invention captures a subject during camera mode (video + audio function) operation in a mobile communication terminal equipped with a camera 18, or immediately opens a microphone 14 and captures the voice in real time to collect a voice in real time. Digital (A / D) conversion to audio coding, and the like, and are stored in the memory 11 together with the captured image. Subsequently, when the user displays the captured image on the display unit 17, the corresponding sound is played along with the image through a voice demodulation process (decoding → digital / analog (D / A) conversion, etc.) The photo reflects the atmosphere of the time. In addition, the information stored in the memory 11 (images and audio information mapped to) integrated into other terminals (PC, notebook, personal digital assistant (PDA), cellular phone or PCS phone, IMT-2000 phone via wired or wireless communication network) , UMTS phone, etc.) is possible.

When the camera mode (video + audio function) is selected according to the user's key operation, the audio input control signal (microphone drive signal) is automatically generated simultaneously with the camera drive signal as the image capture button (simultaneously performs the audio input button function). The camera 18 captures the subject and collects the voice through the microphone 14. In this case, the human voice recording is usually much longer than the subject image capturing time, so that after the subject image capturing is finished, a certain period of time (preferably about 5 seconds) is maintained for the automatic voice recording without a user's key manipulation. More preferably, the voice end control signal (microphone end signal) can be generated by the user's key operation (pressing the voice end button) to ensure a variable length during voice recording. Of course, in the camera mode according to the user's key operation (video + audio function), a voice input button for notifying the start of voice recording may be additionally configured separately from the image capturing button for capturing the subject. Voice end button is preferably provided separately.

First, in order to simultaneously record a subject by using the camera 18 embedded in the mobile communication terminal, the camera mode (video + audio function) is activated by selecting the subject imaging and voice recording menu in the camera mode.

Subsequently, when the imaging button is pressed, the control unit 12 generates an imaging driving control signal (camera driving signal), and accordingly, the image processing unit 16 drives the drive IC (Integrated Circuit) of the camera 18 to capture the subject. Image processing information (image information) (image modulation process). That is, according to the imaging driving control signal (camera driving signal), the camera 18 converts the image of the subject to be captured into an electrical signal through optical / pre-conversion, and the image processor 16 outputs the image signal of the subject to be captured. Encode.

At the same time, when a pressing of an imaging button which simultaneously performs a voice input button function or a pressing of a separate voice input button is detected, the controller 12 together with an imaging driving control signal (camera driving signal) and a voice input control signal (microphone driving signal). ), The voice processing unit 13 operates the microphone 14 according to the voice input control signal (microphone driving signal), and when the voice end button is detected by the user's key operation, the control unit 12 generates the voice. Generates an end control signal (microphone end signal), terminates the microphone 14 by the audio processing unit 13 according to the audio end control signal (microphone end signal), and processes the audio information collected by the start and end of the audio. (Voice modulation process). That is, according to the voice input control signal (microphone drive signal) and the voice end control signal (microphone end signal), the voice processing unit 13 converts the audio signal collected through the microphone 14 into an analog / digital (codec) codec (codec). A / D) is converted to a digital bitstream by the pulse code coding (PCM) method, and compressed in a vocoder.

Thereafter, the controller 12 processes the video and audio signal-processed video and audio into integrated information (video information + audio information) and stores the video and audio in the memory 20. Of course, the integrated memory (video information + audio information) of the video and audio transmitted from other terminals may be stored in the memory 20.

Subsequently, when the integrated information (video information + audio information) of video and audio stored in the memory 20 is reproduced, the control unit 12 according to the playback button is pressed for the integrated information (video information + audio information) selected by the user. Generates an image reproduction control signal (display unit driving signal), and accordingly, the image processor 16 demodulates the image through a reverse process of the image modulation process and displays the corresponding image on the display unit 17. At the same time, the control unit 12 generates an audio output control signal (speaker driving signal) together with the image reproduction control signal (display unit driving signal), and accordingly, the voice processing unit 13 performs voice demodulation through the reverse process of the voice modulation process. The audio mapped to the video is output through the speaker 15.

The key input unit 19 is composed of a plurality of numeric keys, menu keys, and function keys for performing various functions, and outputs key data to the controller 12 by an external operation.

In particular, the key input unit 19 may include a subject image capturing key (including a voice input key), a separate voice input key, a voice ending key, an image, and a voice playing key. 9, *, #), a navigation key, a function key, and a side direction key may be set, or a separate key may be newly added on the terminal.

On the other hand, when transmitting information (image and audio information mapped to the image) integrally stored in the memory 11 to another terminal, it is possible to use a multimedia messaging service (MMS) or a conventional short message service (SMS). However, since a normal SMS can transmit only a text message, a short message according to the SMS is generated and transmitted in the following format.

Header Message file data created by video / audio combination trailer

The format is to distinguish the SMS message type as header information in a conventional short message, and put "message file data generated by the combination of video data + audio data" in the user data field. In general, the data amount of "message file data generated by the combination of video data + audio data" will not be sufficient by the user data size of one short message. In this case, it is generated by the combination of one "video data + audio data." A message file "must be sent using several short messages. Therefore, if the size of the mixed message (video + audio message) is large, the trailer information is inserted at the end of the user data field as a recognition code indicating whether the mixed message file data continues with a short message transmitted or terminated. Therefore, the receiver can receive the messages received continuously.

On the other hand, the image captured by the camera 18 is not only mixed with the voice (upbringing) collected in real time through the microphone 14, but also independently mixed later upbringing or MP3 or sound effect downloaded to the memory 20, etc. In this case, first, the function of importing the image captured by the camera 18 and mixing the voice through the menu operation is selected, and during the mixing, the microphone is operated and recorded, and the MP3 or the sound effect mixing are performed. At the time, the sound source can be selected and mixed with the captured image.

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions, modifications, and changes are possible in the art without departing from the technical spirit of the present invention. It will be clear to those of ordinary knowledge.

As described above, the present invention collects video information using a camera mounted on the terminal, and simultaneously collects audio information through a microphone, synthesizes the collected video information and audio information, and stores them in a memory. In the future, it is possible to reproduce more realistic video information and audio information, and to transmit integrated information of video and audio to other terminals.

Claims (3)

In the video and audio processing device in a terminal equipped with a camera, User input means for user input; According to the user's key operation, the imaging drive control signal and the audio input / end control signal are simultaneously generated to process the captured image and the uttered audio into integrated information, and the video reproduction control signal and the audio output control signal are simultaneously generated. Control means for simultaneously outputting and controlling the corresponding audio during the video reproduction time; Storage means for storing the integrated information mixed with video and audio; Image processing means for driving a camera according to the imaging driving control signal to signal-process the captured image, and for outputting a screen by processing the corresponding image according to the video reproduction control signal; And The voice input device is driven according to the voice input / end control signal, and the voice signal is processed by the voice input device, and the voice signal mapped to the video is processed according to the voice output control signal. Audio processing means for outputting in real time during video playback Image and audio processing device in a communication terminal comprising a. The method of claim 1, Under the control of the control means, the communication means for communicating the integrated information mixed with video and audio with other terminals Video and audio processing device in a communication terminal further comprising. The method according to claim 1 or 2, The user input means, By the user's key operation, the control means notifies the control means of the start and end of the audio to be mixed with the video, so that the control means generates the imaging driving control signal and the audio input / end control signal simultaneously. Image and audio in a communication terminal characterized by informing the control means of the reproduction of the image and the audio mapped to the corresponding image, so that the control means generates the image reproduction control signal and the audio output control signal simultaneously. Processing unit.