KR100211327B1 - Method of concurrently processing video and audio in a home automation device - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

Simultaneous processing of video and audio in home automation equipment.

2. The technical problem to be solved by the invention

In the interphone function performed in the conventional home automation equipment, the image memory capable of recording still images and the voice memory capable of recording audio are operated separately, so that only one signal of the image signal or the audio signal is applied to the key input. It is selected and saved or played in the memory. Therefore, the data stored according to the visitor's visit has a problem that it is difficult for the user to accurately identify the visitor because only one of the image or audio is selectively recorded or reproduced.

3. Summary of Solution to Invention

When the visitor's call is detected in the outing mode, the stored still image data and the voice data are simultaneously stored in the image memory and the voice memory, and the start address at which the still image data and the voice data starts to be stored corresponds to the same index of the buffer. And a recording process for storing the data, and sequentially retrieving the presence or absence of data storage from the last index of the buffer, and reading the stored start address corresponding to the index where the storage of the data is detected from the buffer and A playback process of simultaneously reproducing the still picture data and the voice data stored at the start address of the voice memory; and if the request to delete the reproduced still picture data and the voice data is detected, the image data and the voice data are simultaneously deleted from the image memory and the And deleted data Image and a method of simultaneous voice processing composed of the memory address of the memory and the voice memory in the deletion process of deleting from the buffer.

4. Important uses of the invention

Home automation equipment.

Description

Simultaneous processing of video and audio in home automation equipment

1 is a block diagram showing a general home automation equipment.

2 is a diagram illustrating a control flow for processing an image and a voice in a home automation apparatus according to the related art.

3 is a diagram illustrating a control flow for simultaneously processing an image and a voice in a home automation apparatus according to an embodiment of the present invention.

4 is a diagram illustrating a memory map structure according to an embodiment of the present invention.

The present invention relates to a home automation device, and more particularly, to a method for simultaneously processing a still picture and a voice of a visitor stored by a visitor's call.

The general home automation equipment refers to a device built in one system by combining an interphone, a general telephone, a safety-related safety device, and a home appliance power control function using a unidirectional adapter.

FIG. 1 illustrates a general configuration required for performing the interphone function in the home automation device.

Referring to FIG. 1, the CPU 10 generally controls each component to perform the interphone function. The camera 112 transmits the visitor's image signal under the control (C.S1) of the CPU 10 when the visitor calls. The monitor 114 reproduces the visitor's image under the control of the CPU 10 (C.S2). The A / D converter 116 converts the image signal transmitted from the camera 112 into a digital signal under the control of the CPU 110 and outputs the digital signal. The image memory 120 stores image data output from the A / D converter 116 under the control of the CPU 110 and outputs selected image data under the control of the CPU 110. The D / A converter 118 converts the image data output from the image memory 120 into an analog signal under the control of the CPU 110 and outputs the analog signal to the monitor 114. The sync separator 122 separates the sync signal from the image signal output from the camera 112. The clock generator 124 provides a synchronization signal to an image signal output from the D / A converter 118 according to the synchronization signal separated by the synchronization separator 122. The microphone 128 reproduces the visitor's voice signal under the control (C.S3) of the CPU 110 when the visitor calls. The codec 132 converts an analog signal transmitted from the microphone 128 into a digital signal and outputs the digital signal. The codec 132 converts the digital signal into an analog signal and outputs the analog signal to the speaker 130. The DSP 134 processes the digital signal output from the codec 132 into binary data and stores the digital signal in the voice memory 135, and under the control of the CPU 110, binarizes the voice signal 136. The selected voice data among the voice data stored as the data is read and signal processed into a digital signal and transmitted to the codec 132. The key input unit 138 is composed of key metrics having a plurality of keys including a key for setting a mode performed in the home automation device, and provides the CPU 110 with key data generated according to key input.

Conventionally, the process of processing the visitor's image and sound is as shown in FIG. Referring to FIG. 1 and FIG. 2, the conventional operation will be described. In operation 210 and 212, the CPU 110 detects whether a key for setting a recording mode or a reproduction mode is input from the key input unit 138. If the key input for setting the recording mode is detected in step 210, the CPU 110 proceeds to step 214 and determines whether the key is a key for requesting a visitor's image recording or a voice recording.

If it is determined in step 214 that the key is a request for image recording, the CPU 110 stores the still image data of the visitor input through the camera 112 in the image memory 120 in step 216.

However, if it is determined in step 214 that the key is a voice recording request, the CPU 110 proceeds to step 218 and stores the voice data of the visitor input through the microphone 128 in the voice memory.

In addition, when the key input for setting the playback mode is detected in step 212, the CPU 110 proceeds to step 220 and determines whether a key for requesting a visitor's image playback or a key for audio playback is determined. If it is determined in step 220 that the key is required for image reproduction, the CPU 110 reads the still image data of the visitor from the image memory 120 and reproduces the image through the monitor 114 in step 224. However, if it is determined in step 220 that the key is required to play the voice, the CPU 110 proceeds to step 222 and reads the visitor's voice data from the voice memory 136 and plays it through the speaker 130.

As described above, conventionally, an image memory capable of recording still images and an audio memory capable of recording audio are operated separately, so that only one signal of an image signal or an audio signal is selected for a key input, and the image memory is selected. Stored or played. Therefore, the data stored according to the visitor's visit has a problem that it is difficult for the user to accurately identify the visitor because only one of the image or audio is selectively recorded or reproduced.

Accordingly, an object of the present invention is to provide a method of storing a visitor's still image and audio in synchronization with different memories.

Another object of the present invention is to provide a method of synchronizing the playback of still images and voices of visitors stored in different memories.

It is still another object of the present invention to provide a method for simultaneously deleting still images and voices of visitors stored in different memories.

According to the present invention for achieving the above object, after the visitor's call is detected in the outing mode, the still image data and the audio data are simultaneously stored in the image memory and the audio memory, and then the still image data and the audio data start to be stored. A recording process of storing the memory address corresponding to the same index of the buffer, and sequentially detecting whether data is stored from the last index of the buffer when a reproduction request is detected, and storing the memory address corresponding to the index from which the storage of data is detected. Reading from the buffer and simultaneously reproducing the still image data and the audio data stored in the memory addresses of the image memory and the voice memory; and if the request to delete the reproduced still image data and the audio data is detected, the image data and the audio data. At the same time as the image memory and the audio memory And a memory address of the image memory and the audio memory in which the data is deleted and the data are deleted from the buffer.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Note that the configuration for carrying out the present invention is the same as that of FIG. 1 described above, and the reference numerals of the configurations described below are also used the same.

3 is a control flowchart according to the present invention, when a visitor's call is detected when the outing mode is set, the memory address is stored after converting the image data and the audio data transmitted by driving with the camera and storing them in the image memory and the voice memory. Recording at the same time in response to the index, reading the memory address last stored according to the index according to the playback request, and simultaneously reproducing the image data and the audio data stored in the memory addresses of the image memory and the voice memory, and the image data And if the deletion request is made during or after the reproduction of the audio data, the audio data of the reproduced or reproduced image data is simultaneously deleted.

4 shows a map structure of a memory for storing data generated according to the implementation of the present invention.

FIG. 4 (a) shows a memory map structure provided in the CPU 110. The map includes an area in which an index for managing the memory addresses of the image memory and the voice memory is stored, and an index is stored in the index. And a region in which the memory address of the image memory 120 stored correspondingly is recorded, and a region in which the memory address of the audio memory 136 stored corresponding to the index is recorded.

4 (b) shows a map structure of the image memory 120. The map is composed of an area in which an image memory address is stored and an area in which image data is stored corresponding to the memory address.

4 (c) shows a map structure of the voice memory 136. The map is composed of an area in which a voice memory address is stored and an area in which voice data is stored corresponding to the memory address.

Hereinafter, an operation according to an embodiment of the present invention will be described in detail with reference to the above-described configuration.

The CPU 110 detects whether there is a call from the visitor in step 310, and determines whether there is a play request in step 312. If it is determined in step 310 that there is a call from the visitor while the outing mode is set, the CPU 110 proceeds to step 314. In step 312, the CPU 110 drives (C.S1) the camera 112 to transmit the still image of the visitor, and controls the microphone 128 to transmit the visitor's voice (C.S3). To drive. The CPU 110 controls the A / D converter 116 in step 316 to convert the still picture signal transmitted from the camera 112 into still picture data in the form of a digital signal, and also the codec 132 and the DSP. The control unit 134 controls the voice signal transmitted from the microphone 128 to be digitally processed and converted into a binary code. The CPU 11 stores the converted still image data and audio data in the image memory 120 and the audio memory 136 in step 318. The still image data and audio data are stored in the image memory 120 and the audio memory 136 having the map structure shown in Figs. 4A and 4B.

The CPU 110 determines whether the time set in step 320 has elapsed. The CPU 110 performs steps 316 and 318 until it is determined that the set time has elapsed in step 320. If it is determined in step 320 that the set time has elapsed, the CPU 110 proceeds to step 322 and in step 318 the memory address (start address; Start address; Add.n) where the image data starts to be stored in the image memory 120. ) And a memory address (start address; Add.n ') at which voice data starts to be stored in the voice memory 136 in the internal memory having the map structure of FIG. In operation 324, the CPU 110 transmits control signals C. S1 and C. S3 to block the camera 112 and the microphone 128 and ends the function.

In addition, when it is detected in step 312 that a key for requesting reproduction of data stored in the image memory 120 and the voice memory 136 has been input from the key input unit 138, the CPU 110 proceeds to step 326 to perform the fourth step. (a) A count value (hereinafter, denoted as n) for selecting an index of the internal memory having the structure shown in FIG.

For example, in the following operation description, it will be described on the assumption that the index value for managing data is set to 10.

The CPU 110 searches for an internal memory having the structure of FIG. 4 (a) to determine whether a start address (Add.n, Add.n '), which is a memory address written corresponding to the nth index, exists in step 328. To judge. If it is determined in step 328 that the start addresses Add.n and Add.n 'are not recorded in the selected index, the CPU 110 proceeds to step 336 and decreases n by one to select the next index. Return to step 328. If an index in which start addresses (Add.n, Add.n ') are recorded in steps 328 and 336 is detected, the CPU 110 proceeds to step 330 and records corresponding to the index detected in step 328. The start addresses Add.n and Add.n 'are read from the internal memory having the structure of FIG. 4 (a), and the read start addresses from the image memory 120 having the structure of FIG. The image data stored in Add.n) is reproduced through the monitor 114. Also, the voice data stored at the start address Add.n 'read out from the voice memory 136 having the structure of FIG. 4 (c) is reproduced through the speaker 130. FIG. When the CPU 110 detects an input of the stop key for playback in step 332, the CPU 110 terminates the playback function. If there is no stop key input, the CPU 110 proceeds to step 334. It detects whether it is input from the key input unit 138. If the delete key is not input in step 334, the CPU 110 proceeds to step 336, decreases n by one, selects the next index, and returns to step 328. Otherwise, if the delete key input is detected, the CPU 110 proceeds to step 338 and deletes the image data stored at the start address Add.n from the image memory 120 having the structure of FIG. 4 (b). At the same time, the voice data stored in the start address (Add.n ') is deleted from the voice memory 136 having the structure shown in FIG. Then, the start addresses (Add.n, Add.n ') recorded corresponding to the index corresponding to n are deleted from the internal memory having the structure of FIG. 4 (a). When the deletion is completed, the CPU 110 proceeds to step 340 and determines whether n has a 10 indicating the last index. If the value of n is determined to be 10 in step 340, the deletion function is terminated. However, if it is determined in step 340 that the value of n is not 10, the CPU 110 proceeds to step 342 and the start address (Add.n + 1, Add) recorded in the memory address area corresponding to the index of n + 1. , n + 1 ') is stored corresponding to the index designated by n. The CPU 110 proceeds to step 344 to increase n by one and returns to step 340 to compare the value of n to 10. The steps 340, 342, and 344 are performed to rearrange the start address according to the index to manage the image data and the audio data in the stored order.

Steps 340, 342, and 344 are performed until rearrangement is performed to the last index.

As described above, the present invention has the effect of providing information about the visitor to the user more accurately by simultaneously storing and playing the image and the voice which are the information about the visitor.

Claims (2)

A method of simultaneously processing a still image and a voice in a home automation device, comprising: driving a camera and a microphone to receive still image data and audio data when a visitor's call is detected in an outing mode; Converting the digital signal into an image memory and storing the provided audio data in a digital signal; and storing the still image data after a predetermined time elapses after the visitor's call is detected. Recording the start address of the area and the start address of the voice memory area in which the voice data is stored in correspondence with the same index; and determining whether data is stored by searching the start address recorded in response to the index in reverse order by a reproduction request. And the data storage is retrieved by the determination. And reading the start address of the image memory and the start address of the audio memory recorded in correspondence with the corresponding index, and accessing the image memory and the audio memory by the read start address, respectively. And converting the read still image data into an analog signal and outputting the same to a monitor, digitally processing the read audio data through a speaker, and responding to an index selected by a delete request. And deleting the still image data and the audio data stored in the image memory and the voice memory area corresponding to the deleted start address after deleting the recorded start address. Voice simultaneous processing method. The home automation apparatus of claim 1, wherein when the index in which the start address is deleted is not the last index among the indices in which the start address is recorded, the start address is sorted and stored again based on the deleted index. And voice simultaneous processing.