KR100566980B1 - UMS having a picture data transferring function and controlling method therefore - Google Patents

Abstract

According to the present invention, an IP module for processing an image or audio data of an Internet signal format transmitted from an external device through an Internet network, and a digital PSTN message signal input from the DSP are processed according to the internal format of a UMS for voice recognition. A CPU for storing the voice and image data signals inputted through the IP module and the PSTN module in a database, and processing the voice and image data specified by the user in various combination methods; and a combination control signal of the CPU. Provides a control method of an integrated messaging system equipped with an image data transmission function comprising an integrated data management unit that integrates the combined content blocks of video and audio data into virtual content blocks capable of annotating and stores them in a DB. do.

As described above, the present invention stores images and audio data having a high resolution in a database through the Internet or PSTN network, and transmits the images and audio data to the corresponding video terminal by combining these images and audio data in various ways according to each voice guidance step. When performing the auto relay function, not only audio data but also image data are transmitted to the caller.

IP module, XML data combined with voice and video, combination technique, virtual content

Description

Unified messaging system with image data transfer function and its control method {UMS having a picture data transferring function and controlling method therefore}

1 is an explanatory diagram illustrating an operation of a conventional UMS.

2 is a block diagram illustrating the UMS of the present invention;

3 is a flowchart of the present invention.

<Detailed Description of Codes>

1: private exchange system 2: internet network

3: external equipment 4: IP module

5: DSP 6: UMS

7: PSTN Module 8: DB

9: CPU 10: integrated data management unit

11: Romans 12: Key Panel

The present invention relates to a unified messaging system equipped with an image data transmission function and a control method thereof. In particular, an image and audio data having a high resolution are stored in a database through the Internet or a PSTN network, and these images are adapted to each voice guidance step. The present invention relates to an integrated messaging system having a video data transmission function that combines voice data with various types of voice data and transmits the same to a video terminal.

In general, as the industrial society develops, information communication systems are widely used to transfer data from one point to another desired more appropriately and quickly. Such communication systems are usually homogeneous or heterogeneous communication devices which are geographically dispersed. In most cases, information devices are connected to a network to enable sharing and communication of resources. In the network, a switch is usually used to exchange information converted into an electrical signal with a counterpart, and is divided into a subscriber transmission connecting a subscriber and an exchange and a transmission between stations connecting an exchange period.

In particular, various types of systems are currently developed and used in the exchange system for subscriber transmission in terms of large facility capacity, and simple private exchanges for buildings or small subscribers are widely used. However, such a simple private switching center is provided with a voice messaging system for storing a voice message signal of a caller who is in the absence of an extension subscriber or executing a voice guidance service function to visit a corresponding destination person. Will run.

Then, referring to Figure 1 of the conventional voice messaging system connected to the simple private exchange as described above, DSP 71 for processing the DTMF signal of the voice guidance message signal transmitted and received via the private exchange system 70 as a digital signal; A parser and state transition table 72 which analyzes the DTMF signal of the DSP 71 and selects and outputs an appropriate message to the caller, and finally according to the final number control signal of the DSP 71. And an action module unit 73 for executing a blind transfer process.

On the other hand, referring to the operation of the conventional voice messaging system connected to the simple private exchange as described above, first, when an external caller makes a call to the private exchange system 70, the private exchange system 70 desires through an initial guide broadcast. Ask the caller to choose a number. At this time, when the caller hears the initial announcement and presses the desired number, the private switch system 70 inputs the DSP 71 to the voice messaging system 74. Then, the DSP 71 of the voice messaging system 74 digitally processes the input DTMF signal and inputs it to the parser and the state transition unit 72. Further, the parser and state transition unit 72 analyzes the DTMF signal of the DSP 71 and selects and outputs an appropriate message to the caller. Will be pressed. Therefore, in the above process, when the caller finally presses the number, the DSP 71 transmits the final number control signal to the action module 73 so that the action module 73 performs the final call transfer process. Let's do it. By the way, if the user of the final destination number is busy or missed or there is no set number desired by the caller during the process, the caller will recall (RECALL), wherein the private exchange system 70 sends a recall signal to the voice messaging system. Transfer to the DSP 71 of 74. Then, the voice messaging system 74 processes the code for the reason why the call is not possible through the parser and the state transition unit 72, and then sends out the reason why the call cannot be made based on this code, and stops the call. Alternatively, the service returns to the initial state of the automatic relaying step.

However, since the conventional voice messaging system connected to the conventional simple private exchange as described above is connected to a private exchange system to provide voice data to the caller at various stages and automatically stores the voice data received from the caller during automatic relaying. Since other data, i.e., image data, cannot be processed at all, the user's desires cannot be satisfied, thus bringing considerable obstacles to the high quality of the UMS, and furthermore, a communication system connected to the UMS, for example, a mobile phone equipped with an image camera. In addition, since the image data processed by the PDA or PC can not be received and processed at all, there is a problem that the functionality of the UMS is considerably deteriorated.

Accordingly, the present invention has been invented to solve the above-mentioned conventional problems, and can transmit not only the voice data but also the image data to the caller when performing the automatic relay function, thereby improving the functionality of the UMS. It is an object of the present invention to provide an integrated messaging system equipped with a data transmission function and a control method thereof.

Another object of the present invention is to combine the voice data to the image data of various backgrounds when performing the automatic relay function can be sent at each relay stage, so that the integrated messaging with the image data transmission function that can achieve high quality of the service of the UMS accordingly To provide a system and a control method thereof.

In order to achieve the above object, the present invention communicates with a private exchange system, converts and processes analog PSTN message signals into digital signals, and then compresses or performs a reverse process thereof, and an Internet transmitted from an external device through an Internet network. IP module for processing image or audio data in signal format, PSTN module for processing signal according to internal format of UMS for annotating digital PSTN message signal input from DSP, IP module and PSTN module A CPU for storing the voice and image data signals input through the DB and processing the voice and image data specified by the user in various combinations to generate virtual content, and the CPU according to the combination control signal of the CPU. Content blocks of video and audio data are integrated into virtual content blocks that can be annotated. And provides an image data transmission function is provided with a unified messaging system, characterized in that consisting of an integrated data management unit for storage in the DB.

Another feature of the present invention is an external data receiving and storing step of processing voice and image data received through a PSTN network or an Internet network associated with a private exchange system in a predetermined form and storing it in a DB, and the user after the external data receiving and storing step When a command is set to combine data into a specific form from a user, a combination technique set by a user first configures each of the voice data and the image data stored in the DB into one virtual content, and then virtualizes each of the composed voice and image data. The virtual content configuration step of reconfiguring and storing the virtual content by integrating the contents into the XML form for the annotation function, and when the automatic relay request signal is input from the private exchange system during the virtual content configuration step, the user designates the annotation function. Use virtual content combined by combination method That provides a control method of an image data transmission function is provided with a Unified Messaging system, it characterized in that a combination consisting of a data transmission step of transmitting to the far end, the recipient specified.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

The apparatus of the present invention is connected to the private exchange system 1 as shown in FIG. 2 and used. The apparatus of the present invention is an image of an Internet signal format transmitted from an external device 3, for example, a camera or a PC, through an Internet network 2; The IP module 4 which processes voice data and the private exchange system 1 communicate with each other to convert analog PSTN message signals such as voice or email signals and fax signals into digital signals and then compress or reverse the process. A PSTN module for processing the signal according to the internal format of the UMS 6 for processing the DSP 5 and the digital PSTN message signal input from the DSP 5 for PSTN signal processing, for example, data for voice recognition. 7) and the voice and image data signals inputted through the IP module 4 and the PSTN module 7 are stored in a database (hereinafter referred to as DB; 8) and user-specified voice and image data are stored in various combinations. Processing The CPU 9 transmits during automatic relaying and controls the overall function of the UMS 6, and the content block of image and audio data combined by the CPU 9 according to the combination control signal is capable of annotating. The integrated data management unit 10 is integrated into the virtual content block and stored in the DB (8) .

One end of the CPU 9 includes a ROM 11 having a program for processing audio and image data in various combinations, and a key panel unit 12 for inputting a user function setting signal. Connected.

Here, MPEG7 among the Internet image formats is a language that defines a combination thereof such that MPEG-1, 2, 4 and the like can be used in combination with an image voice such as JPEG, MJPEG, TIFF, GIF, PCM, BMP, etc. This language can be decoded / executed in a program on a user's client, and using them, the contents of one MPEG-7 file can be manipulated. The UMS 6 of the present invention includes this MPEG7 scheme. The video signal is combined with the audio signal.

In addition, the integrated data management unit 10 executes a task using virtual content, which is part or all of the voice content and part or all of the video content is another piece of content configured due to XML for annotation. Or audio / video content is added to another virtual content in a new form. In addition, the above content has a hierarchical structure in which the voice / virtual content is configured as the lowest terminal node and the virtual contents are uploaded thereon. Each node additionally configures each property <properties> phase in XML to define properties of each content. In this case, the contents that can be defined internally can be defined internally using an object language such as perl script or lisp, and the actual XML code is used by inserting the actual XML code into the method for operating in XML. To operate.

 Next, a control method applied to the apparatus of the present invention as described above will be described.

As shown in FIG. 3, the method of the present invention proceeds to the external data reception and storage step S2 in the initial state S1, and processes the voice and image data received through the PSTN network or the Internet network into a predetermined form in a DB. Save it.
After the external data reception and storage step S2, the data combination command determination step S3 is performed to determine whether a command for combining data from the current user is set. If it is determined during the data combination command determination step S3 that the command for combining data from the current user is not set, the process returns to the previous step S2 to repeat the loop.

However, if the command for combining data from the current user is set as a result of the determination during the data combining command determination step (S3), the process proceeds to the data combining step (S4) and annotates the voice and image data by the combination technique set by the user. Are stored in combination as applicable. On the other hand, after the data combination step (S4) to proceed to the automatic relay request determination step (S5) to determine whether the automatic relay request signal is input. If the automatic relay request signal is not input from the private exchange system as a result of the determination during the automatic relay request determination step (S5), the process returns to the external data reception and storage step (S2) and repeats the loop.

However, when the automatic relay request signal is input from the private exchange system as a result of the determination during the automatic relay request determination step (S5), the process proceeds to the combined data transmission step (S6) and the voice combined by the combination method specified by the user as an annotation function. And transmit the image data signal to the caller.

In other words, the CPU 9 of the UMS 6 of the present invention receives the voice or image data through the private exchange system 1 or the Internet network 2 and transmits the voice or image data to the IP module 4 or the PSTN module 7. For example, when the input voice and video signal is an IP signal, the CPU 9 transmits the data from an external device 3, for example, a video device such as a camera, a PC, or a DVR, via the Internet network 2. Image or audio data of the Internet signal format is processed through the IP module 4.

Here, the IP module 4 encodes / decodes an image or voice data packet signal of an input IP signal format. In this case, when the RTP packet has voice in the IP packet, other IP packets are affected. QoS management is performed so as not to receive or if the RTP packet has voice, the PAYLOAD part is copied to the system buffer area. Then, the IP module 4 manages the I, P, P frame units in the case of the image data (the basic unit is MPEG) under the function control of the CPU 9 after the process, or in the case of MJPEG in all the standard frame slices. Indexing is performed for indexing the time information of the input data and the frames corresponding to each time, wherein the video signal is a type of video such as MPEG-1,2,4,7, MJPEG, GIF, TIFF, BMP, etc. ), And then define the data classified according to the current type as XML used by the parent and process it according to the standard. At the same time as the operation, the IP module 4 performs the morphological analysis of the voice data when the input data is a voice signal according to the function control of the CPU 9, wherein the morphological analysis is performed. Through this, each voice data can be converted into a single character data, and thus is converted into an indexable structure and outputted to the CPU 9.

Here, using the speech data through the morphological analysis processed by the IP module 4, the CPU 9 of the UMS (6) performs a function to learn when a new word of speech is detected, and has already had If the word is searched again, it is recorded and caching is performed for the frequent searches in the future.

On the other hand, when the voice data is input to the DSP 5 of the UMS 6 through the private switching system 1, the DSP 5 converts the voice data of the input analog into a digital signal and converts the PSTN module ( 7) to transmit. Then, the PSTN module 7 processes the digital voice data input under the control of the CPU 9 of the UMS 6, for example by encoding / decoding the digital voice data and then transmitting the same to the CPU 9. The voice data to be input is input to the CPU 9 through the morphological analysis process similarly to the IP module 4.

Then, after the morphological analysis process, the CPU 9 of the UMS 6 loads the combination program contained in the ROM 11 from the IP module 4 and the PSTN module 7 through the integrated data management unit 10. The input audio and image data signals are processed in various combinations. At this time, the CPU 9 generates one virtual content block on the frame of the image in accordance with the annotation structure through the integrated data management unit 10. In the integrated data management unit 10 according to the function control of the CPU 9, information such as a combined image is introduced in the virtual block forming process, rather than the image as it is, so that the image information is framed. Or, it is grouped by MPEG-4 or MPEG-7 time unit and used to generate a single virtual content.

In addition, during the virtual block configuration process, the integrated data management unit 10 according to the function control of the CPU 9 also generates a virtual content block for voice, wherein the virtual content block of the voice has already been morphologically analyzed. Since it is the data of the completed speech, a pointer for indexing the speech block is actually used as the data of the virtual content block of the speech.

Meanwhile, after the virtual block configuration process, the integrated data management unit 10 according to the function control of the CPU 9 bundles the virtual content blocks configured in the video / audio processing process into another virtual content block. The virtual content block performs a description of how the preceding audio and video blocks are related and configured.

After the virtual block reconstruction process, the integrated data management unit 10 according to the function control of the CPU 9 uses all of the above-described content blocks in the form of extending the feature blocks of the media in the XML standard format. The media definition has the characteristics of stop, play, layout, etc., play, stop, background, etc., so that virtual contents can be played, stopped, and combined.

On the other hand, the XML can implement a technique for joining voice and video through the following syntax.

Here, referring to an embodiment of the annotation technique described above, it is assumed that one audio file and one video file are bundled with virtual content.

First, the video part is an XML description form of video data having an ID of Video-1. And, File is the name of the file containing the actual image, FileType is the storage type of the image. Time means total recorded capacity. In other words,

</ begin>

<VirtualContent = Video

<ID = video-1>

  <File = "face.mpg">

  <FileType = MPEG-2>

  <Time = 2: 30>

  <Arrangement = IBBP>

  <ArrangementNum = 421>

  </ end>

In addition, the audio portion has an ID of Audio-1, and each element describes a storage form, a storage capacity, and a wav for a file. In other words,

  </ begin>

  <VirtualContent = Audio>

  <ID = audio-1>

  <AudioFile = "call.wav>

  <FileType = wav>

  <Time = 1: 30>

  <Arrangement = NA>

     </ end>

       On the other hand, the following is an example of the Vritual content that describes how to combine the two voice and the video in the state of processing the video and audio data as XML as described above, where the video is output as the background It describes something. In other words,

       </ begin>

       <VirtualContent = Virtual>

       <Components = 2>

       </ begin>

       <ComponentBlock = Video-1>

       </ begin>

       <Start = 23>

       <End = 300>

       <Position = Background>

       </ end>

       </ begin>

       <ComponentBlock = Audio-1>

       </ begin>

       <Start = 1>

       <End = Final>

       </ end>

       </ end>

       </ end>

    Thus, in this way, the syntax is added to the two media in the form of XML to create virtual blocks of the XML standard.

Virtual Content: This indicates whether the virtual content is video, audio, or a virtual composite of these.

Functions (ComponentBlock, Components): These represent the number of blocks and content that each can perform a separate description of the content.

Here, the above two syntaxes describe how several contents are synthesized by repeatedly describing ComponentBlock and Components in VirtualContent.

On the other hand, the voice and image data are combined and stored in the CPU 9 according to the combination method desired by the user through the above process.

Here, if an external caller makes a call to the private exchange system 1, the private exchange system 1 requests the caller to select a desired item through the initial announcement. At this time, when the caller hears the initial announcement and speaks a desired item by voice, the private exchange system 1 inputs it to the DSP 5 of the UMS 6. Then, the DSP 5 of the UMS 6 digitally processes the input voice signal and inputs it to the CPU 9 via the PSTN module 7. In addition, the CPU 9 analyzes the voice signal of the PSTN module 7 and annotates it, so that the CPU 9 already combines an XML message composed of voice and video appropriate to the caller. It selects and outputs, and the caller tells the destination item he / she wants the virtual content completed through the above process several times. Therefore, in the above process, the CPU 9 of the UMS 6 speaks the last selected item by the caller, and recognizes the final item and connects the final item and the telephone number of the other party's receiver designated by the user through the private exchange system 1. .

Therefore, the external terminal receiving the guide data from the UMS 6 via the private exchange 1 by the above process, for example, a mobile phone or a PC, displays the voice and high quality image data transmitted by the UMS 6. do.

In other words, in the structure proposed in the present invention, both video and audio are integrated into a media complex model called MPEG-7, and each of the images is managed in the unit of frame or further, in the unit of object. Using the technology to manage both the speech recognizer (Tpeech Recognizer) and the voice generator (TTS Engine) to manage the indexable form in the computer.

In this case, since the voice and video are combined using the annotation used in MPEG-7, the combination is possible at a very high speed. In addition, the combined video may be made in units of frames or frames so that a user may load a desired voice in a randomly designated time band and transmit a music message including a video and voice to a user who desires the mobile phone. Is possible.

In this case, the video that can be inserted may use MPEG-4 data provided by a base station or a service company or a video recorded by a mobile phone / PDA such as an IMT-2000 SPEC. The video and audio are delivered to the UMS in separate streams, and the UMS combines them based on the previously delivered annotations.

As described above, the present invention stores images and audio data having a high resolution in a DB through the Internet or a PSTN network, and combines the images and the audio data in various manners according to each voice guidance step, and transmits them to the corresponding video terminal. Therefore, when performing the automatic relay function, not only the voice data but also the image data can be transmitted to the caller, thereby having the advantage of significantly improving the functionality of the UMS.

In addition, according to the present invention, it is possible to combine the audio data with the image data of various backgrounds when performing the automatic relay function, and to transmit the audio data at each relay stage, thereby achieving a high quality service of the UMS.

On the other hand, the present invention is not limited to the above-described embodiment and the accompanying drawings, it is usually possible in the technical field to which various substitutions, conversions and changes within the scope without departing from the spirit of the present invention. It will be evident to those who have knowledge of.

Claims (6)

DSP that converts and processes analog PSTN message signals into digital signals by communicating with private switching system and performs reverse process. IP that processes video or audio data of internet signal format transmitted from external equipment through internet network. Module, a PSTN module for processing a signal according to the internal format of the UMS for annotating the digital PSTN message signal input from the DSP, and audio and image data signals inputted through the IP module and the PSTN module. And a CPU for controlling the function of generating virtual content by processing the voice and image data specified by the user in various combination methods, and the content blocks of the image and audio data combined according to the combination control signal of the CPU. It consists of an integrated data management unit that integrates and processes the virtual content block into a DB that can be stored. Integrated messaging system with a video data transmission function, characterized in that. The integrated image with data transfer function of claim 1, wherein the image signal of the Internet signal format is processed by MPEG-1, 2, 4, 7, JPEG, MJPEG, TIFF, GIF, PCM, etc. Messaging system. The integrated messaging system of claim 1, wherein the content blocks of the video and audio data are virtual contents in XML format. External data receiving and storing step of processing voice and image data received through PSTN network or Internet network linked with private exchange system in a certain form and storing in DB, and after receiving the external data receiving and storing step in specific form When a command to combine is set, the combination technique set by the user first configures each of the voice data and the image data stored in the DB into one virtual content, and the virtual content of each of the voice and image data constituted by the annotation function. The virtual content configuration step of reconstructing and storing the virtual content by integrating it into an XML format and the automatic relay request signal input from the private exchange system during the virtual content configuration step are combined by the combination method specified by the user by the annotation function. Receive the other party specified by the user A control method for a unified messaging system equipped with an image data transmission function, comprising: a combination data transmission step of transmitting to a person. delete delete

Images