KR20030004158A - PDA based A/V Communication system & wired and wireless Contents service system - Google Patents

Abstract

The present invention relates to a system and method for real-time video / voice communication, a text conversation system and a translation web service that can be used on a wired / wireless Internet, and in particular, using a mobile phone terminal such as a PDA and a mobile phone. It is a system capable of text and text conversations, and enables the automatic translation system and the direct participation of translators for multi-language real-time translation web service using the advantages of video / voice communication anytime and anywhere through the wireless Internet and the networking system. The present invention relates to a third party translation system, a system capable of a variety of contents according to a user's needs, and a method thereof.

Interactive interactive video / voice communication and text conversation system according to the present invention has the advantages of mobility and portability, unlike the conventional wired Internet environment, but due to the small terminal, PDA with limited hardware resources and display Based on this system, it is a system that enables two-way video / voice communication in wireless internet environment such as wireless LAN or mobile communication network at anytime, anywhere in wired / wireless integrated environment, and develops communication tool that enables PDA-based wired / wireless integrated messenger and voice / image chat. By developing / S and P2P mixed network distributed processing system, we intend to develop mobile contents service platform with various e-commerce functions such as hotel, condo reservation, and contents service such as learning, translation, game and animation.

General video / audio communication, which is widely used in desktop PCs or dedicated terminals, is used for audio input / output devices, audio codecs, video input / output devices, video codecs, audio / video synchronization processing modules, system controllers, communication protocols, network interfaces, and user interfaces. It consists of a containing structure. This basic structure is defined by different protocols in the International Organization for Standardization (ITU-T), depending on the environment of the network used. In other words, video conferencing systems in ISDN are recommended as H.320, H.323 in LAN environments, and H.324 in Generalized Switched Telephone Networks (GSTN). A device that enables mutual communication by transmitting audio, video or data in real time. It receives analog audio signals and video signals, converts them to digital, compresses them, and transmits them to the other party through a transmission medium. The data is decoded and output as audio and video through a speaker or a display device.

The present invention not only complies with international standards such as network protocol and video / audio, but also optimizes these standards in an interface environment such as PDA, and enables various contents and applications such as dictionaries and translation systems to be run on the same platform. There is a characteristic in that it was developed to be.

In addition, in the case of automatic or interactive translation system, it was difficult to convey sufficient content and willingness to be a process of judging and translating conversation contents only by the voice signal of the conventional three-way translation system. The three-party translation system for video / audio / text in a wired / wireless integrated environment has superior functions and effects compared to conventional methods.

Description

PDA based video / voice communication system and wireless internet content service system {PDA based A / V Communication system & wired and wireless Contents service system}

Through the development of PDA-based wired / wireless integrated messenger and voice / video chat, and the development of C / S, P2P mixed network distributed processing system, contents service such as learning, game, animation, hotel, condo reservation, etc. Developing a mobile content service platform with built-in e-commerce is a basic challenge.

The PDA-based domestic wireless Internet market attracts many users due to the lack of killer applications, despite the unique advantages such as mobility and portability due to PDA's own limited memory capacity, difficult data entry, and small displays. The situation is not losing. The existing PDA is a mobile computing and networking terminal that can go beyond personal information management to secure its position as a mobile terminal that meets user's information acquisition needs and communication needs anytime, anywhere. It can be positioned as a core solution that responds appropriately to the needs. To this end, it is necessary to properly accept / integrate the existing web environment and to develop software that runs on wired and wireless networks that connect PDA terminals and wired networks. The software serves as a middleware for wired and wireless web, connecting wireless devices and wired networks, compressing data, restoring compressed data, ensuring security, storing and sending messages, and providing web clipping. It must process data and applications at the same time by providing a database connection network between various terminal devices such as CE and various DBs.

As a starting point and solution for these concerns, our "pocket service" is based on PDA, which provides communication tools such as messenger, voice and video chat, content services such as learning, games, and animations, and electronic commerce functions such as hotel and condo reservations. The development of multimedia communicator and content service system has become a basic task.

In the current wireless Internet, there are many obstacles to market development such as lack of quality content, expensive call charges and billing policies, as well as technical limitations such as slow transmission speed, interface inconvenience, and security vulnerability. This technical limitation is expected to be resolved to some extent with the introduction of IMT2000 and the continuous development of terminals and PDAs. In addition to the full-scale introduction of wireless LAN, HDR (High Data Rate; cdma2000-1x EV-DO) service, which is more advanced than cdma2000-1x, will be commercialized in full scale, and the range of contents will be expanded to multimedia video services from simple text or still images. It is a prospect. In addition, the spread of low-priced handsets, data rate system improvements, and mobile platform services will also serve as a catalyst for spreading the market.

With the development of this technology, the wireless internet network that mobile carriers have monopolized will be opened in earnest by the government's opening policy of wireless internet network prepared since the second half of last year, and it is clear that the first half of this year will produce visible results. And it is analyzed that the competition paradigm centered on mobile communication service providers will change considerably.

The ARC Group estimates that the number of wireless Internet subscribers will reach about 750 million in 2004 from 130 million in 2001, and the 0vum survey showed that the size of the wireless Internet market in 2005 was $ 750 million in 2000. It is expected to grow at $ 42 billion.

Against this backdrop, various solutions through PDA are being developed recently. In particular, KT, Hanaro Telecom, and other fixed-line Internet providers, mainly through the development of a wireless LAN-based VoIP solution, and supports voice communication functions. These service provider-oriented wireless internet phone service is fixed service method by assigning called number for billing, but our video / voice communication service method does not need separate called number and connects to server according to user's need to give ID. It is a fluid system that receives services. The connection process between users can be used by calling or pre-scheduling. Moreover, in the case of KT or Hanaro communication, only voice is supported, but we are given discrimination in that it supports video.

In addition, unlike general PCs, PDAs have different operating environments depending on hardware or OS. Therefore, service types such as KT and Hanaro communication are limited by hardware or OS, but our C / S and P2P mixing methods are different. It is possible to interoperate with and expand the system to communicate with heterogeneous terminals.

Currently, as a content service method through a PDA, a local method through porting of a avant-garo service and a program through one PUSH type is more common than an interactive function, which is an advantage of the Internet as a WEB method. This avant-garde service is not independent from the PC in the present situation, and even if the service is available through the wireless Internet, the search and the like are not supported, so the services such as content are insufficient to meet the user's multifaceted needs.

The C / S structure of the present invention and various contents and application service methods based on the wireless Internet can be extended and extended wirelessly by being combined with an existing web application server, beyond the limitations of a PDA, and can be independently applied only to a wireless environment. Therefore, while utilizing the rich content on the existing web, it brings the advantages of fast information access and thereby improving productivity.

In addition, by implementing the agent function on the server, existing wired web content can be accessed through web clipping, screen scraping, transcoding, morphing, etc. without using a tool to rewrite the content for the wireless web. Web clipping removes content that takes up a lot of media and frequency from wired web pages and provides only text to mobile users. Simple clipping and screen scraping provide a temporary means of moving from the web to the wireless device, but are not scalable and difficult to maintain. Second generation technology uses a variety of techniques to automatically reflect changes in the original web content on all radios without human intervention. By applying this web clipping technology to PDA, it is possible to access the web through better interface.

Therefore, by developing a platform for this, it is possible to create an environment in which various contents on the existing web can be used without difficulty even in a PDA terminal. Text-based messenger features as well as new broadband applications such as video conferencing will establish a multimedia-based mobile communication architecture.

Information acquisition and networking based on mobility and portability, the basic characteristics of PDAs, open up possibilities for various applications such as communication, entertainment, and e-commerce. As a result, the key to expanding users is how quickly and easily general users can utilize various DB or web contents and applications on the intranet or the Internet within the enterprise. The key is whether communication between users is possible. This is because relationships are more important than simple connections. Only when the communication structure is secured will the smooth e-commerce functions, content distribution and application be possible.

As a terminal capable of mobile computing and networking beyond personal information management, PDA has secured its own position and has established various core solutions that respond appropriately to the needs of customers in order to be positioned as leaders in responding to the ubiquitous environment. Should be. Accordingly, the basic concept of the present invention is to secure a communication structure through video / audio communication and to develop a system capable of content service in a wired / wireless interworking environment based thereon.

Since the 1990s, the greatest advances in information and communication have occurred in the Internet and mobile communications. With the development of the Internet, users can obtain various information such as text and multimedia from a server using a web browser, etc., and with the development of mobile communication, users can exchange information effectively regardless of the place.

However, there are many problems in combining the Internet and mobile communication. The access technologies of the two technologies are different, the network protocols are different, and the access media and browser standards are different. For example, the Internet uses an internet protocol (IP) in terms of network protocols, while mobile communication uses protocols such as TDMA (USA), GSM (Europe, Asia, USA), CDMA (USA, Asia), and the like. In order to effectively combine these two technologies, active technologies are being developed in terms of micro-browser and mark-up languages, access media and operating systems, networks, and location services. However, PDAs have high speed and low cost. In terms of cost, it is desirable to optimize the PDA interface without changing any existing networking / content applications and to create an environment where almost all of them can be used.

-Mobile Contents ASP Service Platform

The browser function in desktop environment and the need for an alternative to overcome the difficulty of browsing and searching such as the small screen of PDA, the input method, the slow connection speed, the limitation of limited processing capacity, and the general PC environment. Maximizes PDA mobility and portability by developing communication features and content service interfaces for other PDA readers. It provides an environment where general users can easily and quickly use various multimedia contents such as translation service, foreign language dictionary, network game, flash animation, etc. anytime and anywhere using PDA terminal. It is obvious that there are practical limitations in loading many applications or contents into PDAs, which have limitations in data transfer speed and memory processing capability compared to PCs, and it is difficult to apply existing web contents to existing web access methods. Considering that there are many limitations in how to convert, we have simplified the existing web surfing process of 'browsing & searching & conversion' for PDA environment and customized it to the information acquisition process of PDA users. Development of the interface.

To this end, we have developed a simple user interface for interacting with PDAs and application interfaces, and a platform for multiple applications in a single mode. Interworking with various DBs with development of standard communication / content service applications such as learning / business / leisure / reservation / entertainment / game / networking / communication.

Development of agents that make wired web content accessible to PDA users through web clipping, screen scraping, transcoding, and morphing. Development of a scraping algorithm that dynamically analyzes and tracks changes in existing HTML sources on the web and reflects these changes appropriately in various wireless device environments.

Minimize load of large data by developing distributed processing system that mix C / S and P2P.

Video / Voice Communications

In the case of PDAs, there is a limitation of the existing one-way communication module that requires clicking an action button, such as when talking and listening to a radio. In addition to overcoming the limitations of the existing one-way communication module and considering the wireless network environment, the video / audio codec is selected by predicting the total network status of 100Kbit / s, and the compressed packet is compressed through the time division method. To deliver. The GSM 610-based voice compression module, which has better compression performance than the G.711 voice codec, has been developed to enable stable two-way voice calls with improved noise and delay. Video compression codec is an efficient way to use video compression codec such as MPEG, but it takes a lot of time when it is used in PDA, and the size of frame transmitted using JPEG, which takes relatively less operation, is about 2-3Kbyte.

Wireless internet phone is a service that uses internet phone by using laptop or PDA at access point (AP). Despite the limitation of the area of use, it is cheaper than mobile phone and enables various additional services and high-speed data transmission. It is expected that this will create a new niche. Added video communication as well as voice calls. Services such as video message service and video conferencing are provided. In addition, when this PDA-based VoIP service is introduced in a company or home, a PDA can be connected to an internal LAN to make a phone call. The advantage of using the Internet is that it can be integrated with existing voice telephone networks. Therefore, not only the communication cost is greatly reduced, but also the connection between systems is possible.

1 is a diagram illustrating an embodiment of a technology for supporting web services.

Figure 2 is a block diagram showing the configuration of an automatic translation system according to an embodiment of the present invention.

The invention is a PDA-based multi-party video and audio simultaneous video conferencing system that applies the P to P application technology to solve the overload problem of the streaming technology based on the existing server relay system. Development of a multi-voip / streaming conference system capable of processing a large amount of data such as voice is the main purpose of the present invention.

The present invention is based on C / S, P2P video chat system based on UDP or RTP Protocol, real-time two-way communication via PDA and wireless Internet, and a messenger service that can send a real-time message to the other party, It is a system that enables services such as foreign language dictionary, translation, and e-commerce with the basic function of text chat, and consists of an intuitive user interface that enables the smooth use of various contents and applications even on a small screen interface such as PDA.

The web server 21 of the service provider 20 is a computer terminal 31 (41) capable of accessing the Internet or wireless communication such as a wireless Internet service such as WAP (Wireless Application Protocol) or ME (Mobile Explorer) supported Connection can be made using the terminal 32.

In the WAP method, a WAP gateway is provided between the wireless network and the existing wired Internet network to communicate with each other using a protocol defined by the WAP between the user terminal and the gateway. When the user presses the Internet access button on the wireless communication terminal, this signal requests a service from the wired Internet network through the WAP gateway, and the gateway again uses a wired Internet server, that is, a service provider's web server. Receive the response of will be sent to the terminal.

In the method of transmitting images, voices, and texts between a personal computer and a portable terminal (PDA) through a wired / wireless network, a user uses various contents provided by an operator after joining a membership, and the user uses a multi-party image, voice, or text through an operator server. Participate in various meetings using the transmission system, the user participates in various training using the multi-way video, voice, text transmission system through the operator server, and the user in the conference training room installed in the server The present invention relates to a method for multi-way video, voice, and text transmission using wired or wireless Internet, characterized by participating in voice and text transmission and providing offline meetings and meetings through separate offline events.

Wired and wireless video communication method using a PDA according to the present invention, in order to use a video / voice service in a computer or a mobile communication terminal such as PDA, the step of registering the service to the server by inputting the ID on the screen of the mobile terminal such as PDA; Accessing the server and checking status information of service subscribers and status information of service subscribers on a screen of a terminal such as a PDA; Requesting a video or voice communication from the mobile terminal such as a PDA using the ID of the receiving terminal; accepting a communication request by the other party in response to the request; The communication is transmitted to the other party's terminal, and both images of the communication conversation are displayed on a terminal such as a PDA, thereby operating normally. Such two-way communication is performed, and the other party can communicate by using a text or picture. In addition, it is characterized by having an interface capable of various additional services such as foreign language dictionary and translation.

The effect of the present invention

First, the VoIP Switching System is developed by software to overcome the limitations of the Multi Voice support by the existing traffic to realize the practical use of video conferencing.

Second, by using P2P method, the server load is distributed and user's network is used to solve the problem by Load Balancing.

Third, by synchronizing voice and video, the dubbing effect caused by the flow of network resources has been eliminated, which drastically improved the video transmission speed.

Fourth, by using the voice buffering technology, the syllables were cut off, thereby improving the sound quality of Internet phones.

Fifth, it provides high quality video quality by reproducing natural image streaming by developing its own Data Transfer Protocol.

Sixth, real-time two-way remote lecture using Realtime Dual White Boarding technology

The most important advantage of wireless is the liquidity of information, the motto of Any time, Anywhere, Anyone, which means that companies can reach their customers regardless of location and time, which will give them a competitive advantage. will be.

With the emergence of wireless terminals and wireless applications such as wireless PDAs and IMT-2000 terminals, the mobile business is becoming a new paradigm and is being recognized as a new opportunity for enterprises.

Since the 1990s, the greatest advances in information and communication have occurred in the Internet and mobile communications. With the development of the Internet, users can obtain various information such as text and multimedia from a server using a web browser, etc., and with the development of mobile communication, users can exchange information effectively regardless of the place.

The rapid expansion of the mobile Internet market, which surpasses the spread of the Internet, with more than 48% of Internet users expected to be mobile Internet users in 2003, is a major part of Internet services such as communication, e-commerce, and games. It is expected to happen. In addition, the growth of the high-performance wireless handset market and the rapid growth of the wireless Internet use population will lead to the rapid growth of the wireless internet phone and mobile ASP market.

In recent years, the global PC industry is facing a new turning point. Next-generation products such as PDAs, tablet PCs, and smartphones, which are fused with new technologies such as PC technology, communication, and consumer electronics technologies, are beginning to appear. Korea is more successful than any other in the post PC industry based on the world's most advanced communication infrastructure, CDMA communication technology, home appliance development technology, and core device technology.

If wired / wireless linking is in full swing in Korea, wired ISPs and wired portals will be able to compete on equal terms with existing mobile operators, which will lead to a stronger competitiveness of the overall wireless Internet industry. . PDA, which is one of the representatives of Post PC, is expected to generate demand in earnest centering on wireless PDA as wired / wireless carriers provide PDA-based wireless Internet service. In particular, wireless PDA is expected to be expanded to PDA, which was limited to personal information management (PIMS), to become a mobile Internet terminal for general users and to a mobile office device for corporate users such as logistics, distribution, and insurance.

Therefore, it is possible to implement voice / video communication through low-cost PDA based wireless LAN in mobile office environment in corporate work environment. Also, various contents can be developed and serviced based on this. It will serve as a driving force for mobile business growth. Web access through wireless devices, for example, is deeply involved in transaction-driven business processes, such as buying movie or theater tickets, trading stocks and transferring money. In this respect, wired web e-commerce applications can be extended to the wireless sector, which will change the dynamic market structure of online shopping. For example, with a Web-enabled PDA, a consumer can retrieve the cheapest price on the web from a shopping site and order the item to be delivered home the next day.

Faster access to a variety of good information on the existing wired Web enhances and accelerates decision making. Provides information for services that can access key information anytime and anywhere in the business process, needs for continuous real-time communication, requests for services that can frequently access time-sensitive information, wireless e-commerce, and location-based information Thus, customer satisfaction is possible through transaction-oriented business processes, such as increasing the potential value of services.

Through our multimedia communication and mobile ASP service, we will be able to meet the following requirements. Existing internet-based multimedia services can be expanded to mobile, and the rapid increase of mobile workers due to the spread of voice / video communication environment,

It is possible to use and supply specialized and differentiated contents, and to implement services optimized for target users.

In addition, the market structure of the closed-type mobile business centered on current carriers, that is, content providers and terminal providers have limited business opportunities such as service range and supply chain. It can be provided to their customers anytime, anywhere with the desired terminal and desired content without being subordinated.

For example, in the future, content providers will focus on the content itself without having to consider which terminal and which carrier should be developed.In the future, consumers like us will introduce such differentiated services to the market. The content and terminal can be selected.

3. Application field and application cases of technology

The wireless Internet is a combination of two major flows in the information and communication environment. It can be defined as a service that can transmit and receive wireless voice, data, and video information. Is based on technology.

Due to the small screen, troublesome input method, slow connection speed, and limited processing capacity of PDA, it is not easy to acquire information through browsing and searching like general PC environment. It can be applied to various fields such as e-commerce, technical service support, geographic information / reservation through the development of interface and technology for maximizing the convenience of wireless internet and M-commerce beyond the browser-based model that makes the best use. .

1) Mobile communication through video / voice

Data transmission speed in 1G is 9.6 Kbps and in 2G in 3G in the future, it is developed from voice-based telephone to video streaming and provides various multimedia services. First-generation voice-centered phones, voicemails, and faxes have evolved around text messaging, including second-generation e-newspapers, electronic publishing, and e-mail. In the 2.5th generation, video conferences have been attempted, and audio streaming has Karaoke function. It is developed by technology. In the next three generations, services such as Video on demand, Voice-driven Web Pages, Streaming Audio, High Quality Video Conference, Remote Medical Service, Video Surveillance, and Video Mail will be available.

Apart from the above mobile communication network, the demand for high-speed data service similar to the wired Internet has arisen in the wireless market due to the spread of high-speed Internet access service through wired network. Development has been active. In particular, with the establishment of IEEE 802.11b standards that support high-speed data transmission of up to 11 Mbps and the production of products, interest in wireless LANs has exploded in recent years.

The activation of the wireless LAN service enables users to receive the same level of multimedia service over the wire as the Internet on the wire, instead of the wireless Internet with limited functions such as WAP (Wireless Application Protocol). In particular, unlike wireless data services, these wireless LAN services can be connected to the Internet through the same IP-based networking as wired Internet services. It is expected to provide high speed data transmission up to 54Mbps through systems such as IEEE 802.11a / g or HIPERLAN / 2 in the future.

PDA-based multimedia communication services through mobile communication networks or wireless LANs include services such as VOD, AOD, GAME, and Chatting. Information service is provided to users through a variety of information, such as news, sports, weather. Business & Commerce services include mobile commerce, reservation service and securities service. In addition, services such as video message service and video conferencing are provided. Education services include virtual education, on-line libraries and distance education services. Security monitoring service may be provided for the security service. After all, the possibilities as mobile media are endless.

2) Mobile Contents ASP Service

The primary reason for the acceptance of wireless Internet is that users can take advantage of "idle time" outside the home or office. Wireless ASP (Wire Application Provider (WASP)), a business that leases software and content over wired and wireless networks, is gaining attention as a new business area based on the increase in the use of the wireless Internet and the development of wireless networks capable of high-speed data transmission.

It is also important to create content separately for various wireless devices, but it is also possible to convert existing web content for the wireless web using various technologies such as web clipping. Wired web content can also be accessed wirelessly through web clipping, screen scraping, transcoding, morphing, and so on, without using a conversion tool that rewrites the various content on the web for the wireless web. If these attempts are made on PDA-centric PostPC devices, Web content and e-commerce will be faster and easier than using traditional mobile phones or PCs.

When information acquisition and communication are possible in real time anytime, anywhere, when a PDA user learns a foreign language, the limitation of the memory and the economic burden are great if the packaged foreign language dictionary is carried in the PDA. However, our platform will save you a lot of money if you can access the information and content you need, whenever and wherever you need it. In terms of e-commerce, for example, when a user makes a flower delivery to a lover, it must first go through a very complicated process of finding a flower shop on the web and selecting and buying flowers, but with our Pocket Agent feature, Payment can be processed easily. Interoperability between service providers, our intelligent C / S, and mobile devices enables Internet access services such as web surfing services and e-commerce without the need for a separate browser.

WASP is a wireless ASP service that enables companies or customers to wirelessly access and use various applications in various distributions, such as finance and logistics, as well as general-purpose solutions such as groupware and customer relationship management (CRM) without having to build a separate system. to be.

Video / voice call center services through the Internet in partnership with companies that need customer service.

We take a wide range of marketing strategies to the vertical market where mobile applications such as travel, accommodation, and dining out can be useful, and connect wirelessly with the DB, such as airplane ticket purchase, hotel reservation, car reservation, transportation, and location information DB. Service through PDA can generate various benefits such as productivity improvement, cost reduction, and efficiency improvement through customer service improvement.

Claims (5)

remind PDA-based Video / Voice Communication Method, System and Its Method English / Chinese / Japanese dictionary service system and method which are serviced together with PDA based image / audio communication of claim 1 Translation service system such as English / Chinese / Japanese serviced with PDA based image / voice communication of claim 1 and method thereof PDA-based image / voice communication and wireless web service such as English / Chinese / Japanese dictionary and translation service system through multilateral dialogue in wired / wireless integrated environment and method thereof System and method according to claim 2, 3, and 4, wherein additional services are available on the same screen or interface on a communication system and a PDA