KR20010056293A - Vehicle equipped wireless multimedia termanial system and operating method thereof - Google Patents

Abstract

PURPOSE: A wireless multimedia terminal system for vehicles and a method for operating thereof are provided to offer the video phone service between drivers on the move or between a driver on the move and a fixed network user and to achieve an extended operation even under the mobile radio environments of vehicles and mobile workers by adding a radio modem installation option. CONSTITUTION: A wireless multimedia terminal system for vehicles consists of a driver interface part(100), a multimedia data processing part(120), a call control and data transfer part(130), a multi-task supporting part(140), and a communication access part(150). The driver interface part(100) having a driver interface module(101) presents data for the reference of operation information and takes charge of the start and end function of a video phone. The multimedia data processing part(120) contains a voice synthesis and voice recognition module(121), an audio input/output and audio stream driver module(122), and a video capture/output and video stream driver module(123). The call control and data transfer part(130) having a call setup module(131) covers a call setup function so that a driver can provides a video phone participation request to a remote place or respond to a video phone invitation from a remote place. The multi-task supporting part(140) grants a multi-task function to application programs under the operating system of a vehicle terminal system. The communication access part(150) contains a wireless modem driver module(151), a wired modem driver module(152), and an ECU(Electronics Control Unit) driver module(153).

Description

In-vehicle wireless multimedia terminal system and its operation method {Vehicle equipped wireless multimedia termanial system and operating method

The present invention relates to a wireless multimedia terminal system for a vehicle and a method of operating the same, and in particular, it is possible to provide a video telephone service between a moving driver or a moving driver and a fixed network user, and to provide a wireless modem mounting option for a vehicle and a mobile worker. The present invention relates to a wireless multimedia terminal system for a vehicle which can be extended and operated in a mobile wireless environment and a method of operating the same.

In recent years, with the rapid expansion of high-performance computers, the demand for multimedia data processing has increased, and the performance of the processor and the speed of the wireless network connection have been increased, and the on-vehicle which realizes the joint work between the vehicle drivers or between the distribution center and the vehicle drivers. Services for visual video telephone systems are anticipated. In addition, in order to participate in uninterrupted business processing and cooperative work on the go, the use of ultra-small wireless multimedia input / output terminals capable of wireless Internet access and voice / video transmission is increasing.

To meet these demands, it is a compact system that is easy to mount on the vehicle, low power consumption, guarantees the stability of data transmission in wireless mobile environment and sufficient data compression to transmit digital video and audio data in real time, while driving There is a need for a system that conforms to international standards for communication between multimedia terminals to provide ease of use and to interoperate with other systems.

However, prior art vehicle terminal systems have not been provided with video input and compression, audio data compression and decompression techniques, and the multi-threaded functionality for applications in terminal operating systems has not been utilized, and also standards-based video conferencing systems. Could not present the function.

The present invention has been made to solve the above problems of the prior art, it is possible to provide a video telephone service between a moving driver or between a moving driver and a fixed network user, and equipped with a wireless modem option of the vehicle and mobile workers An object of the present invention is to provide a wireless multimedia terminal system for a vehicle which can be extended and operated in a mobile wireless environment and a method of operating the same.

1 is a block diagram for each module showing the configuration of a vehicle wireless multimedia terminal system according to an embodiment of the present invention,

2A and 2B are flowcharts illustrating a method of operating a wireless multimedia terminal system for a vehicle according to an exemplary embodiment of the present invention.

According to the present invention for achieving the object as described above, includes a driver interface unit, multimedia data processing unit, call control and data transmission unit, multi-task function support unit and communication connection unit; The driver interface unit manages driver information for selecting and calling a predetermined user menu for a remote driver or a logistics center manager who wants to present data and to start and end video calls. A module, and a vehicle information management module for processing and presenting information necessary for driving and managing the vehicle, wherein the multimedia data processing unit is a voice synthesis and speech recognition module that does not require special key manipulation for the safety of a driving driver, a driver Audio input / output and audio stream driver module responsible for the output after restoring the audio stream of the received remote driver and digital capture, and video capture / Output and And a video stream driver module, wherein the call control and data transmission unit includes a call setup module and a call setup that are in charge of a call setup function that enables a vehicle driver to request a video call from a remote location or respond to a video call invitation from a remote location. After completion, a signal control module for performing performance exchange related to multimedia data processing between the mobile terminal system and the remote vehicle terminal system and performing a function such as setting a wireless data transmission channel, and synchronizing with the multimedia stream data of the vehicle terminal system in operation. And a real-time wireless transmission module for packetizing and transmitting information, extracting packet data received from a terminal system of another mobile vehicle, and extracting stream data for each media. The communication connection unit includes an image in a wireless vehicle environment in which a driver is moving. Wireless to carry the phone Wireless modem driver module with modem environment building function, wired modem driver module to support video modem function over the Internet by supporting wired modem connection function, and ECU (Electronics Control Unit) driver module to store and present vehicle driving information It includes; The multi-task function support module provides a multi-task function to an application program under an operating system of the vehicle terminal system, generates a task for transmitting and receiving independent video and audio stream data, and simultaneously drives the same in a time division manner. A vehicle wireless multimedia terminal system is provided which continuously performs call setup and call control functions so as to respond to a termination request from another vehicle terminal system even while using the video telephone function of the system.

In addition, it is responsible for presenting data for reference to driving information and starting and ending functions of a video call, selecting and calling a predetermined user menu for a remote driver or a distribution center manager who wants to make a video call. Processing and presenting the first step; For the driver's safety, no special key manipulation is required, the driver's voice input is digitally compressed, the received remote driver's audio stream is restored, the output is performed, the video signal is input, and the video is digitized. Compressing into a stream; The vehicle driver performs a call setup function for requesting to participate in a video call to a remote place or responding to a video call invitation from a remote place, and after the call setup is completed, the multimedia data processing between the mobile terminal system and the remote vehicle terminal system is performed. Performs performance exchange, performs wireless data transmission channel setting, etc., packetizes and transmits multimedia stream data and synchronization information of a vehicle terminal system in operation, and decompresses packet data received from a terminal system of another mobile vehicle. Extracting stream data for each media; And assigning a multi-task function to an application program under an operating system of the vehicle terminal system, generating a task of transmitting and receiving independent video and audio stream data, and simultaneously driving the same in a time-division manner, and using the video telephone function of the vehicle terminal system. A method for operating a wireless multimedia terminal system for a vehicle is provided, comprising a fourth step of performing a call setup and call control function so as to respond to a termination request from another vehicle terminal system even during the process.

In addition, the computer is responsible for displaying data for driving information and starting and ending video calls, selecting and calling a predetermined user menu for a remote driver or distribution center manager who wants to make a video call, and operating and managing a vehicle. A first step of processing and presenting the information necessary for the; For the driver's safety, no special key manipulation is required, the driver's voice input is digitally compressed, the audio stream of the remote driver is restored, the output is performed, the video signal is input, and the video is digitalized. Compressing into a stream; The vehicle driver performs a call setup function for requesting to participate in a video call to a remote place or responding to a video call invitation from a remote place, and after the call setup is completed, the multimedia data processing between the mobile terminal system and the remote vehicle terminal system is performed. Performs performance exchange, performs wireless data transmission channel setting, etc., packetizes and transmits multimedia stream data and synchronization information of a vehicle terminal system in operation, and decompresses packet data received from a terminal system of another mobile vehicle. Extracting stream data for each media; And assigning a multi-task function to an application program under an operating system of the vehicle terminal system, generating a task of transmitting and receiving independent video and audio stream data, and simultaneously driving the same in a time-division manner, and using the video telephone function of the vehicle terminal system. A computer-readable recording medium is provided which records a program capable of executing what has been performed, including a fourth step of performing call setup and call control functions, so as to respond to a termination request from another vehicle terminal system even during the process.

In the following, with reference to the accompanying drawings, a preferred embodiment according to the present invention will be described in detail.

1 is a module block diagram showing the configuration of a wireless multimedia terminal system for a vehicle according to an embodiment of the present invention. The driver interface unit 100, the multimedia data processing unit 120, the call control unit, and the data transmission unit 130 are shown in FIG. , A multi-task support unit 140 and a communication connection unit 150.

The driver interface unit 100 includes a driver interface module 101 that manages the entire system interface, and is responsible for data presentation for driving information reference and start and end functions of a video call, and with the help of the driver information management module 102. Receive a video call by selecting a predetermined user menu for a remote driver or a distribution center manager wants to call, the vehicle information management module 103 processes and presents the information required for vehicle operation and management.

The multimedia data processing unit 120 utilizes the functions of the voice synthesis and voice recognition module 121 that does not require special key manipulation for the safety of the driver while driving, receives the driver's voice input, digitally compresses the received remote There is an audio input / output and audio stream driver module 122 which is responsible for output after restoring the driver's audio stream, and receives and digitizes a video signal and compresses it into a video stream. There is).

The call control and data transmission unit 130 has a call setup module 131 in charge of a call setup function that allows a vehicle driver to request a video call from a remote place or respond to a video call invitation from a remote place. After the call setup is completed, there is a signal control module 132 that performs performance exchange related to multimedia data processing between the mobile terminal system and the remote vehicle terminal system and performs a function such as setting a wireless data transmission channel. In addition, the real-time wireless transmission module 133 functions to packetize and transmit multimedia stream data and synchronization information of a vehicle terminal system in operation, and extract stream data for each media by decompressing packet data received from a terminal system of another mobile vehicle. Has

The multi-task function support module 140 provides a multi-task function to an application program under an operating system of the vehicle terminal system, generates a task for transmitting and receiving independent video and audio stream data, and simultaneously drives the same in a time division manner. The call setup and call control functions can be continuously performed to respond to the termination request from another vehicle terminal system even while the video terminal function of the vehicle terminal system is in use.

The communication connection unit 150 has a wireless modem driver module 151 having a wireless modem environment construction function for the driver to perform a video call in a wireless vehicle environment in which the driver is moving, and supports a wired modem connection function to support a video telephone function on the Internet. It provides a wired modem driver module 152 to operate the modem so that it can be connected to the modem for telecommuting users. In addition, an ECU (Electronics Control Unit) driver module 153 is provided to store and present vehicle driving information.

2A and 2B are flowcharts illustrating a method of operating a wireless multimedia terminal system for a vehicle according to an embodiment of the present invention, and a signal for performing a video call participation request and a video call invitation among video telephony functions driven on the vehicle terminal system; The operation flowchart is shown.

First, in step S201, when the main task and the interface screen are performed, user management data is set, in step S202, after the call setup and signal control task is performed, in step S203, if there is an application to join the meeting, whether to allow or not To judge.

As a result of the determination in step S203, if participation in the conference is allowed, in step S204, it is determined whether the audio / video stream is supported, and if it is supported, in step S205, after initializing the video and audio capture / compression routine, In step S206, a local video and audio stream transmission task is performed.

Subsequently, in step S207, the wired / wireless modem and the ECU are connected to drive the communication connection module, in step S208, a remote video and audio stream reception task is performed, in step S209, after outputting video data, in step S210 It determines whether a teleconference end message has been received.

As a result of the determination in step S210, if an end message is received, the process terminates. If no end message is received, it is determined in step S211 whether a local conference end message has been received.

As a result of the determination in step S211, if the local conference end message is received, the procedure ends. If no local conference end message is received, the process returns to step S206.

On the other hand, if it is not supported as a result of the determination in step S204, in step S212, it is determined whether or not the system is to be terminated, and if it is to be terminated, it is terminated. If not, it is returned to the step S202.

As a result of the determination in step S203, if participation in the meeting is not permitted, the flow proceeds to step S212.

Meanwhile, a method of operating the vehicular wireless multimedia terminal system illustrated in FIGS. 2A and 2B will be described in detail with reference to FIG. 1.

First, when the driving of the vehicle terminal system according to an embodiment of the present invention is started, the driver interface module 101 generates a main task for maintaining a video telephony application until the termination of the terminal system, and presents a driver interface screen. .

Subsequently, the driver information management module 102 may set driver management data, manage driver information, present a list of stored drivers on the screen, and, in the case of a driver not present in the list, the driver interface. Remote operator can be selected and called by voice input directly from the screen.

The call setup module 131 and the signal control module 132 are called when a remote driver is requested to select a remote driver from the driver interface screen or a video driver is requested to join a video call while the video telephone function is being driven. Each task is generated by invoking the multi-task processing module 140, and a channel for call setup between systems and a channel for exchanging information on data processing capability for each media are set. At this time, if the telephone participation and participation request is rejected, the system is terminated by asking whether the system is terminated or waiting for call setup and signal control again.

If telephone participation is permitted, the communication function is determined by comparing the multimedia data processing capability of the local driver terminal system with the capabilities of the remote driver terminal system. At this time, if the common function does not exist, it is asked whether to shut down the system again to terminate the video call function, or wait for call setup and signal control again.

A video and audio capture routine by calling the video capture / output and video stream driver module 122 and the audio input / output and audio stream driver module 123 based on multimedia data processing performance compared to a remote vehicle terminal system. Initialize the compression routine. Subsequently, the multi-task processing module 140 is invoked to generate and perform a local video and audio stream transmission task in order to transmit video data and audio data of a local driver. At this time, the network connection device for transmitting the media data of the local driver is driven by calling any one of the wireless modem driver module 151 or the wired modem driver module 152 according to the result set in the vehicle terminal system. The communication connection module is driven, and the packet data generated by the real time wireless transmission module 133 is transmitted to the remote driver terminal system.

After performing a remote video and audio stream reception task by calling the multi-task processing module 140, packet data received from a remote driver terminal system is separated into stream data for each media, and audio stream data is inputted to the audio input. The output and audio streams are sent to the audio stream driver module 123 and then restored. The video stream data is restored by performing the video capture / output and video stream driver module 122, and the driver interface module 101 is restored. The restored video data is then converted into a sprite and displayed on the remote driver screen in the driver interface screen.

The vehicle terminal system is driven to accept a call termination request from a remote driver while performing a video call, and when the local driver wants to terminate the video call function, a video call termination message is transmitted to the remote driver terminal system. If the local driver does not want to terminate the call, the local video and audio stream transmission task is continuously performed by calling the multi-task processing module 140.

The process of selecting a command or presenting a command execution result of a vehicle terminal system is a function of the voice synthesis and voice recognition module 121. Basically, in order not to disturb the driver's safe driving and visibility, voice recognition and voice are performed. The compositing function is used in parallel with the direct input method. That is, in the command input step, the function menu selection for the command and the voice input are simultaneously performed so that the driver selects the desired function at the minimum level. The confirmation of the selection result and the presentation of the help output the appropriate voice synthesis message.

The present invention as described above is recorded on a computer-readable recording medium, and can be processed by a computer.

As described in detail above, the present invention is to operate a video call function based on the international standard for the multimedia terminal for video telephony with the support of the wireless multimedia environment to the user driving the vehicle on the vehicle terminal system that is the on-board multimedia input / output terminal. It has the effect of making it possible.

In addition, the vehicle video telephone function captures and compresses / transmits audio and video stream data in real time using a multitasking function on a vehicle terminal, and restores the audio and video stream data from a remote driver to present to a user. By providing various communication connection options of wired / wireless modem environment and ECU connection environment, and utilizing video service function of vehicle, it supports uninterrupted business processing during long time operation, and video telephony service in limited area such as complex building. And it can support the cooperative work, there is an effect that can be utilized as an information terminal or advertising terminal in the public vehicle in operation.

The technical spirit of the present invention has been described above with reference to the accompanying drawings, but this is by way of example only and not by way of limitation to the present invention. In addition, it is obvious that any person skilled in the art may make various modifications and imitations without departing from the scope of the technical idea of the present invention.

Claims (3)

A driver interface unit, a multimedia data processor, a call control and data transmitter, a multitask function support unit, and a communication connection unit; The driver interface unit manages driver information for selecting and calling a predetermined user menu for a remote driver or a logistics center manager who wants to present data and to start and end video calls. A module, and a vehicle information management module for processing and presenting information necessary for vehicle operation and management, The multimedia data processing unit receives a voice input from a voice synthesis and voice recognition module that does not require a special key operation for the driver's safety, and digitally compresses the driver's voice input. An audio input / output and audio stream driver module, and a video capture / output and video stream driver module for receiving and digitizing video signals and compressing them into video streams. The call control and data transmission unit is a call setup module for a call setup function that allows a vehicle driver to request a video call to a remote site or respond to a video call invitation from a remote site. Perform a performance exchange related to multimedia data processing between remote vehicle terminal systems, perform a function such as setting a wireless data transmission channel, packetize and transmit multimedia stream data and synchronization information of a vehicle terminal system in operation, A real time wireless transmission module for extracting packet data received from a terminal system of another mobile vehicle and extracting stream data for each media; The communication connection unit supports a wireless modem driver module having a wireless modem environment building function and a wired modem connection function for the driver to perform a video call in a wireless vehicle environment in which a driver operates a wired modem to operate a video telephone function on the Internet. A driver module, and an ECU (Electronics Control Unit) driver module for storing and presenting vehicle driving information; The multi-task function support module provides a multi-task function to an application program under an operating system of the vehicle terminal system, generates a task for transmitting and receiving independent video and audio stream data, and simultaneously drives the same in a time division manner. A wireless multimedia terminal system for a vehicle, characterized in that the call setup and call control functions are continuously performed so as to respond to a termination request from another vehicle terminal system even when the video telephone function of the system is in use. It is responsible for presenting data for reference to driving information and starting and ending of video call, and selecting and calling a predetermined user menu for a remote driver or distribution center manager who wants to make a video call, and processes information necessary for vehicle operation and management. Presenting the first step; For the driver's safety, no special key manipulation is required, the driver's voice input is digitally compressed, the received remote driver's audio stream is restored, the output is performed, the video signal is input, and the video is digitized. Compressing into a stream; The vehicle driver performs a call setup function for requesting to participate in a video call to a remote place or responding to a video call invitation from a remote place, and after the call setup is completed, the multimedia data processing between the mobile terminal system and the remote vehicle terminal system is performed. Performs performance exchange, performs wireless data transmission channel setting, etc., packetizes and transmits multimedia stream data and synchronization information of a vehicle terminal system in operation, and decompresses packet data received from a terminal system of another mobile vehicle. Extracting stream data for each media; And Under the operating system of the vehicle terminal system, the multi-task function is given to the application program, and the task of transmitting and receiving independent video and audio stream data can be generated and driven simultaneously in a time division manner, while the video telephone function of the vehicle terminal system is in use. And a fourth step of performing a call setup and call control function so as to respond to a termination request from another vehicle terminal system. On your computer, It is responsible for presenting data for reference to driving information and starting and ending of video call, and selecting and calling a predetermined user menu for a remote driver or distribution center manager who wants to make a video call, and processes information necessary for vehicle operation and management. Presenting the first step; For the driver's safety, no special key manipulation is required, the driver's voice input is digitally compressed, the received remote driver's audio stream is restored, the output is performed, the video signal is input, and the video is digitized. Compressing into a stream; The vehicle driver performs a call setup function for requesting to participate in a video call to a remote place or responding to a video call invitation from a remote place, and after the call setup is completed, the multimedia data processing between the mobile terminal system and the remote vehicle terminal system is performed. Performs performance exchange, performs wireless data transmission channel setting, etc., packetizes and transmits multimedia stream data and synchronization information of a vehicle terminal system in operation, and decompresses packet data received from a terminal system of another mobile vehicle. Extracting stream data for each media; And Under the operating system of the vehicle terminal system, the multi-task function is given to the application program, and the task of transmitting and receiving independent video and audio stream data can be generated and driven simultaneously in a time division manner, while the video telephone function of the vehicle terminal system is in use. And a fourth step of performing a call setup and call control function so as to respond to a termination request from another vehicle terminal system.