KR100549444B1 - Vehicle equipped wireless multimedia terminal system and operating method thereof - Google Patents

Abstract

The present invention provides a video telephony service between a moving driver or between a moving driver and a fixed network user, and has an option for installing a wireless modem, thereby enabling extended operation in a mobile wireless environment of a vehicle and a mobile worker, and a wireless multimedia terminal system for a vehicle. The purpose is to provide a method of operation.

According to the present invention, there is provided a vehicle wireless multimedia terminal system comprising a driver interface unit, a multimedia data processing unit, a call control and data transmission unit, a multitask support unit and a communication connection unit.

Description

In-vehicle wireless multimedia terminal system and its operation method

1 is a block diagram for each module showing the configuration of a vehicle wireless multimedia terminal system according to an embodiment of the present invention,

2A and 2B are flowcharts illustrating a method of operating a wireless multimedia terminal system for a vehicle according to an exemplary embodiment of the present invention.

The present invention relates to a wireless multimedia terminal system for a vehicle and a method of operating the same, and in particular, it is possible to provide a video telephone service between a moving driver or a moving driver and a fixed network user, and to provide a wireless modem mounting option for a vehicle and a mobile worker. The present invention relates to a wireless multimedia terminal system for a vehicle which can be extended and operated in a mobile wireless environment and a method of operating the same.

In recent years, with the rapid expansion of high-performance computers, the demand for multimedia data processing has increased, and the performance of the processor and the speed of wireless network connection have been increased, and the on-vehicle which realizes the joint work between the vehicle driver or between the distribution center and the vehicle driver. Services for visual video telephone systems are anticipated. In addition, in order to participate in uninterrupted business processing and cooperative work on the go, the use of ultra-small wireless multimedia input / output terminals capable of wireless Internet access and voice / video transmission is increasing.

To meet these demands, it is a compact system that is easy to mount on the vehicle, low power consumption, guarantees the stability of data transmission in wireless mobile environment and sufficient data compression to transmit digital video and audio data in real time, while driving There is a need for a system that conforms to international standards for communication between multimedia terminals to provide ease of use and to interoperate with other systems.

However, prior art vehicle terminal systems have not been provided with video input and compression, audio data compression and decompression techniques, and the multi-threaded functionality for applications in terminal operating systems has not been utilized, and also standards-based video conferencing systems. Could not present the function.

The present invention has been made to solve the above problems of the prior art, it is possible to provide a video telephone service between a moving driver or between a moving driver and a fixed network user, and equipped with a wireless modem option to provide a vehicle and mobile workers An object of the present invention is to provide a wireless multimedia terminal system and a method for operating the same in a mobile wireless environment.

According to the present invention for achieving the object as described above, includes a driver interface unit, multimedia data processing unit, call control and data transmission unit, multi-task function support unit and communication connection unit; The driver interface unit manages driver information for selecting and calling a predetermined user menu for a remote driver or a logistics center manager who wants to present data and to start and end video calls. A module, and a vehicle information management module for processing and presenting information necessary for driving and managing the vehicle, wherein the multimedia data processing unit is a voice synthesis and speech recognition module that does not require special key manipulation for the safety of a driving driver, a driver Audio input / output and audio stream driver module responsible for the output after restoring the audio stream of the received remote driver and digital capture, and video capture / Output and And a video stream driver module, wherein the call control and data transmission unit includes a call setup module and a call setup that are in charge of a call setup function that enables a vehicle driver to request a video call from a remote location or respond to a video call invitation from a remote location. After the completion, the signal control module for performing the performance exchange of the multimedia data processing between the mobile terminal system and the remote vehicle terminal system, and performs a function such as setting a wireless data transmission channel, and multimedia stream data of the vehicle terminal system in operation. And a real-time wireless transmission module for packetizing and transmitting the synchronization information and extracting packet data received from a terminal system of another mobile vehicle, and extracting stream data for each media. Wireless to execute video call Wireless modem driver module with modem environment building function, wired modem driver module to support video modem function over the Internet by supporting wired modem connection function, and ECU (Electronics Control Unit) driver module to store and present vehicle driving information It includes; The multi-task function support module provides a multi-task function to an application program under an operating system of the vehicle terminal system, generates a task for transmitting and receiving independent video and audio stream data, and simultaneously drives the same in a time division manner. A vehicle wireless multimedia terminal system is provided which continuously performs call setup and call control functions so as to respond to a termination request from another vehicle terminal system even while using the video telephone function of the system.

In addition, it is responsible for presenting data for reference to driving information and starting and ending functions of a video call, selecting and calling a predetermined user menu for a remote driver or a distribution center manager who wants to make a video call. Processing and presenting the first step; For the driver's safety, no special key operation is required, digital compression is performed by the driver's voice input, the audio stream of the received remote driver is restored, the output is performed, and the video signal is input and digitized. Compressing into a video stream; The vehicle driver performs a call setup function for requesting to participate in a video call to a remote place or responding to a video call invitation from a remote place, and after the call setup is completed, the multimedia data processing between the mobile terminal system and the remote vehicle terminal system is performed. Performs performance exchange, performs wireless data transmission channel setting, etc., packetizes and transmits multimedia stream data and synchronization information of a vehicle terminal system in operation, and decompresses packet data received from a terminal system of another mobile vehicle. Extracting stream data for each media; And assigning a multi-task function to an application program under an operating system of the vehicle terminal system, generating a task of transmitting and receiving independent video and audio stream data, and simultaneously driving the same in a time-division manner, and using the video telephone function of the vehicle terminal system. A method for operating a wireless multimedia terminal system for a vehicle is provided, comprising a fourth step of performing a call setup and call control function so as to respond to a termination request from another vehicle terminal system even during the process.

delete

In the following, with reference to the accompanying drawings, a preferred embodiment according to the present invention will be described in detail.

1 is a module block diagram showing the configuration of a wireless multimedia terminal system for a vehicle according to an embodiment of the present invention. The driver interface unit 100, the multimedia data processing unit 120, the call control unit, and the data transmission unit 130 are shown in FIG. , The multi-task support unit 140 and the communication connection unit 150.

The driver interface unit 100 includes a driver interface module 101 that manages the entire system interface, and is responsible for data presentation for driving information reference and start and end functions of a video call, and with the help of the driver information management module 102. Receive a video call by selecting a predetermined user menu for a remote driver or a distribution center manager wants to call, the vehicle information management module 103 processes and presents the information required for vehicle operation and management.

The multimedia data processing unit 120 utilizes the functions of the voice synthesis and voice recognition module 121 that does not require special key manipulation for the safety of the driver while driving, receives the driver's voice input, digitally compresses the received remote There is an audio input / output and audio stream driver module 122 which is responsible for output after restoring the driver's audio stream, and receives and digitizes a video signal and compresses it into a video stream. There is).

The call control and data transmission unit 130 has a call setup module 131 in charge of a call setup function that allows a vehicle driver to request a video call from a remote place or respond to a video call invitation from a remote place. After the call setup is completed, there is a signal control module 132 that performs performance exchange related to multimedia data processing between the mobile terminal system and the remote vehicle terminal system and performs a function such as setting a wireless data transmission channel. In addition, the real-time wireless transmission module 133 functions to packetize and transmit multimedia stream data and synchronization information of a vehicle terminal system in operation, and to extract packet data for each media by decompressing packet data received from a terminal system of another mobile vehicle. Has

The multi-task function support module 140 provides a multi-task function to an application program under an operating system of the vehicle terminal system, generates a task for transmitting and receiving independent video and audio stream data, and simultaneously drives the same in a time division manner. The call setup and call control functions can be continuously performed to respond to the termination request from another vehicle terminal system even while the video terminal function of the vehicle terminal system is in use.

The communication connection unit 150 has a wireless modem driver module 151 having a wireless modem environment construction function for the driver to perform a video call in a wireless vehicle environment in which the driver is moving, and supports a wired modem connection function to support a video telephone function on the Internet. It provides a wired modem driver module 152 to operate the modem so that it can be connected to the modem for telecommuting users. In addition, an ECU (Electronics Control Unit) driver module 153 is provided to store and present vehicle driving information.

2A and 2B are flowcharts illustrating a method of operating a wireless multimedia terminal system for a vehicle according to an embodiment of the present invention, and a signal for performing a video call participation request and a video call invitation among video telephony functions driven on the vehicle terminal system; The operation flowchart is shown.

First, in step S201, when the main task and the interface screen are performed, user management data is set, in step S202, after the call setup and signal control task is performed, in step S203, if there is an application to join the meeting, whether to allow or not To judge.

As a result of the determination in step S203, if participation in the conference is allowed, in step S204, it is determined whether the audio / video stream is supported, and if it is supported, in step S205, after initializing the video and audio capture / compression routine, In step S206, a local video and audio stream transmission task is performed.

Subsequently, in step S207, the wired / wireless modem and the ECU are connected to drive the communication connection module, in step S208, a remote video and audio stream reception task is performed, in step S209, after outputting video data, in step S210 It determines whether a teleconference end message has been received.

As a result of the determination in step S210, if an end message is received, the process terminates. If no end message is received, it is determined in step S211 whether a local conference end message has been received.

As a result of the determination in step S211, if the local conference end message is received, the procedure ends. If no local conference end message is received, the process returns to step S206.

On the other hand, if it is not supported as a result of the determination in step S204, in step S212, it is determined whether or not the system is to be terminated, and if it is to be terminated, it is terminated. If not, it is returned to the step S202.

As a result of the determination in step S203, if participation in the meeting is not permitted, the flow proceeds to step S212.

Meanwhile, an operation method of the vehicular wireless multimedia terminal system illustrated in FIGS. 2A and 2B will be described in detail with reference to FIG. 1.

First, when driving of the vehicle terminal system according to an embodiment of the present invention starts, the driver interface module 101 generates a main task for maintaining the video telephony application until the terminal system is terminated, and presents a driver interface screen. .

Subsequently, the driver information management module 102 sets driver management data, manages driver information, presents a list of stored drivers on the screen, and, in the case of a driver not presented in the list, on the driver interface screen. Direct voice input will select / call the remote driver.

The call setup module 131 and the signal control module 132 are called when a remote driver is requested to select a remote driver from the driver interface screen or a video call function is requested from a remote driver while the video telephone function is driven. By calling the multi-task processing module 140, each corresponding task is generated, and a channel for call setup between the systems and a channel for information exchange regarding data processing performance for each media are set. At this time, if the telephone participation and participation request is rejected, the system is asked to shut down or terminates, or waits for call setup and signal control again.

If telephone participation is permitted, the common functionality that can be communicated is determined by comparing the multimedia data processing capabilities of the local driver terminal system with the capabilities of the remote driver terminal system. At this time, if the common function does not exist, it is asked whether to shut down the system again to terminate the video call function, or wait for call setup and signal control again.

A video and audio capture routine by calling the video capture / output and video stream driver module 122 and the audio input / output and audio stream driver module 123 based on multimedia data processing performance compared to a remote vehicle terminal system. Initialize the compression routine. Subsequently, the multi-task processing module 140 is invoked to generate and perform a local video and audio stream transmission task in order to transmit video data and audio data of a local driver. At this time, the network connection device for transmitting the media data of the local driver is driven by calling any one of the wireless modem driver module 151 or the wired modem driver module 152 according to the result set in the vehicle terminal system. The communication connection module is driven, and the packet data generated by the real time wireless transmission module 133 is transmitted to the remote driver terminal system.

After performing a remote video and audio stream reception task by calling the multi-task processing module 140, packet data received from a remote driver terminal system is separated into stream data for each media, and audio stream data is inputted to the audio input. The output and audio streams are sent to the audio stream driver module 123 and then restored. The video stream data is restored by performing the video capture / output and video stream driver module 122, and the driver interface module 101 is restored. The restored video data is then converted into a sprite and displayed on the remote driver screen in the driver interface screen.

The vehicle terminal system is driven to accept a call termination request from a remote driver while performing a video call, and when the local driver wants to terminate the video call function, a video call termination message is transmitted to the remote driver terminal system. If the local driver does not want to terminate the call, the local video and audio stream transmission task is continuously performed by calling the multi-task processing module 140.

The process of selecting a command or presenting a command execution result of a vehicle terminal system is a function of the voice synthesis and voice recognition module 121. Basically, in order not to disturb the driver's safe driving and visibility, voice recognition and voice are performed. The compositing function is used in parallel with the direct input method. That is, in the command input step, the function menu selection for the command and the voice input are simultaneously performed so that the driver selects the desired function at the minimum level. The confirmation of the selection result and the presentation of the help output the appropriate voice synthesis message.

delete

As described in detail above, the present invention is to operate a video call function based on the international standard for the multimedia terminal for video telephony with the support of the wireless multimedia environment to the user driving the vehicle on the vehicle terminal system that is the on-board multimedia input / output terminal. It has the effect of making it possible.                     

In addition, the vehicle video telephone function captures and compresses / transmits audio and video stream data in real time using a multitasking function on a vehicle terminal, and restores the audio and video stream data from a remote driver to present to a user. By providing various communication connection options of wired / wireless modem environment and ECU connection environment, and utilizing video service function of vehicle, it supports uninterrupted business processing during long time operation, and video telephony service in limited area such as complex building. And it can support the cooperative work, there is an effect that can be utilized as an information terminal or advertising terminal in the public vehicle in operation.

The technical spirit of the present invention has been described above with reference to the accompanying drawings, but this is by way of example only and not by way of limitation to the present invention. In addition, it is obvious that any person skilled in the art may make various modifications and imitations without departing from the scope of the technical idea of the present invention.

Claims (5)

A multimedia data processing unit, a call control and data transmission unit, and a multi-task function support unit, The multimedia data processing unit is a voice synthesis and voice recognition module that does not require special key manipulation for the safety of the driver in operation, and receives the driver's voice input, digitally compresses and restores the received audio stream of the remote driver and outputs the audio. An input / output and audio stream driver module, and a video capture / output and video stream driver module for receiving and digitizing video signals and compressing them into video streams. The call control and data transmission unit is a call setup module that is responsible for a call setup function that allows a vehicle driver to request a video call to a remote site or respond to a video call invitation from a remote site, and the mobile terminal system and the remote vehicle that are moving after call setup is completed. A signal control module for performing performance exchange related to multimedia data processing between terminal systems and performing functions such as wireless data transmission channel setting, and multimedia stream data and synchronization information of a running vehicle terminal system processed by the multimedia data processing unit. And a real time wireless transmission module for extracting stream data for each media by transmitting and extracting packet data received from a terminal system of another mobile vehicle. The multi-task function support module provides a multi-task function to an application program under an operating system of a vehicle terminal system during processing occurring in the call control and data transmission unit and the multi-task function support unit, and transmits and receives independent video and audio stream data. By creating a processing task to be driven simultaneously in a time-division manner, and continuously performing a call setup and call control function to respond to the termination request from another vehicle terminal system even while using the video telephony function of the vehicle terminal system Wireless multimedia terminal system for a vehicle, characterized in that. The method of claim 1, Further comprising a driver interface, The driver interface unit includes a driver interface module for displaying data for driving information reference and a start and end function of a video call, and driver information for selecting and calling a predetermined user menu for a remote driver or a distribution center manager who wants a video call. And a vehicle information management module for processing and presenting information necessary for vehicle operation and management. The method according to claim 1 or 2, Further comprising a communication connection, The communication connection unit supports a wireless modem driver module having a wireless modem environment building function and a wired modem connection function for the driver to perform a video call in a wireless vehicle environment in which a driver operates a wired modem to operate a video telephone function on the Internet. And a driver module, and an ECU (Electronics Control Unit) driver module for storing and presenting vehicle driving information. For the driver's safety, no special key manipulation is required, the driver's voice input is digitally compressed, the received remote driver's audio stream is restored, the output is performed, the video signal is input, and the video is digitized. Compressing into a stream; The vehicle driver performs a call setup function for requesting to participate in a video call to a remote place or responding to a video call invitation from a remote place, and after the call setup is completed, the multimedia data processing between the mobile terminal system and the remote vehicle terminal system is performed. Perform performance exchange, perform a function such as setting a wireless data transmission channel, and packetize and transmit multimedia stream data and synchronization information of a running vehicle terminal system corresponding to the result of the first step; Extracting packet data received from the terminal system of the second media and extracting stream data for each media; And During the processing in the first and second stages, the multi-task function can be given to an application program under an operating system of the vehicle terminal system, and a task for transmitting and receiving independent video and audio stream data can be generated and simultaneously driven in a time division manner. A third step of performing a call setup and call control function so as to respond to a termination request from another vehicle terminal system even while using the video telephone function of the vehicle terminal system. Operation method of a vehicle wireless multimedia terminal system comprising a. The method of claim 4, wherein It is responsible for presenting data for reference to driving information and starting and ending of video call, and selecting and calling a predetermined user menu for a remote driver or distribution center manager who wants to make a video call, and processes information necessary for vehicle operation and management. Steps to Present Operation method of a vehicle wireless multimedia terminal system further comprising.

Images