KR20070019321A - Intelligent interactive multimedia system - Google Patents

Abstract

The interactive multimedia system includes a core server, streaming servers and encoders. The core server includes an authentication server, a master server, a web server and a database. The authentication server is for checking the authentication of users. The master server redirects users to specific servers based on policies that take into account IP ranges, user information, and so on. The web server provides information to assist the user in selecting a channel. The database stores various data and policies such as user and account information. To determine which streaming servers can be used, the master server periodically sends heart beat signals to each streaming server. The encoder encodes multimedia content to provide various bit rates and resolutions. The encoder uses an optimized compression codec that allows real-time streaming without the need for buffering. This allows the user or manufacturer to talk to the streaming multimedia content in real time.

Core Server, Streaming Server, Encoder, Authentication Server, Master Server, Web Server

Description

Intelligent Interactive Interactive Multimedia System {INTELLIGENT INTERACTIVE MULTIMEDIA SYSTEM}

1 is a block diagram illustrating an interactive multimedia system according to an embodiment of the present invention.

2A is a block diagram illustrating an interactive multimedia system in accordance with an embodiment of the present invention.

2B illustrates an interactive multimedia system in accordance with an embodiment of the present invention.

The present invention relates to a multimedia system. In particular, the present invention describes a system for providing intelligent and interactive multimedia systems.

Conventional television broadcasting is achieved by transmitting television signals to multiple viewers via satellite or cable. Television content is pre-scheduled and pre-recorded. This method is suitable for some types of content, but the disadvantage of this system is its inflexibility in modern content delivery. Thus, viewer satisfaction is lower than desired.

For example, a television network may decide to broadcast a movie at a specific time and date. In order for a user to watch a movie, the user must watch using a channel at broadcast time. This is inconvenient for many viewers and only a few people can watch the movie. In addition, the smaller the number of viewers, the lower the profits of broadcasters due to the reduction in advertising revenue.

Some users have attempted to remedy these shortcomings by recording broadcast content, resulting in their users being able to watch the broadcast content at a convenient time. However, this does not solve the problem of content selection. Viewers are still limited to the content selected by the broadcaster. In addition, it is inconvenient and cumbersome for users to set recording schedules. Therefore, there have been occasions in which a user records a recording timing error or is not worth recording. In any case, the number of viewers is far below optimal.

In addition, in a typical broadcast, users only watch content, which is a passive experience without conversation. This lack of conversation causes boring and lowers viewer satisfaction.

Therefore, there is a need for a system that provides multimedia content to multiple users, allowing individual users to select and communicate with the content.

In order to achieve these and other advantages and overcome the shortcomings of the prior art in accordance with the object of the invention as embodied and broadly described herein, the present invention is to provide an intelligent interactive multimedia system.

The present invention provides an intelligent interactive multimedia system that provides a wide variety of multimedia content and services a large number of users using various platforms.

For example, users may use the Internet, satellite television, cable television, televisions with set top boxes, telecom networks, wireless cellular phones, local area networks, or other electronic equipment connected to other types of network equipment.

In addition, the system allows users to enjoy multimedia content as well as to communicate with the multimedia content, thereby increasing the level of enjoyment and satisfaction of the participants. Thus, users will participate more frequently and for longer periods of time.

The system of the present invention supports the streaming of multiple video and audio signals simultaneously on a single channel. For example, eight video signals and eight audio signals may be provided on a single channel. Thus, a single display or window allows users to easily communicate with these multiple multimedia signals. Since the present invention provides real time or near real time streaming, content providers or producers can use interactive applications. For example, when a content producer provides multimedia content, users can talk to the multimedia content and in real time with other users.

In addition, the system provides a number of channels for the user to select. For example, channels with specific content or topics such as movies, education, meetings, meetings, and concerts can be provided to users. Channels can be grouped by subject or region of interest.

Users or user groups can participate in interactive multimedia sessions and communicate in real time or near real time by text messaging, audio or video signals.

These and other objects of the present invention will become apparent to those skilled in the art through the following detailed description of the preferred embodiments.

It is to be understood that both the foregoing general description and the following detailed description are intended to provide additional explanation of the invention as typical and claimed.

The accompanying drawings are provided to provide a further understanding of the invention, and form a part of this specification. The entire drawings illustrate embodiments of the invention and, together with this description, serve to explain the principles of the invention.

DESCRIPTION OF EMBODIMENTS Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings. Wherever possible, the same or similar parts have been given the same reference numerals in the drawings and the specification.

1, a basic block diagram illustrating an interactive multimedia system in accordance with an embodiment of the present invention is shown.

The interactive multimedia system 10 of the present invention basically comprises a core server 20 or core servers, a streaming server farm 30 and one or more encoders 40. The multimedia content is streamed from the encoder 40 to the user 50 through the streaming server 30.

2A, there is shown a block diagram of an interactive multimedia system 210 in accordance with an embodiment of the present invention, and FIG. 2B shows an interactive multimedia system in accordance with an embodiment of the present invention.

The core server 220 includes an authentication server 221, a master server 222, a web server 223, and a database 224. The authentication server 221 is for checking the authentication of users. Users must pass authentication checks before they can connect to the streaming server. The master server 222 redirects users to a particular streaming server based on the policy defined in the master server 222. This policy determines which server streams multimedia content to users. This policy may take into account IP ranges, user information, user accounts, company names, channels, etc. For example, a policy may be established to allow a user's IP to indicate the user's location and to select an appropriate streaming server located near the user's location.

Web server 223 provides program information such as, for example, television program information to assist users in selecting a channel or program. The program information may list the program title, producer, synopsis, time, date, popularity or other information.

The database 224 stores various data such as user information, account information, policies, web information, and the like.

The core server 220 may include a single server or multiple servers. For example, authentication server 221, master server 222, web server 223, and database 224 may be realized as a single server. Alternatively, each may be a separate server or a combination of servers.

Firewall 230 separates core servers 220 and streaming servers 240. This increases the protection level of the core servers 200 and slows down the probability of attack by hackers.

Streaming servers 240 are a number of servers 241, 242, 243 arranged to stream multimedia content to / from users 261, 262, 263, 264. By adding more streaming servers 240, the system can be easily scaled to meet the needs of multiple concurrent users. In this way, the load is balanced between the subs 240 and, due to the large number of streaming servers, these servers have a high utilization rate.

To determine which streaming servers 241, 242, 243 can be used or on-line, the master server 222 periodically sends heartbeat signals to each streaming server 241, 242, 243. do. Heartbeat signals are for example TCP packets. This allows master server 222 to maintain a list of active servers. Therefore, if the streaming server goes down, goes down for maintenance, or goes offline, the master server 222 will redirect users to other streaming servers based on the defined policy and the list of active servers.

Additionally, the channel or channels can be streamed over a multicast protocol to save bandwidth.

The encoder or encoders 251 and 252 encode the multimedia content. They can also live stream and provide various bit rates and resolutions. Depending on the performance or environment of the network, the channel may be encoded as low as 56 Kbps or maximum broadband speed, for example 1.5 Mbps or higher, for dial-up links to provide better quality. Similarly, the resolution can be selected. For example, this resolution may be set to 160 × 120, 176 × 144, 320 × 240, 352 × 288, 640 × 480, or higher. In addition, the frame rate can be adjusted according to the available bandwidth with the higher frame rate requiring more bandwidth. The frame rate may for example be set as low as 1 frame per second or as high as 30 frames per second. In addition, encoders 251 and 252 use an optimized compression codec that allows real time or real time streaming without the need for buffering. This allows users or broadcasters to interact with streaming multimedia content in real time or near real time.

Transmission control protocol (TCP) is used to connect core servers 220 and streaming servers 240. TCP delivers data and allows packets to be delivered in the same order in which they were sent.

User Datagram Protocol (UDP) is used to provide a direct way to send and receive datagrams over an IP network between encoders 251, 252, streaming servers 241, 242, 243 and users.

Multicasting can be used so that the transmission content selects a group or number of users. For example, streaming server 243 may include several servers 243 and 244 for multicasting to users 263 and 264.

As an application example of the intelligent interactive multimedia system of the present invention, the following scenario is provided.

The multimedia producer prepares the multimedia content. Multimedia content may be pre-recorded or live. Multimedia providers create or assemble the infrastructure needed to distribute multimedia content. The multimedia producer and the multimedia provider can be the same entity or different entities. The multimedia provider also prepares programming information about the multimedia content to assist users in making program or channel selections.

Once the system is set up, users register or sign for the service. Their user and account information is stored in a database. After the user has connected with the multimedia provider and entered their access information, their authentication is verified. The user then selects a channel by accessing or guiding programming information. When the user selects the desired channel, the appropriate streaming server is selected and the multimedia content starts streaming to the user.

Because multimedia content is streamed in real time or near real time, the user can talk to the content. There are many ways a user can carry out this conversation. For example, if a user is connected via the Internet, the user can simplify the type text into a field in the chat portion of the interface. According to the channel, provider, policy or producer, this text may be automatically revealed or optionally selected to appear on a multi-section display. This allows other users to know the sender's comments. In this way, all users of the channel can communicate with the producers with each other or in real time. In addition, this allows content producers to adapt to their programs according to user feedback or discussion. For example, if the multimedia content is a movie, users may comment or discuss aspects of the movie as shown. In another example, if the content is an educational program such as a particular subject class, users can participate in the lecture like students by asking or answering questions.

In addition to text, the system of the present invention also allows users to add microphones and web cameras to provide video and audio signals. In this way, users can act as partial content producers. As in the educational programs of the above example, the instructor's video appears in part of the display, and each student's video can be displayed in other parts of the display. The multi-section display may include, for example, video from an instructor as well as video from multiple individual students. Similarly, audio can be heard from several users in addition to instructors. This allows the channel's virtual environment to be as close to the live experience as possible.

Users can also achieve similar results by using a television equipped with a set top box. Alternatively, users can talk using, for example, a 3G handset. Depending on the user's equipment, the conversation may include short message service (SMS) messages, multimedia message service (MMS) messages, still pictures, video, and audio. In addition, users can enjoy the audio portion of the multimedia content and can audibly communicate with the content by using a conventional telephone.

2A and 2B, various examples will be provided for various scenarios. The streaming server 241 is located at ISP 1. Encoder 251 and user 261 are connected to streaming server 241 at ISP 1. The multimedia content is encoded by the encoder 251 and streamed to the user 261.

In another example, user 262 and user 263 want to talk to the multimedia generated by encoder 252. However, user 262 and user 263 are connected with different ISPs. The multimedia content is encoded by encoder 252 and streamed to user 262 by streaming server 242. This content is also streamed to the user 263 by the streaming server 243 via the streaming server 242. This allows users connected to different ISPs to share the same interactive multimedia experience.

Expanding this example, streaming server 243 includes a group of servers 243, 244. This content may also be multicast to user 264 by another streaming server 244 in the server group of streaming server 243.

As an application of the present invention, the following scenario is provided. This scenario is merely an example and may be modified in various ways such as for content type or sequence.

The multimedia producer, producer A, prepares a group of films, for example French films. These movies are encoded and stored on a server or streaming server. The multimedia provider, ie provider B, establishes an infrastructure that includes core servers, streaming servers, network and encoders. The user, user C, signs for this service. When the user wants to watch the multimedia content, user C logs into the system and enters their user information. The authentication server verifies user C's information. Once verified, user C is connected to a web server to view the program information stored in the database. The available programming can be formatted by the master server, the list of available servers, policy, IP, or other criteria.

User C is interested in French films and chooses to watch the content provided by producer A. After searching for the channel and the film, the streaming server starts streaming the movie to user C.

To further complicate the above, producer A also provides a French film critic forum. This forum is hosted by film critics. Many users, User C, User D, User E, and User F, want to participate in the forum. Each user has a webcam and microphone connected to their computer. Once a forum session is started, audio and video from each user are encoded and streamed to each of the other users as well as streamed to the film critic's display. In addition, the film is streamed to each user. All these video signals are displayed on a single display in multiple sections or areas of the screen. The layout of the screen is selected by the producer or personalized by individual users. In addition, the film critic can control the audio signals to be heard by individual users. For example, if user C asks a question, the host can listen to user C's audio.

In addition, while the film is streaming, each user can communicate with the host and other users via text messaging. For example, users and hosts may comment on a particular screen or discuss what this film looks like.

During the entire session, the master server keeps a list of active servers by sending heartbeat packets to streaming servers. In this way, if any streaming servers are directed down, the user is automatically redirected to another streaming server.

For example, if user C is in the United States, the selected streaming server currently in use will stop working. The master server automatically redirects user C to another active server based on possible user C's policy or IP address. In this example, the master server selects an active server located in user A's hometown.

Clearly, many changes can be made to the above example. For example, content, number of users, providers, content location, etc. can be changed or adapted according to requirements.

Those skilled in the art will appreciate that various modifications and changes can be made to the present invention without departing from the scope or principles of the invention. In the foregoing, it is considered to cover modifications and variations of the present invention that are within the scope of the present invention.

The present invention provides an intelligent interactive multimedia system that provides a wide variety of multimedia content and services a large number of users using various platforms.

Claims (10)

As an interactive multimedia system, A core server including an authentication server that checks user authentication, a master server that redirects the user to a particular streaming server based on a policy, a web server that provides program information to the user to select a channel, and a database that stores data; A plurality of streaming servers for streaming multimedia content to a user; And, And at least one network connecting said streaming server, core server, and user. The method of claim 1, And a firewall between the core server and the streaming server to protect the core server. The method of claim 1, The data includes user information, account information, policy, web information, or program information. The method of claim 1, And a heartbeat signal periodically transmitted to the streaming server to maintain a list of active servers. The method of claim 4, wherein The heartbeat signal comprises a transmission control protocol packet. The method of claim 1, And at least one encoder for encoding multimedia content and providing the encoded multimedia content to a user via the streaming server. The method of claim 1, The network includes an internet, local area, wide area, telecom, wireless, fiber optic cable, satellite, or cellular network. The method of claim 1, The user datagram protocol is used to send and receive data over a network between encoders, streaming servers and users. The method of claim 1, The policy takes into account internet protocol address ranges, internet protocol addresses, user information, user accounts, company names, or channels. As an interactive multimedia system, A core server including an authentication server that checks user authentication, a master server that redirects the user to a particular streaming server based on a policy, a web server that provides program information to the user to select a channel, and a database that stores data; A plurality of streaming servers for streaming multimedia content to a user; A firewall between the core server and the streaming server; And, And at least one network connecting said streaming server, core server, and user.

Images