KR20090042549A

KR20090042549A - System and method for producing media that play impropriety in terminal, and server applied to the same

Info

Publication number: KR20090042549A
Application number: KR1020070108372A
Authority: KR
Inventors: 이중윤
Original assignee: 에스케이 텔레콤주식회사
Priority date: 2007-10-26
Filing date: 2007-10-26
Publication date: 2009-04-30
Also published as: KR100932055B1

Abstract

A system and method for offering media which cannot be reproduced and a server thereof are provided to reproduce all kinds of media desired by a user, efficiently by converting the media which cannot be reproduced into media which can be reproduced, and the offering the converted media to a user terminal. A service management server(200) extracts the media play information for a user terminal, determines whether the extracted media can be reproduced in the user terminal, and then determines a playback impossible factor if it is determined that one or more media cannot be reproduced. And then, the service management server converts the media which cannot be reproduced into media which can be reproduced and then transmits the media to the user terminal. A playback possibility discriminator(220) determines whether the user terminal can reproduce an moving picture, and then generates the reproduction impossible factor. A media converter(230) converts the moving picture corresponding to the playback impossible factor so as to be reproducible.

Description

System and method for providing media that can not be played on the terminal, and a server applied thereto {SYSTEM AND METHOD FOR PRODUCING MEDIA THAT PLAY IMPROPRIETY IN TERMINAL, AND SERVER APPLIED TO THE SAME}

The present invention relates to a technology related to media playback, and more particularly, when a user terminal device such as a mobile communication terminal or a PDA does not play predetermined media due to lack of performance related to media playback, the user terminal device on the server side. The present invention relates to a system and a method for providing non-playable media in a terminal for providing the user terminal device to a user terminal device after forming a non-playable media into a playable media through a media conversion process, and a server applied thereto.

A method and system for providing a multimedia content service based on a communication system through a high speed internet wired communication network or a wireless communication network such as IMT 2000 has been noted.

In particular, not only voice and text can be transmitted and received through a wired or wireless terminal device, but also a function of transmitting and receiving still images and videos, and a function of sending and receiving music files such as MP3 files are added to the terminal device or an external device. As a result, the technical foundation for transmitting / receiving multimedia content files by wire or wireless is being prepared, and the technical basis for distributing multimedia contents files by themselves and distributing them to wired or wireless communication networks is also provided. .

Furthermore, since a user terminal device, which is a wired or wireless terminal device, cannot have a performance related to media playback capable of playing all the myriad media (eg, still images or videos) provided as multimedia content files, playback is not possible. There is no choice but to generate impossible media.

There are countless kinds of media such as text, still image, audio, and video, and if you list by file extension for playing the kind of audio, there are mpa, mp3, mp2, wma, wav, and so on. Listed by file extension to be played are wmv, avi, divx, asf, mpg, and so on.

As described above, it is not easy to provide a codec for reproducing all of the user terminal devices due to the numerous types of media.

In addition, the user terminal device has a relatively low processing power than a personal computer (PC) in terms of the ability to process a variety of media playback, as well as the reason that the codec is not provided, as well as the corresponding media on the terminal screen In terms of hardware performance up to display, the processing power is insufficient to limit the playable media.

In terms of the hardware processing capability of the user terminal device, it is more frequently encountered when the performance limits are played while playing at least two or more media than when playing a single media.

Typically, a user terminal device that plays back at least two media (eg, a video) includes a memory for storing compressed video files, a first decoder for decompressing and outputting a first video file stored in the memory, and a second stored in the memory. A second decoder for decompressing and outputting a video file, an image processor for synthesizing and outputting video frames output from the first and second decoders, a display unit for displaying data output from the image processor, and processing for media playback. It is executed through the control unit to be executed.

The memory may be various storage devices such as one or a plurality of flash memories, a hard disk, an optical disk storage device, or a combination thereof.

The first decoder and the second decoder are each implemented as a flexible digital signal processor capable of reproducing a compressed file of a plurality of formats. One or more of various formats such as MPEG-4, H.263, MPEG-7 and MPEG-2 may be supported.

Thus, while operating simultaneously, the two decoders can play video files of different formats.

Each decoder starts playback from the specified temporal position for the designated moving image file. Each decoder supports double speed playback and slow playback.

Decoders with this function are provided commercially, and related codecs decompress each file and output image frames in a standard format such as YUV or RGB.

The image processor may enlarge or reduce the input image frames, and may synthesize the two images.

For example, two videos may be shrunk and displayed by dividing the screen. One video frame may be displayed on the full screen as a main screen, and the other video frame may be reduced and displayed in a picture-in-picture format.

However, the user terminal device in the prior art can play the media, in particular two videos at the same time to output on the terminal screen, in order to play more videos at the same time should be implemented with better performance, all user terminals Since the device is not implemented to play two videos through an operation in the terminal, there is a problem that a video that cannot be played in the terminal must be generated.

There is a need for a solution to overcome this problem.

Accordingly, the present invention has been made to solve the above problems, and an object of the present invention is to provide a server when a user terminal device such as a mobile communication terminal or a PDA fails to play predetermined media due to lack of performance related to media playback. A system and method for providing non-playable media in a terminal for providing to a user terminal device after forming a media that cannot be played through a user terminal device through a media conversion process and providing the same to a user terminal device, and a server applied thereto There is.

In addition, another object of the present invention is to mediate the media playback-related information for the user terminal in order to efficiently utilize the wireless communication environment regardless of the performance related to the media playback in the user terminal device, based on the user terminal The present invention provides a system and method for providing media that can not be played in a terminal for converting and providing a corresponding media to match a user terminal device and transmitting a server applied thereto prior to transmission to the device.

In addition, another object of the present invention is to determine at least one or more causes of the media that can not be played on the user terminal device at the server side, and then to perform a process for resolving a plurality of causes that cannot be played, the user terminal, The present invention provides a system and method for providing media that can not be played in a terminal for forming and providing media that can be played in a device, and a server applied thereto.

In order to achieve the above object, a system for providing media that cannot be played in a terminal according to the first aspect of the present invention is based on at least one user terminal device for requesting provision of at least one media and media playback information on the user terminal device. After determining whether or not the at least one media is playable, and forming a non-playable factor, the at least one media is converted to be playable in response to the non-playable factor, and the converted at least one media is converted into the user terminal device. Characterized in that it comprises a service management server for delivering to.

Preferably, the media play information is information on a media play environment including codec information of a media playable through the user terminal device and hardware information for display.

Preferably, the media play information is information formed and provided from the user terminal device or information formed by the service management server based on the terminal information provided from the user terminal device.

Preferably, the user terminal device transmits the media play information to the service management server while requesting provision of the at least one or more media.

Preferably, the service management server is characterized in that the extraction of the media playback information corresponding to the terminal information on the basis of the media storage database previously stored.

Preferably, when the non-playback factor is a codec mismatch, the service management server converts the codec for the at least one or more media based on the codec information included in the media play information.

Preferably, when the non-playback factor fails to simultaneously play at least two or more media through the user terminal device, the service management server uses the at least one code based on codec information included in the media play information and hardware information for display. It is characterized by converting two or more media through media synthesis.

Preferably, the service management server is characterized in that for converting the at least two or more media into a single media through the media synthesis.

Preferably, the service management server performs the resolution conversion for the at least one or more media when the non-playable factor is overloaded when playing the at least one or more media through the user terminal device. It is done.

Preferably, the service management server corresponds to a case in which the non-playback factor is at least one of factors including a codec mismatch, a case in which at least two or more media cannot be played simultaneously, and a case in which an overload occurs during playback. And converting the at least one or more media to be playable based on the media play information.

Preferably, the at least one media is characterized in that it comprises at least one of a moving picture and a still image.

In addition, the service management server according to a second aspect of the present invention for achieving the above object, an interface for connecting to a user terminal device requesting at least one or more media, based on the media playback information for the user terminal device; A playable determining unit for determining whether the at least one or more media is playable to form a non-playable factor, a media converter for converting the at least one or more media to be playable in response to the non-playable factor, and the play Receiving the at least one or more media based on the result of the determination of the availability and delivering the at least one media to the user terminal device, or receiving the converted at least one media and resetting the media to a service providing target to deliver the at least one media to the user terminal device. Including the management department And that is characterized.

Preferably, the media play information is information formed and provided from the user terminal device or information formed by the playable determination unit based on the terminal information provided from the user terminal device.

Preferably, when the service management server forms the media play information through the playable determination unit, the service management server further includes a first database for previously storing the service subscription information and the terminal information for the user with the corresponding media. Characterized in that.

Preferably, the service management server further comprises a second database for pre-storing the at least one or more media, or the second database is provided in an external server to interoperate with each other.

Preferably, when the non-playback factor is a codec mismatch, the media converter converts the codec for the at least one or more media based on the codec information included in the media play information.

Preferably, when the non-playback factor fails to simultaneously play at least two or more media through the user terminal device, the media converter may be configured based on codec information including the media play information and hardware information for display. The above media may be converted through media synthesis.

Advantageously, said media converter comprises a decoder for decoding said at least two or more media, a preprocessor for preprocessing execution including resolution conversion and frame rate adjustment of said at least two or more decoded media, respectively, said at least two or more preprocessing. Media synthesizing module for performing image placement between media through media compositing with media, Encoder for encoding and executing the media formed by the media compositing according to a predetermined bit rate, and images of the at least two media. And a controller for finely adjusting an image arrangement of media formed by the media composition and adjusting the bit rate according to a transmission bandwidth and whether or not the user terminal device is loaded.

Preferably, the decoder and the preprocessor are characterized in that provided with at least two or more corresponding to the at least two or more media.

Preferably, the media formed by synthesizing the media is characterized in that the media synthesized by converting the at least two or more media into a single media.

Preferably, the controller forms ROI (Region Of Interest, ROI) information for the media formed by the media composition, and then transmits the ROI information to the encoder to set differential encoding for each image area. It features.

Preferably, the media conversion unit performs resolution conversion for the at least one or more media when the non-playback factor is overloaded when playing the at least one or more media through the user terminal device. do.

In addition, the method for providing media that cannot be played on the terminal according to the third aspect of the present invention for achieving the above object comprises the steps of: (a) responding to a user terminal requesting at least one or more media provisions; Determining whether the at least one media is playable based on media play information of a terminal device to form a non-playable factor, (c) converting the at least one or more media to be playable in response to the non-playable factor And (d) delivering the converted at least one media to the user terminal device.

Preferably, the step (c) corresponds to a case in which the non-playback factor is at least one or more of factors including a codec mismatch, a failure to simultaneously play two or more media, and an overload during playback. And convert the at least one or more media to be playable based on the media play information.

Preferably, the step (c) is characterized in that when at least two or more media cannot be played simultaneously, the at least two or more media are synthesized into a single media that can be played on the user terminal device.

Therefore, in the present invention, when a user terminal device such as a mobile communication terminal or a PDA cannot play predetermined media due to lack of performance related to media playback, a media conversion process of media that cannot be played through the user terminal device on the server side is performed. By forming a media that can be played back and then providing it to a user terminal device, even if the performance related to media playback in the user terminal device is insufficient, not only can the user efficiently play all types of media, but also such a terminal device. It has the advantage of activating more various media services by removing the limitations in.

Hereinafter, a preferred embodiment of a media providing system that cannot be played in a terminal according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a media providing system that cannot be played on a terminal according to an exemplary embodiment of the present invention. As shown only by way of example in FIG. 1, a media providing system that cannot be played on a terminal may include a user terminal device 100 for requesting at least one or more media to access a media providing service and a user in response to the request. After extracting the media playback information for the terminal device 100 and determining whether at least one or more media scheduled to be provided to the user terminal device 100 can be played on the user terminal device 100 based on the extracted media playback information, If it is determined that at least one of the at least one or more media is not playable through the determination result, the non-reproducibility factor is further determined. Transfer the converted one or more media to the user terminal 100. It includes a service management server 200 for reaching.

Here, the media play information refers to information including codec information of media that can be played through the user terminal device 100 and hardware information for display.

This is formed in the user terminal device 100 and delivered to the service management server 200 through a service request, or the terminal information (eg, terminal type information) provided by the service management server 200 from the user terminal device 100. It is possible to form through matching with the user and terminal information previously stored in the first database 250 based on the.

At least one or more media to be provided to the user terminal device 100 may be various, such as still images, videos, sounds, texts, and so on.

The service management server 200 determines a non-playback factor that acts as an obstacle to playing at least one video on the user terminal device 100, and if the non-playback factor is a codec mismatch, The codec for at least one video is converted based on the codec information included in the corresponding media presentation information.

In addition, the service management server 200 is at least two or more based on the hardware information for the display and the codec information included in the media playback information when the non-playability factor is not able to simultaneously play at least two or more videos through the user terminal device 100; A video is synthesized based on a video that can be played by the user terminal device 100.

Here, preferably, at least two videos are converted into a single video that can be played back by the user terminal device 100.

In addition, the service management server 200 acts as a barrier to playing in the user terminal device 100 when an overload occurs when the non-playback factor plays at least one or more videos through the user terminal device 100. In order to prevent a load from being generated, conversion for load prevention is performed, including resolution conversion of at least one video.

Further, the service management server 200 at least based on the interface unit 210 for connecting to the user terminal device 100 that requests the provision of the at least one video and the media playback information of the user terminal device 100. Playable determining unit 220 for determining whether or not playable for one or more video to form a non-playable factor, Media conversion unit 230 for converting at least one video corresponding to the non-playable factor to be playable ), And if a non-playback factor is not formed, the corresponding at least one or more videos are directly transmitted to the user terminal device 100, and a non-playback factor is formed to be provided through a conversion process through the media converter 230. Resetting at least one video to a target for providing a service to deliver to the user terminal 100 And a management unit (240).

When the service management server 200 forms the media play information through the playable determination unit 220 in response to the service providing request of the user terminal device 100, the service management server 200 corresponds to the service subscription information and the terminal information for the user. It further includes a first database 250 for matching with the pre-store.

In addition, the service management server 200 includes a second database 260 for pre-store and managing at least one video, the second database 260 is provided in an external server and implemented in a manner of interworking with each other. It is possible.

FIG. 2 is a block diagram of the media converter 230 in the configuration of the service management server 200 shown in FIG. 1. As shown only as an example in FIG. 2, the media conversion unit 230 is a module for solving the non-playback factor, which can be variously implemented according to each factor, and the non-playback factor is the user terminal device 100. In the case where at least two videos cannot be simultaneously played in the media converter 230, the first decoder 231 to the Nth decoder respectively provided for decoding at least one or more videos to be transmitted to the user terminal device 100. 231, the first preprocessor 232 to the N th preprocessor 232 for executing various preprocessing including resolution conversion and frame rate adjustment, respectively, of the at least one video to be decoded and transmitted, and are output through the preprocessing process A media compositing module 233 for executing video compositing for at least two videos and further performing arrangement between the images; An encoder 234 for encoding and outputting a video output through the video synthesis process at a predetermined predetermined bit rate, and a video synthesized and output based on a video arrangement relationship for at least two videos before conversion is performed. And a controller 235 for fine-adjusting the image arrangement for the image and adjusting the bit rate according to the transmission bandwidth and the load on the user terminal 100.

Hereinafter, with reference to the accompanying drawings will be described in more detail with respect to the operation of the media providing system that can not be played in the terminal according to the present invention.

FIG. 3 is a flowchart illustrating an operation process of a media providing system that cannot be played in a terminal illustrated in FIG. 1. As shown only as an example in FIG. 3, the video providing method that cannot be played in the terminal proceeds by the user terminal 100 accessing the service management server 200 for a request for a service based on the video providing. It becomes (S100).

Subsequently, the service management server 200 extracts the corresponding media play information based on the user and the terminal information that is stored in advance by using the terminal information provided from the user terminal device 100 (S102), and based on the extracted media play information. It is determined whether the at least one video scheduled to be provided to the user terminal device 100 is playable (S104).

In the step S104, using the result of the determination, the user terminal device 100 further determines and forms a non-playback factor that acts as an obstacle to playing the at least one video (S106).

If the non-playback factor formed in step S106 does not simultaneously play at least two or more videos through the user terminal device 100, the user terminal device after preprocessing through each decoding process of the at least two or more videos is performed. The process of converting a single video based on the playable video in step 100) is performed (S108 and S110).

Thereafter, the single video is reset to a target corresponding to the video providing based service requested from the user terminal device 100 (S112), and then transferred to the user terminal device 100 (S114).

Accordingly, the user terminal device 100 executes a process of displaying the received single video on the terminal screen (S116).

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art will be variously modified and changed within the scope of the invention without departing from the spirit and scope of the invention described in the claims below. I can understand that you can.

In addition, in the present invention, when a user terminal device such as a mobile communication terminal or a PDA does not play predetermined media due to lack of performance related to media playback, a media conversion process of media that cannot be played through the user terminal device on the server side is performed. Formed as a media that can be reproduced through and then provided to the user terminal device, it is an invention that is industrially applicable because it is not only commercially available or commercially viable, but also practically evident.

1 is a block diagram of a media providing system that cannot be played on a terminal according to an embodiment of the present invention;

FIG. 2 is a block diagram of a media conversion unit among components constituting the service management server shown in FIG. 1;

FIG. 3 is a flowchart illustrating an operation process of a media providing system that cannot be played in a terminal illustrated in FIG. 1.

100: user terminal 200: service management server

210: interfacing unit 220: playable determination unit

230: media conversion unit 231: decoder

232: preprocessor 233: media synthesis module

234: Encoder 235: Controller

240: management unit 250: the first database

260: second database

Claims

A user terminal for requesting provision of at least one media; And

Determine whether the at least one media is playable based on the media play information of the user terminal device to form a non-playable factor, and convert the at least one or more media to be playable in response to the non-playable factor; And a service management server for delivering the converted at least one media to the user terminal device.

The method of claim 1, wherein the media playback information is

And information on a media playing environment including codec information of the media playable through the user terminal device and hardware information for display.

The method of claim 1 or 2, wherein the media playback information is

And information provided by the service management server based on terminal information provided from the user terminal device or information provided and formed by the user terminal device.

The method of claim 3, wherein the user terminal device

And transmitting the media play information to the service management server while requesting provision of the at least one media.

The method of claim 3, wherein the service management server

And the media playback information corresponding to the terminal information is extracted based on a media-related database stored in advance.

The method of claim 1, wherein the service management server

The codec for the at least one or more media is converted based on the codec information included in the media play information when the non-playable factor is a codec mismatch.

The method of claim 1, wherein the service management server

If the non-playback factor fails to simultaneously play at least two or more media through the user terminal device, converting the at least two or more media through media synthesis based on codec information included in the media play information and hardware information for display. Media providing system that can not be played in the terminal, characterized in that.

The method of claim 7, wherein the service management server

And at least two or more media are converted into a single media through the media synthesis.

The method of claim 1, wherein the service management server

Providing non-playable media in the terminal characterized in that the resolution conversion for the at least one or more media is executed when the over-play occurs due to the non-playability factor playing the at least one or more media through the user terminal device. system.

The method of claim 1, wherein the service management server

The at least one on the basis of the media play information in response to the codec mismatch, at least one or more of the factors including the failure to play at least two media at the same time, and the case of overload occurs during playback The media providing system that can not be reproduced in the terminal, characterized in that for converting the above media to be playable.

The method of claim 1, wherein the at least one media is

The media providing system that can not be played on the terminal, characterized in that it comprises at least one of a video and a still image.

An interfacing unit for accessing a user terminal device requesting at least one media providing;

A playable determining unit for determining whether the at least one media is playable based on the media play information of the user terminal device to form a non-playable factor;

A media converter configured to convert the at least one media to be playable in response to the non-playable factor; And

The at least one or more media are received and transmitted to the user terminal device based on the determination result of the playability, or the converted at least one or more media is received and reset to media for service provision and delivered to the user terminal device. Service management server comprising a management unit for.

The method of claim 12, wherein the media play information is

Service information server, characterized in that the information formed and provided from the user terminal device, or information formed by the playable determination unit based on the terminal information provided from the user terminal device.

The method of claim 13, wherein the service management server

When the media play information is formed through the playable determination unit, the service management server further comprises a first database for storing the service subscription information and the terminal information for the user in advance with the corresponding media.

The method of claim 12, wherein the service management server

And a second database for pre-storing the at least one or more media, or providing the second database to an external server to interoperate with each other.

The method of claim 12, wherein the media conversion unit

If the non-playback factor is a codec mismatch, converting a codec for the at least one media based on codec information included in the media play information.

The method of claim 12, wherein the media conversion unit

If the non-playback factor fails to simultaneously play back at least two media through the user terminal device, converting the at least two media through media synthesis based on codec information including the media playback information and hardware information for display. Service management server, characterized in that.

18. The method of claim 17, wherein the media conversion unit

A decoder for decoding the at least two media;

A preprocessor for preprocessing the at least two decoded media, each of which comprises a resolution conversion and a frame rate adjustment;

A media synthesizing module for executing image placement between media by synthesizing the at least two preprocessed media;

An encoder for encoding the media formed by the media synthesis according to a predetermined bit rate; And

A controller for finely adjusting an image arrangement of media formed by the media composition based on the image arrangement relationship for the at least two media, and adjusting the bit rate according to a transmission bandwidth and load on the user terminal device; Service management server, characterized in that.

19. The method of claim 18, wherein the decoder and the preprocessor are

Service management server, characterized in that provided with at least two or more corresponding to the at least two or more media.

19. The medium of claim 18, wherein the media formed by media synthesis is

And a media processed by synthesizing the at least two media into a single media.

19. The apparatus of claim 18, wherein the controller is

And after forming ROI (Region Of Interest, ROI) information for the media formed by the media synthesis, the ROI information is transmitted to the encoder to set a different encoding for each image area.

The method of claim 12, wherein the media conversion unit

And if the overplay factor causes an overload in playing the at least one or more media through the user terminal device, performing resolution conversion for the at least one or more media.

(A) responding to the user terminal device requesting the provision of at least one media;

(B) determining whether the at least one media is playable based on the media play information of the user terminal device to form a non-playable factor;

(C) converting the at least one media to be playable in response to the non-playable factor; And

(D) delivering the converted at least one media to the user terminal device.

The method of claim 23, wherein the (c) step

The at least one on the basis of the media play information in response to the codec mismatch, at least one or more of the factors including the failure to play at least two media at the same time, and the case of overload occurs during playback The media providing method that can not be reproduced in the terminal, characterized in that for converting the above-mentioned media to play.

The method of claim 24, wherein the step (c)

And when the at least two or more media cannot be played simultaneously, synthesizing the at least two or more media into a single media that can be played by the user terminal device.