METHOD AND SYSTEM FOR PROCESSING MOVING PICTURE DATA BASED
UPON VECTOR GRAPHIC ON WIRELESS NETWORK
Technical Field
The present invention relates to a method and system of diminishing and
transforming a moving picture based upon vector graphic for processing effectively
them using wireless terminals.
Background Art
Until early 1990's, just some people could use a computer and some of that
could use the Internet as a means of communication; However, now is the time that
most of the people can use the Internet with a computer. An important reason of
popular Internet is due to a practical use of the World Wide Web (WWW).
At present, based upon the Internet with the Web, various services are provided,
for example electronic commerce, cyber stock dealings, electronic mail (e-mail) and
business for supplying contents like image data or moving pictures. Using the Internet,
people can easily accomplish various works that have been accomplished by physical
efforts of the people- Therefore, the Internet services leaps into most important
businesses.
Briefly, the Internet is a data communications network for performing data
communication using a Local Area Network (LAN) or Public Switched Telephone
Network (PSTN) based upon a Transmission Control Protocol/Internet Protocol
(TCP/IP) between a plurality of unit networks identified by Internet Protocol (IP)
addresses and a plurality of hosts having private IP addresses within each unit network.
The host, which means a computer with a communication modem or phone line
connector, may communicate with other hosts by transmitting messages using these
unique IP addresses offered to each host. Users try to retrieve information from the
Internet so-called 'sea of information', get the desired information and make that to his
own information.
Recently, applications are highlighted, for example the GIF Animator or
Macromedia Flash for producing moving pictures, as well as the PhotoShop or Paint
shop for processing static images like photographs.
Especially, according to appearance of various characters, many netizens have
interest in a moving picture for expressing motions of the characters. Moreover, a
ratio of transmitting the moving picture such as a movie or animation is being grown by
increasing data transmission speed via a network and data processing speed in computer
systems coupled to the network.
FIG. 1 is a schematic illustration of general network for using the Internet of the
prior art.
Referring FIG. 1, prior network for coupling to the Internet has a composition
that a user's Internet terminal 10, a web server 18 and an Internet Service Provider (ISP)
20 are interconnected for delivering data. The user's Internet terminal 10 receives
commands from the users for acquiring desired information. A wire network 12
connects the user's Internet terminal 10 with another terminal using the commands and
user's IP address. A gateway 14 transforms the commands and IP address, which are
provided from the wire network 12, to a specific data format for use on the Internet.
The Internet 16 acts as an agent to interconnect networks for accomplishing the
commands from the gateway 14. A web server 18 provides web information by
receiving the commands from the Internet 16. The ISP 20 is coupled to another
network using the commands from the Internet 16. An intranet 22 is coupled to the
Internet 16 through the ISP 20 and may include its own database 24.
Above network for coupling to Internet has a problem not to supply a movement
of the terminal. However, it is proposed a mobile Internet technology, which can
provide an Internet coupling service in a moving condition beyond a fixed position
because the existing IP addresses are used in the portable computers and mobile hosts
with mobile terminals due to a rapid development for an information technology and
electronics recently. Because it is used a wireless network using a mobile
communication system, for example a Personal Digital Assistants (PDA), cellular phone
or International Mobile Telecommunication 2000 (IMT2000), users can make a use of
the wireless Internet in a moving condition by the mobile communication system.
FIG. 2 is a schematic illustration of a prior mobile Internet service system using
a wireless network.
Referring FIG. 2, in the prior mobile Internet service system, a wireless internet
terminal 30 transforms commands, which are received from an external command input
device such as a keypad or touch screen, to Radio Frequency (RF) signal suitable for a
specific data service and then transmits the RF signal. A base station 32 demodulates
the RF signal, which is provided from the wireless internet terminal 30. A wireless
network 34 supplies the RF signal together with an Identity (ID) of the wireless internet
terminal using a protocol for Internet service. A gateway 36 transforms the protocol
signal, which is provided from the wireless network 34 for the Internet service, to
TCP IP protocol signal for Internet connection and then supplies. The Internet 38 acts
as an agent to interconnect networks for accomplishing the commands of the gateway
36. A web server 40 provides web information according to the commands received
from the Internet 38. The mobile ISP 42 is coupled to another network using the
commands from the Internet 38.
The operation of the mobile Internet service system is described in below.
When a user inputs a command through an external command input device such as a
keypad or touch screen, the command is transformed to a specific format suitable for a
protocol between the wireless network 34 and the gateway 36 in the wireless internet
terminal 30. The transformed command is transformed to a RF signal for transmission
via wireless channels by bandwidth spread or modulation and then transmitted to the
base station 32. The base station 32 receives and demodulates the RF signal provided
from the wireless internet terminal 30, and then transmits the demodulated RF signal to
a wireless network 34. The wireless network 34 transforms the RF signal to a specific
protocol language, for example a Handheld Device Markup Language (HDML),
Wireless Markup Language (WML) or mobility Hyper Text Markup Language
(mHTML) for Internet service on the wireless network and then supplies to a gateway
36. The gateway 36 transforms the input command to a TCP/IP format used on the
Internet. Thus, the users connect to the Internet 38 by generating an Internet protocol
address used on the Internet with an ID number of the wireless internet terminal 30.
Then, a command being inputted, users will be coupled to the web server 40 using
HTML, which is a protocol language supported to a web service on the Internet 38.
When a user inputs a command for acquiring specific information in another network,
the user can acquire the information by coupling to the mobile Internet Service Provider
42 using the TCP/IP of the Internet 38-
On the other hand, data transmission from the Internet 38 to the wireless internet
terminal 30 is accomplished in opposite sequence of the above. First, information
acquired from the web server 40 or mobile Internet Service Provider 42 on the Internet
38 is transmitted to the gateway 36. The gateway 36 transmits the information, which
is provided from the Internet 38, to the wireless network 34 using a protocol for HDML,
mHTML or WML. The wireless network 34 transmits the information to the wireless
internet terminal 30 according to the specific internet protocol address through the base
station 32.
Recently, there are many efforts to transmit various text data, image data, sound
data, color data or moving picture data through the wireless internet. However,
because performance of wireless communication device such as PDA or portable
telephone is inferior to a PC, transmission and processing services of the moving picture
are less provided. Therefore, limited some services of the moving picture are jus
provided using sequential bitmap image.
FIG. 3 is a schematic diagram of a wireless service system of a moving picture
of the prior art-
Referring FIG. 3, the wireless service system of a moving picture of the prior art
includes a Wireless Application Protocol (WAP) gateway 60, so called WAP proxy,
between a wireless terminal 70 corresponding to a client and a web server 50. The
WAP gateway 60 acts as a role of inter-transforming between a WAP-used signal and a
Hyper Text Transfer Protocol (HTTP)-user signal mutually. As it were, a request
signal for an Internet service is provided to the WAP gateway 60 from the wireless
terminal 70. The WAP gateway 60 transmits the request signal, which is provided
using the WAP, to the web server 50 via the Internet. Then, the WAP gateway 60
transforms a response signal of the web server 50 to a WAP signal and then transmits
the WAP signal to a conesponding wireless terminal 70.
The wireless terminal 70 generates and transmits the request signal, and then
receives the response signal using a WAP browser 74 composed of a Wireless Markup
Language (WML), WML Script or extended Markup Language (XML). A wireless
Session Protocol (WSP)/Wireless Transaction Protocol (WTP) is used for delivering the
request signal or response signal between the wireless terminal 70 and the WAP
gateway 60. Thus, the WAP gateway 60 includes a HTTP/WTP transformer 62, which
is used for transforming a WTP signal from the wireless terminal 70 to a HTTP signal
and used for transforming a HTTP signal from the web server 50 to a WTP signal.
Also, it may include a protocol adapter 66 used for compatibility between a TCP/IP and
a WAP. Especially, the WAP gateway 60 may include a bitmap image transformer 64
used for transforming a sequential bitmap image, which is provided from the web server
50 by the HTTP, to a specific data format used on the wireless Internet. The image
data transformed by the bitmap image transformer 64 are transmitted to the wireless
terminal 70 from the WAP gateway 60 using a WTP. The users can confirm the
moving picture data on a display 76 in the wireless terminal 70 by the bitmap image
with being delivered from the WAP gateway 60 to the WAP browser 74 of the wireless
terminal 70.
For the above operation, the web server 50 includes a contents server 54, which
has various multimedia data, and a HTTP communication device 52 used for
transmitting the sequential bitmap image data to the WAP gateway 60 using a HTTP.
However, there is a problem that wireless delivery based upon the wireless
terminal is not accomplished properly because the moving picture including bitmap
images has vast size and the quality is bad comparing to its size. As it were, effective
data delivery cannot be accomplished because the size of the moving picture is larger
than the transmission speed. Moreover, it is a problem that the moving picture
including bitmap images is not compatible between users who have wireless terminals.
Disclosure of the Invention
The present invention is intended to overcome the above-mentioned
disadvantages. Therefore, it is an object of the present invention to provide a method
and system for processing a moving picture; that make a possible to transmit data at
high speed and to provide moving picture with excellent quality, on the ground of
transforming and optimizing the moving picture data based upon vector graphic to
specific format suitable for wireless internet environment, and then transmitting them to
users' wireless terminals.
To achieve the above objects, a method for processing a moving picture based
upon vector graphic of the present invention may comprise a step of detecting a Bezier
curve from the moving picture based upon vector graphic, a step of generating a first
straight-line and a second straight-line tangent to the Bezier curve by connecting at least
three control points that define the Bezier curve, a step of generating a third straight-line
tangent to the Bezier curve by interconnecting midpoints of the first straight-line and the
second straight-line, a step of dividing the Bezier curve into two sub Bezier curves on
the basis of the contact point between the Bezier curve and the third straight-line, a step
of repeating said step of dividing recursively for the sub Bezier curves, when an
approximate distance D, which is a distance between a crossing point of the first
straight-line and the second straight-line and the contact point on the Bezier curve by
the third straight-line, is not less than a pre-determined reference value, and a step of
substituting the first and second straight-lines that interconnect at least three control
points of each sub Bezier curve, which is divided by said step of dividing, for
corresponding sub Bezier curve, when each approximate distance D for each sub Bezier
curve is not exceeding a pre-determined reference value.
The moving picture based upon vector graphic may be made by the
Macromedia Flash.
The method for processing moving picture based upon vector graphic may
further comprise the step of constructing a triangle with the first and second straight-
lines substituting the sub Bezier curve and a base line that is a segment interconnecting
tangent points, which the first and second straight-lines are tangent to the sub Bezier
curve, and a step of substituting a line involving the base line for the first and second
straight-lines, when two intersecting angles related to the base line are not exceeding a
pre-determined reference angle.
The reference angle may have a value between 0 and π radian.
Moreover, a method for processing events based upon vector graphic of the
present invention may comprise a step of detecting location information of a mouse and
input information of mouse buttons within the moving picture based upon vector
graphic, a step of detecting a plurality of state information of control buttons of the
moving picture that control the moving picture displayed in a screen in accordance with
a location of the mouse and inputs of the mouse buttons, a step of deleting some state
information that does not correspond to a pre-determined directional button and input
button selected for controlling the moving picture in the wireless terminal among the
plurality of state information of the control buttons of the moving picture, a step of
recognizing locations of the control buttons of the moving picture displayed in the
screen of the wireless terminal and then forming a button network that interconnects the
control buttons of the moving picture, a step of receiving at least one button motion
among the directional buttons and the input buttons of the wireless terminal, and a step
of performing a function of the control button of the moving picture with a specific
location on the button network, in accordance with a motion of at least one button
among the directional buttons and the input buttons of the wireless terminal.
The state that does not correspond to a directional button and input button in the
wireless terminal may be UP or HIT AREA; from UP which defines an operation of the
Flash button when a pressed left button of a mouse is relaxed, DOWN which defines an
operation of the Flash button when a left button of a mouse is just pressed, OVER
which defines an operation of the Flash button when a mouse pointer is on the Flash
button, and HIT AREA which defines a region of action of the Flash button.
Moreover, a method for processing frame data based upon vector graphic of the
present invention may comprise a step of detecting a plurality of frame information
composed of a moving picture, a step of computing characteristic values of the motion
for each frame, a step of computing sequentially variations of the characteristic value of
the motion for continuous two frames, and a step of deleting one frame of the two frame,
when the variation of the characteristic value of the motion is not exceeding a pre¬
determined reference variation.
The step of computing characteristic values of motion for each frame may
comprise a step of constructing a matrix using screen information for each frame as
elements, and a step of computing a determinant of the matrix.
The screen information for each frame may comprise at least one selected from a
group consisting of rotation information, scale information and transition information.
Moreover, a method for processing moving picture based upon vector graphic
of the present invention may comprise a step of detecting elements that constitute a
moving picture, a step of detecting frame display elements, which are for displaying
characters on a screen, among the elements, a step of detecting detailed elements in the
frame display elements, a step of deleting the frame display element, when the detailed
elements of the frame display element are just composed of space arrangement elements
for ananging the characters in the space.
The method for processing moving picture based upon vector graphic may
further comprise the step of deleting background music element used for defining the
background music among elements constituting a moving picture.
The method for processing moving picture based upon vector graphic may
further comprise the step of transforming curve data, which constitute a moving picture,
to straight-line data.
The method for processing moving picture based upon vector graphic may
further comprise the step of transforming mouse events, which constitute a moving
picture, to button events of the wireless terminal.
The method for processing moving picture based upon vector graphic may
further comprise the step of deleting one frame of continuous similar frames among a
plurality of frames, which constitute the moving picture.
The step of deleting one frame of continuous similar frames among a plurality
of frame constituting the moving picture may comprise a step of detecting a plurality of
frame information constituting a moving picture, a step of computing characteristic
values of the motion for each frame, a step of computing sequentially variations of the
characteristic value of the motion for continuous two frames, and a step of deleting one
frame of the two frame, when the variation of the characteristic value of the motion is
not exceeding a pre-determined reference variation.
The method step of deleting elements or frames may comprise a step of
registering elements or frames to be deleted in a deletion list, and a step of deleting
selected elements or frames at regular interval among those of registered in the deletion
list.
The method for processing moving picture based upon vector graphic may
further comprise the step of recording a result of transforming the moving picture in the
header of the moving picture-
Moreover, a method for processing Macromedia Flash moving picture of the
present invention may comprise a step of detecting tag information of the Macromedia
Flash moving picture, a step of deleting a ShowFrame tag within the Macromedia Flash
moving picture when only PlaceObject tags exist in the ShowFrame tag, a step of
transforming curve data in a shape tag within the Macromedia Flash moving picture to
straight-line data, and a step of transforming a mouse event within the Macromedia
Flash moving picture to a button event of the wireless terminal.
The shape tags may comprise at least one selected from a group consisting of a
DefineShape tag, a DefineShape2 tag, a DefineShape3 tag and a DefineMorphShape tag.
The button tags may comprise at least one selected from a group consisting of a
DefineButton tag, a DefineButton2 tag, a DefineButtonCxform tag and a
DefineButtonSound tag.
Moreover, a method for processing moving picture based upon vector graphic
may comprise a step of collecting kind information about wireless terminals, a step of
detecting elements of a moving picture to be transmitted to the wireless terminal, a step
of determining whether at least one selected from a group consisting of color
information, font information, image information and sound information conesponds to
the kind of the wireless terminal that receives the moving picture, when the elements
include at least one selected from a group consisting of color information, font
information, image information and sound information, and a step of transforming at
least one selected from a group consisting of color information, font information, image
information and sound information so as to be suitable for a kind of the wireless
terminal, when at least one selected from a group consisting of color information, font
information, image information and sound information does not correspond to the kind
of the wireless terminal.
The kind information of the wireless terminal may comprise at least one selected
from a group consisting of a size of display screen, a number of colors to be displayed
and sound format to be outputted-
Moreover, a method of processing Macromedia Flash moving pictures of the
present invention may comprise a step of collecting kind information about wireless
terminals, a step of detecting tags of the Macromedia Flash moving picture to be
transmitted to a wireless terminal, a step of determining whether at least one selected
from a group consisting of a shape tag, font tag, bitmap tag and sound tag corresponds
to the kind of the wireless terminal that receives the Macromedia Flash moving picture,
when the Macromedia Flash moving picture include at least one selected from a group
consisting of a shape tag, a font tag, a bitmap tag and a sound tag, and a step of
transforming at least one selected from a group consisting of a shape tag, font tag,
bitmap tag and sound tag so as to be suitable for a kind of the wireless terminal, when at
least one selected from a group consisting of a shape tag, a font tag, a bitmap tag and a
sound tag does not correspond to the kind of the wireless terminal-
The font tags may comprise at least one selected from a group consisting of a
DefineFont tag, a DefineFont2 tag and a DefineFontlnfo tag.
The bitmap tags may comprise at least one selected from a group consisting of
a DefineBits tag, a DefineBitsJPEG2 tag, a DefineJPEG3 tag, a DefineBitsLossless tag,
a DefineBitsLossless2 tag and a JPEGTables tag.
The sound tags may comprise at least one selected from a group consisting of a
DefineSound tag, a SoundStreamBlock tag, a SoundStreamHead tag and a
SoundStreamHead2 tag.
Moreover, a method for processing moving picture based upon vector graphic
of the present invention may comprise a step of receiving a moving picture based upon
vector graphic, a step of detecting transform information from the header of the moving
picture, a step of determining whether at least one transformation between an off-line
transformation for wireless delivery and on-line transformation for kinds of the wireless
terminals is accomplished to the moving picture using the transform information, and a
step of performing at least one transformation between the off-line transformation and
on-line transformation for the moving picture in accordance with the result of
determination.
The transform information may be what indicates the result of at least one
transformation between the off-line transformation and on-line transformation.
Moreover, a method for processing Macromedia Flash moving picture of the
present invention may comprise a step of receiving a Macromedia Flash moving picture,
a step of detecting transform information from the header of the Macromedia Flash
moving picture, a step of determining whether at least one transformation between an
off-line transformation for wireless delivery and on-line transformation for kinds of the
wireless terminals is accomplished to the Macromedia Flash moving picture using the
transform information, and a step of performing at least one transformation between the
off-line transformation and on-line transformation for the Macromedia Flash moving
picture in accordance with the result of determination.
Moreover, a system for processing moving picture based upon vector graphic so
as to be suitable for wireless terminals coupled with a gateway which transmits the
moving picture based upon vector graphic to the wireless terminals may comprise a
database with moving pictures based upon vector graphic, an off-line transformer for
transforming the moving picture that selected from said database for a wireless delivery,
and a wire protocol communication device for transmitting the moving picture based
upon vector graphic, which is transformed by said off-line transformer, to the gateway
via a wire network, wherein said off-line transformer may comprise an element detector
for detecting frame display elements, which are for displaying characters on a screen,
among elements of the moving picture and an element controller for deleting the frame
display element, when the frame display element are just composed of space
arrangement elements for ananging the characters in the space.
The off-line transformer may further comprise a curve transformer for
transforming curves within the moving picture to straight-lines.
The curve transformer may comprise a curve detector for detecting a Bezier
curve from the moving picture based upon vector graphic, an approximate straight-line
generator for generating a first straight-line and a second straight-line tangent to the
Bezier curve by connecting at least three control points that define the Bezier curve and
for generating a third straight-line tangent to the Bezier curve by interconnecting
midpoints of the first straight-line and the second straight-line, a curve divider for
dividing the Bezier curve into two sub Bezier curves on the basis of the contact point
between the Bezier curve and the third straight-line, a curve division controller for
repeating said step of dividing recursively for the sub Bezier curves, when an
approximate distance, which is a distance between a crossing point of the first straight-
line and a second straight-line and the contact point on the Bezier curve by the third
straight-line, is not less than a pre-determined reference value, and a straight-line
processor for substituting the first and second straight-lines that interconnect at least
three control points of each sub Bezier curve, which is divided by said step of dividing,
for conesponding sub Bezier curve, when each approximate distance for each sub
Bezier curve is not exceeding a pre-determined reference value.
The off-line transformer may further comprise an event transformer for
transforming mouse events constituting a moving picture to button events of the
wireless terminal.
The event transformer may comprise a button selector for selecting a directional
button and input button among a plurality of buttons attached to the wireless terminal, a
state controller for deleting some state information that does not correspond to a pre¬
determined directional button and input button in the wireless terminal among a
plurality of button states for the moving picture, which have actions by receiving
locations of a mouse and inputs of the mouse button, a network constructor for
recognizing a button location of the moving picture displayed in a screen of the wireless
terminal, and then forming a button network that interconnects the buttons of the
moving picture, and a moving picture processor for selecting and performing a function
of the button of the moving picture with a specific location on the button network, in
accordance with a motion of the directional button and the input button of the wireless
terminal.
The system for processing moving picture based upon vector graphic may
further comprise a frame controller for deleting one frame of continuous similar frames
among a plurality of frames constituting the moving picture.
The frame controller may comprise a frame detector for detecting a plurality of
frame information constituting a moving picture, an arithmetical processor for
computing characteristic values of the motion for each frame, and for computing
sequentially variations of the characteristic value of the motion for continuous two
frames, and a frame processor for deleting one frame of the two frame, when the
variation of the characteristic value of the motion is not exceeding a pre-determined
reference variation.
The system for processing moving picture based upon vector graphic may
further comprise a deletion list controller for registering elements or frames to be
deleted in a deletion list, and for deleting selected elements or frames at regular interval
among those of registered in the deletion list.
The system for processing moving picture based upon vector graphic may
further comprise a header controller for recording a result of transforming the moving
picture in the header of the moving picture.
Moreover, a gateway system for processing moving picture based upon vector
graphic of the present invention so as to be used in wireless terminals by coupling to a
server which is for delivering the moving picture based upon vector graphic may
comprise an off-line transformer for detecting a moving picture based upon that
transmitted from the server and for transforming the moving picture for wireless
delivery, and a wireless protocol communication device for transmitting the moving
picture based upon vector graphic, which is transformed by said off-line transformer, to
user's wireless terminal through a wireless network, wherein said off-line transformer
may comprise an element detector for detecting frame display elements, which are for
displaying characters on a screen, among elements of the moving picture, and an
element controller for deleting the frame display element, when the frame display
element are just composed of space arrangement elements for arranging the characters
in the space.
Moreover, a gateway system for processing moving picture based upon vector
graphic of the present invention so as to be used in wireless terminals coupled with a
server which is for delivering the moving picture based upon vector graphic may
comprise a database with kind information about wireless terminals, an on-line
transformer for transforming the moving picture based upon vector graphic that
transmitted from the server so as to be used in the wireless terminal in accordance with
kind of the wireless terminal, and a wireless protocol communication device for
transmitting the moving picture based upon vector graphic, which is transformed by
said on-line transformer, to the wireless terminal through a wireless network, wherein
said on-line transformer may comprise an element detector for detecting elements of a
moving picture to be transmitted to a wireless terminal, at least one transformer selected
from a group consisting of a color transformer, which is for transforming a color
element so as to be suitable for a kind of the wireless terminal among the elements of
the moving picture, a font transformer, which is for transforming a font element to
shape information by dividing the font element so as to be suitable for a kind of the
wireless terminal, when the font information among the elements of the moving picture
does not correspond to the kind of the wireless terminal, an image transformer, which is
for transforming an image element to pixel information so as to be suitable for a kind of
the wireless terminal among the elements of the moving picture, and a sound
transformer, which is for transforming a sound element so as to be suitable for a kind of
the wireless terminal among the elements of the moving picture.
Moreover, a gateway system for processing moving picture based upon vector
graphic of the present invention so as to be used in wireless terminals coupled with a
server which is for delivering the moving picture based upon vector graphic may
comprise a database with kind information about wireless terminals, a transformation
judger for determining whether the moving picture based upon vector graphic, which is
transmitted from the server, has been accomplished an off-line transformation by
detecting transform information, an off-line transformer for transforming the moving
picture, which has not been accomplished the off-line transformation, so as to be
suitable for a wireless delivery in accordance with the result of transforming, an on-line
transformer for transforming the moving picture, which has been accomplished the off¬
line transformation, so as to be used in the wireless terminal in accordance with a kind
of the wireless terminal, a wireless protocol communication device for transmitting the
moving picture based upon vector graphic, which is transformed by said off-line
transformer or on-line transformer, to the wireless terminal through a wireless network,
wherein said off-line transformer may comprise an element detector for detecting frame
display elements, which are for displaying characters on a screen, among elements of
the moving picture, and an element controller for deleting the frame display element,
when the frame display element are just composed of space arrangement elements for
ananging the characters in the space, and wherein said on-line transformer may
comprise an element detector for detecting elements of a moving picture to be
transmitted to a wireless terminal, at least one transformer selected from a group
consisting of a color transformer, which is for transforming a color element so as to be
suitable for a kind of the wireless terminal among the elements of the moving picture, a
font transformer, which is for transforming a font element to shape information by
dividing the font element so as to be suitable for a kind of the wireless terminal, when
the font information among the elements of the moving picture does not correspond to
the kind of the wireless terminal, an image transformer, which is for transforming an
image element to pixel information so as to be suitable for a kind of the wireless
terminal among the elements of the moving picture, and a sound transformer, which is
for transforming a sound element so as to be suitable for a kind of the wireless terminal
among the elements of the moving picture-
Moreover, a wireless terminal for processing moving picture based upon vector
graphic transmitted from a gateway in accordance with a kind of a wireless terminal of
the present invention may comprise a memory system with kind information about
wireless terminals, a transformation judger for determining whether the moving picture
based upon vector graphic, which is transmitted from the gateway, has been
accomplished an on-line transformation by detecting transform information, an on-line
transformer for transforming the moving picture, which has not been accomplished the
on-line transformation, so as to be used in the wireless terminal in accordance with a
kind of the wireless terminal on the basis of the result of transforming, a moving picture
controller for processing the moving picture based upon vector graphic, which is
transformed through the on-line transformer, so as to be recognized by a user, and a
display for displaying the moving picture on a screen by the process of the moving
picture controller, wherein said on-line transformer may comprise an element detector
for detecting elements of a moving picture to be transmitted to a wireless terminal, at
least one transformer selected from a group consisting of a color transformer, which is
for transforming a color element so as to be suitable for a kind of the wireless terminal
among the elements of the moving picture, a font transformer, which is for transforming
a font element to shape information by dividing the font element so as to be suitable for
a kind of the wireless terminal, when the font information among the elements of the
moving picture does not correspond to the kind of the wireless terminal, an image
transformer, which is for transforming an image element to pixel information so as to be
suitable for a kind of the wireless terminal among the elements of the moving picture,
and a sound transformer, which is for transforming a sound element so as to be suitable
for a kind of the wireless terminal among the elements of the moving picture.
The moving picture controller may comprise a parsing processor for analyzing
sentences of the moving picture so as to display the moving picture having done the on¬
line transformation, and a rendering processor for visualizing the moving picture so as
to be recognized by a user.
Brief Description of the Drawings
FIG. 1 is a schematic illustration of a general network for using the Internet of
the prior art-
FIG. 2 is a schematic illustration of a prior mobile Internet service system using
wireless network.
FIG. 3 is a schematic diagram of a wireless service system of moving picture of
prior art.
FIG. 4 illustrates a Definition tag of the Macromedia Flash.
FIG. 5A and FIG. 5B illustrate a process of transforming curve in a moving
picture to straight-lines in a method and a system for processing moving picture data
based upon vector graphic in accordance with preferred embodiment of the present
invention.
FIG. 6A and FIG. 6B are schematic diagrams for describing a method of
transforming mouse events to button events of a wireless terminal in a method and
system for processing moving picture data based upon vector graphic in accordance
with prefened embodiment of the present invention.
FIG. 7 illustrates control tags of the Macromedia Flash.
FIG. 8 is a flow chart for describing an off-line transformation process of
transforming data of the Flash moving picture to wireless data suitable for a wireless
terminal in a method for processing moving picture data based upon vector graphic in
accordance with preferred embodiment of the present invention.
FIG. 9 is a flow chart for describing an on-line transformation process of
transforming wireless data so as to be suitable for each kind of wireless terminals in a
method for processing moving picture data based upon vector graphic in accordance
with preferred embodiment of the present invention.
FIG. 10 illustrates a schematic diagram of a system of processing moving
picture data based upon vector graphic in accordance with one preferred embodiment of
the present invention.
FIG. 11 is a flow chart for describing a process of treating the Macromedia
Flash moving picture in the web server in a method for processing moving picture data
based upon vector graphic in accordance with preferred embodiment of the present
invention.
FIG. 12 is a flow chart for describing a process of treating the Macromedia
Flash moving picture in a WAP gateway in a method for processing moving picture data
based upon vector graphic in accordance with preferred embodiment of the present
invention-
FIG. 13 is a flow chart for describing a process of treating the Macromedia
Flash moving picture in a user's wireless terminal in a method for processing moving
picture based upon vector graphic in accordance with preferred embodiment of the
present invention-
Best Modes for carrying out the Invention
Hereinafter, preferred embodiments of the present invention will be described in
more detail with reference to the accompanying drawings.
The present invention transforms and deletes some elements unsuitable for
wireless Internet environment by selecting from a moving picture based upon vector
graphic. It transforms curve data that needs a large amount of calculation, to straight-
line data. It also transforms mouse events accomplished on the wire Internet to keypad
events on wireless terminals. Thus, it can effectively transmit the moving picture in
wireless environment. Hereinafter, the above transformation will be called an off-line
transformation.
Also, the present invention can provide effective wireless service to many users
by on-line transformation that transforms the Macromedia Flash moving picture suitable
for wireless environment to a specific data format in accordance with kinds of wireless
terminals.
Moving picture data can be generally divided to bitmap image, which includes
all information of image pixels consisting of each frame, and vector graphic image,
which includes specific information for drawing the images consisting of each frame.
All the image data, for example performed by digital camera or scanner are
composed of pixels. The pixels have location information such as a distance from x-
axis and y-axis, existence of pixels or colors. The image using a small grid of regular
tetragon called a pixel for expressing is said to be a bitmap image or raster graphic.
The grid is composed of regular lines arranged wide and long. It is also used to
ascertain relative location of the image or to indicate coordinates on a screen.
On the other hand, programs, for example Macromedia Flash or Adobe
Illustrator for drawing an image on a computer generate vector graphics. The vector
graphic is an image performed by segments and curves that are identified as objects, so-
called vector and made from mathematical computation. As it were, it describes the
image not by pixels but by connection between one location and another location using
a straight-line or a curve. Thus, the vector graphic image may be an image having
mathematical computing information used for connecting segments of between one
location and another location (start point and end point). Therefore, not being real
subject like pixels, it must be changed to selective regions and then it must be
transformed to a bitmap image by filling the selective regions or boundaries of them
with some colors.
Although there are various applications based upon the vector graphic, it will be
described with reference to the Macromedia Flash in below.
A SWF file constituting the Macromedia Flash for a moving picture can widely
be divided to a header and tags. The header may have a file header for the SWF file
and a record header for specified data blocks. The tags as data blocks in the SWF file
have a tag type and a length. Besides, the SWF file may include a Character,
Character ID, Object, Depth number, Dictionary and Display list. The Character is a
conceptual Object defined by tags and tag data. The Object is an instance of a
Character unit to be realized in the Display list. Each Character has a Character ID
that consists of a 16-bit number for classifying the Characters defined in the SWF file.
Also, it may have Depth numbers composed of a 16-bits integer number for describing
the stacking order of elements on the Display list. The Dictionary indicates definitions
or cunent lists of all the characters that appear in the Flash moving picture in the SWF
file. The Display list indicates a list of the Object that exists at specific location of the
screen within some times.
The header may include a Version field indicating a transformation, a Size field
indicating a size of the file and a Protection field related to contents copyrights of the
Macromedia Flash moving picture. Especially, the Version field comprises a
combination of NONE, OFF CNVT and ON CNVT for indicating transformations of
the header-
A method and system for processing moving picture based upon vector graphic
of the present invention use the Version field of the header in order to indicate whether
the Macromedia Flash moving picture is transformed for a wireless data transmission.
When the moving picture is transformed, the size of the moving picture is so changed
that the data of the Size field will be altered-
Tags of the Flash moving picture are divided into a Definition tag and a Control
tag. The Definition tag manages a dictionary of resource like shapes, text, bitmaps and
buttons that may be used at specific location of the animation. The Control tag
manipulates the Display list, a start operation and a stop operation.
FIG. 4 illustrates a Definition tag of the Macromedia Flash.
Referring to FIG. 4, the Definition tag may include large number of tags, as it
were DefineShape, DefineShape2, DefineShape3, DefineMoφhShape, DefineBits,
DefineBitsJPEG2, DefineBitsJPEG3, DefineBitsLossless, DefineBitsLossless2,
JPEGTables, DefineButton, DefineButton2, DefineButtonCxform, DefineButtonSound,
DefineFont, DefineFont2, DefineFontlnfo, DefineText, DefineText2, DefineSound,
SoundStreamBlock, SoundStreamHead, SoundStreamHead2 and DefϊneSprite tags.
The DefineShape, DefineShape2, DefineShape3 and DefineMoφhShape tags
indicate shapes in the Flash moving picture. The DefineBits, DefineBits JPEG2,
DefineJPEG3, DefineBitsLossless, DefineBitsLossless2 and JPEGTables tags indicate
bitmap images. Also, the DefineButton, DefineButton2, DefineButtonCxform and
DefineButtonSound tags are button tags for indicating motions and operations of a
mouse- The DefineFont, DefineFont2, DefineFontlnfo, DefineText and DefineText2
tags indicate information of the text and font in the Macromedia Flash moving picture.
The DefineSound, SoundStreamBlock, SoundStreamHead and SoundStreamHead2 tags
indicate sounds of the Macromedia Flash moving picture. The DefineSprite tag
indicates other SWF moving pictures within the SWF moving picture.
It is need to delete or transform the shape tags, bitmap tags, font tags and sound
tags within the Definition tags for effective transmission of wireless data.
The bitmap tags, e.g., DefineBits, DefineBitsJPEG2, DefineBitsJPEG3,
DefineBitsLossless and DefineBitsLossless2, the font tags, e.g., DefineFont,
DefineFont2 and DefineFontlnfo, and sound tags, e.g., DefineSound,
SoundStreamBlock, SoundStreamHead and SoundStreamHead2 will be altered to a
specific format compatible for kinds of the wireless terminals. By transformation of
the above tags, the size of transmitted wireless data can be reduced.
As it were, since the Macromedia Flash moving picture is used as a vector
graphic, the bitmap tags are transformed in accordance with a number of colors supplied
from the wireless terminal. Also, the font tags and sound tags are transformed in
accordance with the font and sound of the wireless terminal.
Also, tags used for defining background music can be deleted because current
wireless terminals do not supply an operation of sound mixing.
On the other hand, the shape tags composed of the DefineShape, DefineShape2,
DefineShape3 and DefineMoφhShape include data describing the shapes of characters
in the Macromedia Flash moving picture. Also, the vector graphic like the
Macromedia Flash moving picture describes the shape of curves in second-order Bezier
curve- The Bezier curve is described by vertexes (control points) of polygon, which
define curves. Also the Blending function for determining shapes of the curves is
described by the Bernstein polynomial.
A method and system for processing moving picture data of the present
invention can reduce data size of the Macromedia Flash moving picture by transforming
data of the Bezier curve in the shape tags to a plurality of data of sequential straight-line
and by combining the data of the straight-lines.
FIG. 5A and FIG. 5B illustrate a process of transforming curve in moving
picture to straight-lines in a method and system for processing moving picture data
based upon vector graphic in accordance with preferred embodiment of the present
invention.
First referring FIG. 5A, a second-order Bezier curve Cl can be described with
two segments P1P2 and P2P3 that connect between an outer point P2, and two end
points Pl and P3 of the curve. As it were, one Bezier curve can be defined as three
points Pl, P2 and P3. A line interconnecting a midpoint P12 of the segment P1P2 to a
midpoint P23 of the segment P2P3 is always tangent to the Bezier curve Cl. If the
tangent point is called M, the initial Bezier curve Cl is divided into a curve between a
point Pl and a point M, and a curve between a point M and a point P3. Therefore, the
curve Cl can be described with three segments P1P12, P12P23 and P23P3. As it were,
the data of one curve can be transformed to data of three straight-lines- Then, it
measures the distance D between outer point P2 of the curve Cl and the midpoint M
when a curve can be described as three straight-lines. Recursively repeating the
processes of transforming the curve, the distance D between outer point of the curve and
tangent point becomes shorter and shorter. The unit of the distance D is a pixel or a
mathematical length because it can be varied from objects used for constructing a screen.
A number of divisions for the curve Cl can be altered by assigning the distance
D to specific value. As it were, enlarging the reference value of the distance D, the
number of divisions for the curve Cl becomes reduced. Thus, the size of straight-lines
for describing the curves can be reduced, but the accuracy of the curves becomes lower.
On the other hand, reducing the reference value of the distance D, the accuracy of the
curves becomes higher owing to describe the curve Cl with larger number of straight-
lines. For example, when the distance D is within unit length 1, the lower distance is,
the higher accuracy of the Macromedia Flash moving picture is. The higher distance is,
the lower data are transmitted to the wireless terminals. However, the size of
transmitted curve data can be reduced and the wireless data can be effectively
transmitted by transforming the Bezier curve to the straight-lines, regardless of the
magnitude of reference value of the distance D.
After transforming the curve in the moving picture to straight-lines by above
method, the straight-lines are described as illustrated in FIG. 5b by connecting the two
straight-lines adjacent to the curve.
As it were, a triangle P6P7P8 with a crossing point P7 as a vertex can be drawn
by intersecting the adjacent straight-lines P6P7 and P7P8. If the two angles Al and
A2, which obtained by measuring <P7P6P8 (Al) and <P7P8P6 (A2) constituting base
line of triangle P6P7P8, are less than a pre-determined reference angle, it can be
considered that the straight-line P6P7 is parallel with the straight-line P7P8. The
reference angle can be placed with random value between 0 and π radian. However,
preferably it is not exceeding a value of 0.2 radian.
Therefore, the two adjacent straight-lines (straight-lines P6P7 and P7P8) can be
described as one straight-line P6P8 by considering that the two straight-lines are parallel,
when their intersecting angle is less than the reference angle. The reference angle can
be controlled by pre-specified size or user's selection in a process of transforming data
with format suitable for each wireless terminal. Thus, the data size of the curve can be
much reduced by describing the curve to several straight-lines within specific range, and
by combining two adjacent straight-lines with one straight-line-
The processes of describing a curve to straight-lines and combining straight-
lines are continued until simplification does not proceed any more- In a process of
describing the boundaries of the Macromedia Flash moving picture, the straight-lines
that obtained from the curve by the transformation and the combination are described on
a screen, and then the original moving picture can be reformed by restricting the
coloring operation for the inner of the curve within the inner of the straight-lines. If
the distance D between a outer point and a tangent point of the curve, and a reference
value of base angles for the two adjacent straight-lines have low values, more precise
image can be described with a low size of the curve data.
Like above, the data size of the Macromedia Flash moving picture can be much
reduced by transforming the curve with shape tags to straight-lines and combining the
plurality of straight-lines.
Moreover, button tags composed of DefineButton, DefineButton2,
DefineButtonCxform and DefineButtonSound describe motions and operations of a
mouse. Thus, they can transform wireless data to a specific form suitable for the
wireless terminal without a mouse.
Operations of a mouse connected to user's computer system on a wire network
can be described by pointing information of up, down, left and right directions in
combination with press information of mouse buttons.
Buttons in the Macromedia Flash moving picture are made to act in accordance
with mouse events, for information of mouse location and input of the mouse button.
These Macromedia Flash events are processed by tags that define buttons. The four
states of the Macromedia Flash buttons are composed of an UP, DOWN, OVER and
HIT AREA. The UP defines an operation of the Macromedia Flash button when a
pressed left button of a mouse is relaxed- The DOWN defines an operation of the
Macromedia Flash button when a left button of a mouse is just pressed. The OVER
defines an operation of the Macromedia Flash button when a mouse pointer is on the
Macromedia Flash button. The HIT AREA defines a region of action of the
Macromedia Flash button in which operations of the UP/DOWN/OVER are
accomplished by motions of the mouse.
For example, when a mouse pointer is moved over the Macromedia Flash
button, it is decided whether the location of the mouse pointer is in a region of the HIT
AREA by x and y-coordinates of the mouse pointer. If the x and y-coordinates of the
mouse pointer are within the region of the HIT AREA, current state of corresponding
Macromedia Flash button is changed to the OVER. Moreover, when a left button of a
mouse is pressed with pointer laid on a Macromedia Flash button, current state of the
Macromedia Flash button is changed from the OVER to the DOWN. In the same way,
when a pressed left button of a mouse is relaxed, the state of the Macromedia Flash
button is changed to the UP.
Therefore, the method of transformation from mouse events to keypad events
suitable for the wireless terminals is changing states of the Flash buttons for recognizing
motions of the mouse pointer and states of the mouse in the wireless terminal without a
mouse.
FIG- 6A and FIG- 6B are schematic diagrams for describing a method of
transforming mouse events to button events of a wireless terminal in a method and a
system for processing a moving picture based upon vector graphic in accordance with
prefened embodiment of the present invention.
The method of transforming mouse events to button events of a wireless
terminal is described in the below referring to FIG. 6A and FIG. 6B.
Each time a mouse pointer moves, sequential values of x and y-coordinates are
altered. However, a wireless terminal does not have a mouse. Thus, five buttons
among a plurality of buttons of the wireless terminal are voluntarily selected for
indicating movements to up, down, left and right, and a command. Four directional
buttons and center button will generally be used. When the five buttons in a wireless
terminal are selected, the names of the left, right, up, down and enter may be assigned to
each button. In a wire computer system, coordinate value (x, y) of a current location is
changed to (x, y+1), (x, y-1), (x-1, y) and (x+1, y) respectively. However, the
coordinate value (x, y) in a wireless terminal is changed to (xl, yl), (x2, y2), (x3, y3)
and (x4, y4) respectively. The xl, x2, x3 and x4 are 0 or positive integers not
exceeding the maximum of left and right of a screen. Also, the yl, y2, y3 and y4 are 0
or positive integers not exceeding the maximum of up and down of the screen. The
coordinate values are related to x-directional or y-directional distance between a
Macromedia Flash button with an OVER state and an adjacent button located up, down,
left and right.
Assume nine Macromedia Flash buttons with shapes of square and a center
Flash button with a current OVER state as described in FIG. 6A.
When a central point of a Flash button with an OVER state has a coordinate
value (x, y), a nearest Flash button located at left direction (-x direction) of the current
Flash button is selected according to press of left button of the wireless terminal. If
any Macromedia Flash button does not exist in the left direction, no action is generated.
However, a Macromedia Flash button being found in the left direction as described in
FIG. 6A, the central point (xl, yl) of the newfound Macromedia Hash button is
calculated.
The OVER state of the current Hash button is changed to the UP state and the
state of the newfound Macromedia Hash button becomes an OVER state. And then,
cunent location is altered to the new calculated location (xl, yl) as described in FIG.
6B. A difference (xl-x, yl-y) between coordinate values (x, y) and (xl, yl) of
adjacent two Macromedia Hash buttons is made link to each Macromedia Hash button.
With above method, constructing network for up, down, left and right among adjacent
Macromedia Hash buttons, it is possible to transform an event, which links from one
button to another buttons in accordance with sequential motions of the mouse, to
keypad events. Also, a state that the left button of the mouse is pressed can be
substituted for a state that the enter button is pressed. Therefore, mouse events for the
Macromedia Hash moving picture can be accomplished just by states of the DOWN and
OVER of a wireless terminal. Thus, other events, states of the UP and HIT AREA can
be deleted- After all, among the mouse events of the Macromedia Hash moving
picture realized in a computer system, states of the DOWN and OVER are transformed
for using in a wireless terminal, and rest states of the UP and HIT AREA are deleted.
Thus, data size to be processed and controlled in the wireless terminals can be reduced.
HG. 7 illustrates control tags of the Macromedia Hash moving picture.
Refening to HG. 7, control tags of the Macromedia Hash include End,
FramdLabel, PlaceObject, PlaceObject2, Protect, RemoveObject, RemoveObject2,
SetBackgroundColor, ShowFrame, StartSound and DoAction tags. The ShowFrame
tag of the control tags displays all Characters within the Display list on a screen.
Finished the operation for displaying frames, the End tag stops a displaying operation of
the Hash moving picture. The ShowFrame tag is generally composed of the
PlaceObject tags. The PlaceObject tag places the Characters due to the Definition tag
on a space. When any other tag exists in the ShowFrame tag except the PlaceObject
tag, the other tags must not be deleted because they define others. However, if the
PlaceObject tags exist only in the ShowFrame tag, the ShowFrame tag can be deleted
since the aesthetic identity of the Macromedia Hash moving picture is maintained even
if the ShowFrame tag is deleted.
On the other hand, each frame can be compared with adjacent frame in the
Macromedia Hash moving picture. For example, data in the ShowFrame tag include
information of rotation, scale or translation of the moving picture. The information of
each frame can be constructed to a matrix. Then, determinant of the matrix for
indicating motion characters of each frame can be obtained. Calculating the variation
of the determinants between adjacent frames, the adjacent frames are considered as
continuous frames that have little change between the adjacent frames when the
variation is not more than a pre-determined reference variation. For the continuous
frames with little change, one frame of the continuous two frames can be deleted.
HG. 8 is a flow chart for describing an off-line transformation process of
transforming data of the Macromedia Flash moving picture to wireless data suitable for
a wireless terminal in a method for processing a moving picture based upon vector
graphic in accordance with preferred embodiment of the present invention.
The off-line transformation process is described in the below referring to HG. 8.
The off-line transformation process may be accomplished in a WAP server or a WAP
gateway.
A transformation of the moving picture, which is produced by an application
based upon vector graphic like the Macromedia Hash, is accomplished according to its
tag, or data within the tag. For the process, the WAP server or WAP gateway first
receives tags existing in the Macromedia Hash moving picture (slO). It examines
whether the input tag is a tagEnd indicating end of the tags (sl2). When a tagEnd is
found, it registers the information, which indicates a size, event transformation and
shape optimization of the moving picture with a low size by the off-line transformation,
in a header. And then, the off-line transformation ends after the version information of
the header is modified to OFF_CNVT and then registered (sl4). The version
information is a field located in the header of the Macromedia Flash moving picture and
indicates whether the off-line transformation is accomplished.
When a tagEnd is not found, it examines whether the input tags include a
ShowFrame tag to be used for transforming wire data to wireless data (sl6). When a
ShowFrame tag is found, it examines whether it is composed of only PlaceObject tags
(s20). When the ShowFrame tag is composed of only PlaceObject tags, it registers the
ShowFrame tag in the between frame list since it can be deleted in a rendering process
for visualizing the Macromedia Hash moving picture on a screen of the wireless
terminal (s22)- The between frame list indicates frames that have a probability to be
deleted among a plurality of frames constituting the Macromedia Hash moving picture
through a process of transforming the frames to the wireless data- Therefore, all or
some selected from the frames registered in the between frame list can be deleted before
those frames are transformed to the wireless data. Otherwise, though all the frames are
registered in the between frame list, those frames can be used for processing wireless
data without deleting-
Each frame may include other tags except the PlaceObject tag. Other tags
except the PlaceObject tag define objects that displayed on a screen of a wireless
terminal or are used in a rendering process for visualizing such as a tag for deleting
objects on a screen. Thus, the tags are considered what must not be deleted. When a
frame is considered as what must not be deleted, the WAP server or the WAP gateway
applies a deletion rule to the frames by computing a variation of motion characters
between continuous frames (s36). Due to the deletion rale, when a variation for the
motion characters between the continuous two frames, e.g., front frame and rear frame,
is not exceeding a pre-determined reference variation, the front frame or rear frame is
deleted by considering that little variation exists between the two frames (s38).
Motion characters of each frame can be obtained by constracting the
information of rotation, scale or transition of the moving picture as a matrix, and then
by computing determinants of each matrix. Thus, calculating an absolute value for
difference of the determinants of the continuous two frames, and then the absolute value
compares with the reference variation- The reference variation can be selected
between 0 and 1. The larger the reference variation is, the data of the Macromedia
Hash moving picture is reduced by the fact the larger the number of frames to be
deleted. Otherwise, as the reference variation is nearer to 0, the number of frames to
be deleted becomes reduced.
On the other hand, as a result of comparing variation of the motion characters
between the continuous frames with the reference variation, non-deleted frames are
registered and then can be deleted selectively at regular intervals (s40). At the
beginning, it is preferred not to delete the between frames in a process of transforming
the Macromedia Hash moving picture to the wireless data. However, a size of the
Macromedia Hash moving picture can be reduced by deleting at regular intervals, for
example every n-th frames within the between frame list. The intervals can be
controlled by a user's selection.
Remain tags and data not being deleted within the between frame list will be
stored, and then be used as wireless data (s42). Otherwise, when an input tag is not a
ShowFrame tag, it examines whether the input tag is a Definition tag that defines shape,
bitmap, sprite, sound, button and font (sl8). When an input tag is not a Definition tag,
the WAP server or WAP gateway stores the input tag considering that not to be
transformed or deleted any more (s42). When an input tag is a Definition tag, it
examines whether the input tag is a useless tag like a background tag in a process of
transmitting wireless data. If so, it deletes the input tag (s26). If the input tag is not
able to be deleted, it examines whether the input tag is a shape tag (s28). When an
input tag is a shape tag, the WAP server or WAP gateway transforms the curve data to
the straight-line data, combines the plurality of straight-line data, optimizes the shape
data (s32), and then stores the tag and tag data (s42).
When an input tag is not a shape tag but a button tag, the WAP server or WAP
gateway changes mouse events to wireless events that can be accomplished by input
buttons of the wireless terminal (s34). The process of changing events for the wireless
terminal is described above.
On the other hand, after reducing data size of the moving picture based upon
vector graphic and transforming the data to wireless data suitable for the wireless
terminals, the WAP server or WAP gateway may transform the wireless data so as to be
suitable for each kind of wireless terminals by an on-line transformation.
FIG. 9 is a flow chart for describing an on-line transformation process of
transforming wireless data so as to be suitable for each kind of the wireless terminals in
a method for processing moving picture data based upon vector graphic in accordance
with preferred embodiment of the present invention.
Referring to HG. 9, a WAP gateway collects kind information of wireless
terminals playing the Macromedia Hash moving picture (s60). Kinds of wireless
terminals can be generally classified by a screen size, pixel information displayed in the
screen and sound information. It takes examples, Nokia, Motorola, SK telecom,
Samsung, LG, Hyundai, NTT Docomo and so forth, as representative manufacturing
companies of the wireless terminals playing the moving picture. There are diverse
kinds of the wireless terminals produced by the above manufacturing companies. The
wireless terminals also have diverse performances for processing data-
For example, one wireless terminal called 'iBook' made in the LG Electronics
has a screen with 128x128 pixels and it can display four colors (black, dark gray, bright
gray and white) in each pixel- Also, sound is output signal generated by a speaker that
use buzzes and a CODEC called QCELP.
In above case, when bitmap information of trae color exists in the Macromedia
Hash moving picture, it must be changed to a bitmap composed of just 4 colors. Thus,
the bitmap information can be displayed in the wireless terminal. As it were, a number
of colors constituting a shape tag are reduced and transformed according to the number
of colors of the wireless terminal. Generally, 24 bit trae colors are transformed to 4
grays, 256 colors or 4,096 colors. Moreover, when an image size of the wireless data
transformed by the off-line transformation is larger than 128 x 128, the data may not be
displayed in a screen. Thus, the image size must be transformed so as to be suitable
for the screen size of the wireless terminal. Also, since a user cannot listen sound with
a wireless terminal when the sound in the Macromedia Hash moving picture is defined
as MP3, the MP3 sound data must be transformed by QCELP transcodec. The sound
information will be different in accordance with kinds of the hardwares of the wireless
terminals. Also, when the wireless terminal does not supply a font like Time new
Roman, the font information is decomposed and transformed to shape information, and
then the shape information is displayed in a screen.
If information of wireless terminals is collected for processing the Macromedia
Hash moving picture, the WAP gateway or wireless terminal receives a tag or inner data
of the tag within the wireless data that have been transformed by off-line transformation
(s62). It examines whether an input tag is a tagEnd (s64). When the input tag is a
tagEnd, header information is modified in accordance with the on-line transformation of
the Macromedia Hash moving picture and a result of the on-line transformation
(ON_CNVT) is registered in a version field of the header information (s66). If it is not
a tagEnd, it examines whether the input tag is a Definition tag (s68). When the input
tag is not a Definition tag, the input tag may not need the on-line transformation. Thus,
a new input tag is provided (s62). When the input tag is a Definition tag, it examines
whether the input tag is a shape tag defining shapes (s70), a font tag defining fonts (s74),
a bitmap tag defining bitmaps (s78) or a sound tag defining sounds (s82). When the
Definition tag is not a shape tag, font tag, bitmap tag and sound tag, a new tag is
provided since the on-line transformation is not necessary.
When the input tag is a shape tag, the WAP gateway or wireless terminal
transforms the color information of the shape tag so as to be processed in the wireless
terminal (s72). When the input tag is a font tag, it determines whether the font tag
conesponds to a font of the wireless terminal. If the font of the font tag exists in the
wireless terminal, the WAP gateway or wireless terminal uses the font tag as it is. If
not, it discomposes the font information and then transforms the font information to
shape information (s76). When the input tag is a bitmap tag, the WAP gateway or
wireless terminal transforms all the pixel information of the bitmap tag so as to be
displayed in the wireless terminal (s80). When the input tag is a sound tag, it
transforms the sound tag so as to be utilized in the wireless terminal (s84). The above
transformations are performed recursively until the input tag is equivalent to the tagEnd.
Although the Macromedia Hash as an application for processing moving
picture based upon vector graphic has been described as an example, it is apparent that
the above method of the present invention can be applied to all the applications
handling the moving pictures based upon vector graphic. For the moving pictures
based upon vector graphic using Bezier curves for image processing, the above method
of transforming the curve data to the straight-line data can be applied in the same way.
Moreover, a method of transforming the mouse events of the moving pictures to the
button events of the wireless terminals is applied to all the moving picture in the same
way. Moreover, wireless data can be effectively delivered by selecting and deleting
useless elements in the wireless data delivery or wireless terminals, and by transforming
selected elements so as to be suitable for wireless data delivery and wireless terminals.
In the method of transforming the Macromedia Hash moving picture, the off¬
line transformation in the wireless delivery of the Macromedia Hash moving picture is
accomplished in the web server or WAP gateway, and the on-line transformation
according to the kinds of the wireless terminals is accomplished in the WAP gateway or
wireless terminals-
HG. 10 illustrates a schematic diagram of a system of processing moving
picture data based upon vector graphic in accordance with one preferred embodiment of
the present invention.
Refening to HG. 10, the system of processing the moving picture based upon
vector graphic of the present invention includes a web server 110 for generating and
processing the moving pictures based upon vector graphic like the Macromedia Flash
moving picture, a wireless terminal 130 for acting as a client and a WAP gateway 120
for transforming data between the web server 110 and wireless terminal 130. The web
server 110 may include an off-line transformer 114 for transforming the Macromedia
Hash moving picture based upon vector graphic so as to be suitable for wireless data
delivery. Also, the wireless terminal 130 may include an on-line transformer 134 for
transforming the wireless data, which are transformed so as to be suitable for wireless
data delivery by the off-line transformer 114 of the Macromedia Hash moving picture,
to specific elements according to the kinds of the wireless terminals 130. The WAP
gateway 120 may include an on/off-line transformer that performs on-line
transformation for transforming the Macromedia Hash moving pictures so as to be
suitable for the wireless data delivery and off-line transformation for transforming the
Macromedia Hash moving pictures having passed through the off-line transformation so
as to be suitable for the kinds of the wireless terminals 130.
The web server 110 stores the Macromedia Hash moving pictures made by
Macromedia Hash moving picture generator in the contents server 116. The off-line
transformer 114 transforms the Macromedia Hash moving picture stored in the contents
server so as to be suitable for a wireless data delivery through the off-line
transformation. As it were, the web server 116 deletes tag data, which are not required
for a wireless data delivery, from the Macromedia Hash moving picture and transforms
the specific tag data so as to be suitable for the wireless data delivery through the
method as described in HG. 8. The Macromedia Hash moving picture transformed
through the off-line transformation will be stored in the contents server 116 with
registering in the header whether the transformation is accomplished. The web server
116 transmits the Macromedia Flash moving picture, which have been performed the
off-line transformation, to the WAP gateway 120 using a protocol device for a wire
communication 112 such as a HTTP communication device.
The WAP gateway 120 can ascertain whether the off-line transformation is
accomplished using version information in the header of the Macromedia Hash moving
picture transmitted from the web server 110. When the off-line transformation has not
been accomplished, the on/off-line transformer 124 of the Macromedia Hash moving
picture in the WAP gateway 120 may perform the off-line transformation so as to be
suitable for the wireless data delivery. When the off-line transformation has been
accomplished, the on/off-line transformer 124 may perform the on-line transformation
according to the kind of the wireless terminal. The off-line or on-line transformation
having been accomplished, the WAP gateway 120 transmits the Macromedia Hash
moving picture, that have been through the off-line or on-line transformation, to the
wireless terminal 130 through the protocol transformer for a wire/wireless
communication 122.
The wireless terminal 130 receives the Macromedia Hash moving picture
transmitted from the WAP gateway 120 through the protocol device for a wireless
communication 132. Then, it selects the version information from the header of the
Macromedia Hash moving picture and confirms whether the off-line or on-line
transformation is accomplished- When the Macromedia Hash moving picture has
been just through the off-line transformation, the wireless terminal 130 performs the on¬
line transformation so as to be suitable for the kind of the wireless terminal 130 through
the on-line transformer 134 of the Macromedia Hash moving picture. When the
Macromedia Hash moving picture has been through the on-line transformation by the
on-line transformer 134 or has been transmitted with on-line transformed, the
Macromedia Hash moving picture will be displayed in the display 130 through the
WAP browser 136.
On the other hand, a user of the wireless terminal 130 can control the motion of
the Macromedia Hash moving picture with an input/output device (it is not described in
figures) attached to the wireless terminal 130. When a user inputs a command to the
wireless terminal 130, the command is transmitted to the WAP gateway 120 through the
protocol device for a wireless communication 132, and then transmitted to the web
server 110 through the protocol device for a wire/wireless communication 122 of the
WAP gateway 120. The web server 110 selects the Macromedia Hash moving picture
from the contents server 116 according to a user's command. The selected
Macromedia Hash moving picture will pass through processes of the off-line and on¬
line transformations sequentially through the web server 110, WAP gateway 120 and
wireless terminal 130. Therefore, the user of the wireless terminal 130 can receive
desired Macromedia Hash moving picture using the wireless terminal 130 by requesting
to the web server 110.
HG. 11 is a flow chart for describing a process of treating the Macromedia
Hash moving picture in the web server in a method for processing moving picture based
upon vector graphic in accordance with preferred embodiment of the present invention.
Referring to FIG. 11, the web server selects a Macromedia Hash moving
picture to be transmitted to a wireless terminal from a contents server (slOO). Then,
the web server determines whether it transforms the Macromedia Hash moving picture
so as to be suitable for the wireless terminal or not (sl02). If the off-line
transformation has been completed, the off-line transformation is needless to be
performed. When the off-line transformation is not completed, the web server detects
header information of the Macromedia Hash moving picture (sl04), and then
transforms the Macromedia Hash moving picture to wireless data through the off-line
transformation as described in HG. 8 (sl06). For the Macromedia Hash moving
picture having completed the off-line transformation, the version information indicating
the completion of the off-line transformation is registered in the header information
(sl08). The web server modifies the size or frame number of the Macromedia Flash
moving picture having been transformed together with the version information and
stores the Macromedia Hash moving picture in the contents server (si 10). If there is
an additional Macromedia Hash moving picture to be transformed, the process as
described in HG. 11 is performed for the Macromedia Hash moving picture repeatedly.
If not, all the processes are terminated- When a user requests specific Macromedia
Hash moving picture, the web server detects the Macromedia Hash moving picture
having done the off-line transformation from the contents server and then transmits the
Macromedia Hash moving picture to the WAP gateway. If the Macromedia Flash
moving picture has not gone through the off-line transformation in the web server, the
off-line transformation of the Macromedia Hash moving picture can be accomplished in
the WAP gateway-
HG. 12 is a flow chart for describing a process of treating the Macromedia
Hash moving picture in the WAP gateway in a method for processing moving picture
based upon vector graphic in accordance with preferred embodiment of the present
invention.
Referring to HG. 12, the WAP gateway receives the Macromedia Hash moving
picture using a wire protocol such as a HTTP (sl30). Then, the WAP gateway selects
header information of the Macromedia Flash moving picture (sl32) and determines
whether it has done the off-line transformation using version information (sl34).
When the off-line transformation has not been done in the web server, the off-line
transformation as described in HG. 8 is accomplished (sl36). Otherwise, when the
off-line transformation has been done in the web server, the WAP gateway selects a kind
of the wireless terminal for on-line transformation suitable for the wireless terminal
(sl38). The kind of the wireless terminal may be decided by hardware restrictions
such as a size of output screen, color limitation of output device, supply device of sound,
etc. Based upon the hardware restrictions, it determines whether the kind of the
wireless terminal can supply the Macromedia Hash moving picture having done the off¬
line transformation (sl40). When the kind of the wireless terminal fully supplies the
Macromedia Hash moving picture having done the off-line transformation, the WAP
gateway modifies the version information within the header of the Macromedia Hash
moving picture to a completion state of the on-line transformation (ON_CNVT) (sl44).
Then, it transmits the Macromedia Hash moving picture to the wireless terminal (sl36).
On the other hand, when the kind of the wireless terminal does not supply the
Macromedia Hash moving picture having done the off-line transformation, the WAP
gateway performs the on-line transformation as described in HG. 9 (sl42) and then
modifies the header information according to the size of the Macromedia Hash moving
picture having done the on-line transformation (sl44). The version information that
indicates the result of the on-line transformation will be modified together. The WAP
gateway transmits the Macromedia Flash moving picture having done the on-line
transformation to the user's wireless terminal (sl46). The cost of delivering the
Macromedia Hash moving picture may be demanded to the user.
HG- 13 is a flow chart for describing a process of treating the Macromedia
Hash moving picture in a user's wireless terminal in a method for processing moving
picture based upon vector graphic in accordance with preferred embodiment of the
present invention.
Referring to HG. 13, the user's wireless terminal receives the Macromedia
Hash moving picture transmitted from the WAP gateway (sl60)- The wireless
terminal detects the header information of the Macromedia Hash moving picture for
ascertaining whether the received Macromedia Hash moving picture has done the on¬
line transformation in the WAP gateway (sl62). When the version information is not
ON CNVT, the wireless terminal performs the on-line transformation for the
Macromedia Hash moving picture as described in HG- 9 by considering that the
Macromedia Hash moving picture is not to be supplied from the wireless terminal
(sl66). Otherwise, when the version information describes on-line transformation, the
wireless terminal performs a parsing operation that inteφrets sentences of the
Macromedia Hash moving picture since the wireless terminal supplies the Macromedia
Hash moving picture (sl68). Completing the parsing operation of the Macromedia
Hash moving picture, the wireless terminal performs a rendering operation so as to be
suitable for a display of the wireless terminal (sl70). Then, the wireless terminal
examines whether the Macromedia Flash moving picture waits for the user's input
(sl72) and progresses a step of input processing (sl74). Mouse and keyboard inputs of
the Macromedia Hash moving picture, which has not done the off-line transformation in
the input process, are transformed to inputs based upon buttons of the wireless terminal.
When the input is terminated or it is not a waiting state, the wireless terminal completes
the rendering process for the current frame of the Macromedia Hash moving picture
(sl76). When the user inputs a stop button, the wireless terminal terminates the output
process of the Macromedia Hash moving picture- Otherwise, as long as the user does
not input the stop button, the rendering process will be repeated for successive frames of
the Macromedia Hash moving picture.
Industrial Applicability
As described above, depending on a method for processing moving picture
based upon vector graphic of the present invention, the moving picture data for wireless
communication can be reduced by deleting useless elements and by transforming each
element so as to be suitable for wireless data processing.
Moreover, the method for processing moving picture based upon vector graphic
of the present invention can reduce data size of the moving picture to be transmitted in a
wireless communication by transforming curve data constituting the moving picture
based upon vector graphic to straight-line data and then by combining them.
Moreover, the method for processing the moving picture based upon vector
graphic of the present invention can easily display the moving picture in a wireless
terminal by transforming the moving picture based upon vector graphic according to the
kind of the hardware of the wireless terminal.
Moreover, the method for processing moving picture based upon vector graphic
of the present invention can efficiently treat the moving picture in the wireless terminal
by transforming mouse and keyboard events of the moving picture to button events of
the wireless terminal.
Although the method and system for processing moving picture based upon
vector graphic of the present invention has been described in detail in terms of various
embodiments, it is not intended that the present invention be limited to these
embodiments- Various modification and change within the spirit of the invention will
be apparent to those skilled in the art-