Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M1/00—Substation equipment, e.g. for use by subscribers
  • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
  • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
  • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
  • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
  • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
  • H04L51/10—Multimedia information
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
  • H04L51/58—Message adaptation for wireless communication
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/41—Structure of client; Structure of client peripherals
  • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
  • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/854—Content authoring
  • H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
  • H04W4/12—Messaging; Mailboxes; Announcements

Definitions

• the present invention relates to a multimedia message processing technology, and in particular, to a multimedia message editing method and apparatus. Background technique
• MMS sets a combination of text, pictures, audio, and video, and is a very popular application.
• MMS brings together media files of different natures through Synchronized Multimedia Integration Language (SMIL). Similar to Microsoft PowerPoint, MMS creates multimedia texts for each slide with text, pictures and music.
• SMIL Synchronized Multimedia Integration Language
• MMS editing is done in the MMS editor, which converts the user's editing actions into SMIL for storage and then previews them.
• the SMIL language is generally divided into two parts: head and body.
• the MMIL corresponding to the SMIL file shown below contains three slides, each of which is a picture, a video, and an audio file, and each page contains text information.
• the Head section mainly lists the page size, the elements contained in the page, and the display length, width and display position of each element.
• the Body part mainly includes the time when the page is played, the index of the elements in the page, and the corresponding elements. The position shown in the head.
• An example of a SMIL file is as follows:
• the ID of the used resource is marked in the SMIL, and the corresponding resource can be found by the ID and displayed according to the description in the SMIL.
• the SMIL file can also contain the dur attribute, the begin and end attributes, the clip-begin and clip-end attributes, etc., which are used to describe the playback properties of the media file in more detail.
• the SMIL language is similar to the text markup language (HTML, Hypertext Markup Language) language used in web pages.
• HTML Text Markup Language
• Existing web pages support adding tags to the browsing interface, but the existing MMS editor does not support this feature.
• the playback and editing of existing MMS messages are separated. In the preview process, if the user thinks that the picture or video position is unreasonable and the size is not suitable, it cannot be directly adjusted. If the editing and playback can be combined, it will be very Good to achieve the "what you see is what you get” effect. Summary of the invention
• the technical problem to be solved by the present invention is to provide a multimedia message editing method and apparatus for solving the problem that the MMS content cannot be edited and modified during the existing MMS preview process, and the content cannot be manually drawn in the preview interface.
• the present invention provides a multimedia message editing method, including: according to a user's operation on a multimedia message content, describing the content of the processed multimedia message in a synchronous multimedia integrated language SMIL; when a preview is required, according to a SMIL pair
• the MMS content is played, and further includes: when previewing the MMS content, editing the MMS content in a preview mode, and modifying and saving the SMIL.
• the editing the content of the MMS in the preview mode comprises: adjusting a position, a size, or a time period of the media element, and drawing the content of the MMS in the preview mode.
• the user In the process of adjusting the first media element, if the partial or all coordinate points of the first media element are included in the range of the second media element, the user is prompted, and if the user confirms the overlay, the first media element covers the second media element. , if the user selects no, the first media element is restored to the original position; or
• the location of the second media element and the location of the first media element are swapped.
• the size of the media element is adjusted to
• the media elements are stretched or shrunk and the media elements are backed up.
• the time period of the media element is adjusted to
• the time period corresponding to the media element is displayed, and the media element time period is adjusted by the start and end time of the media element.
• the MMS content is drawn in the preview mode, and the drawn graphic or the mark is combined with the original graphic into a picture and saved to the file system. And generate a new file ID; or
• the mark includes a tip type, a tip color, an eraser, and an undo, and is used to control the type and color of the mark.
• the present invention also provides a multimedia message editing apparatus, including
• a MMS editing module configured to describe, according to a user operation of the MMS content, the content of the processed multimedia message in a synchronous multimedia integration language SMIL;
• the MMS content includes a media element;
• a preview module configured to play the MMS according to SMIL when a preview is needed
• a preview editing module configured to edit the MMS content in a preview mode when previewing the MMS, and modify the SMIL save.
• the preview editing module is configured to edit the MMS in a preview mode
• the preview editing module is configured to adjust a position, a size, or a time period of the media element, and draw the MMS content in the preview mode.
• the preview template is used to draw the multimedia message in a preview mode, including
• the nib control is used to provide the user with a nib type and a nib color selection in the preview interface, so that the user can use different thickness or different color handwriting;
• Figure 1 is a structural view of a first embodiment of the present invention
• Figure 2 is a flow chart of a second embodiment of the present invention.
• FIG. 3 is a schematic diagram of the MMS media element adjustment in the second embodiment of the present invention.
• 4-1 and 4-2 are schematic diagrams showing positions of adjusting media elements in Embodiment 2 of the present invention.
• FIG. 5 is a schematic diagram showing the size of an adjusted media element in a second embodiment of the present invention.
• FIG. 6 is a schematic diagram of a period of adjusting media elements in a second embodiment of the present invention.
• Figure 7 is a schematic illustration of a manually drawn graphic or indicia in a second embodiment of the present invention. detailed description
• FIG. 1 it is a structural diagram of a first embodiment of the present invention, and provides a multimedia message editing apparatus, including
• the MMS editing module 101 is configured to describe, according to a user operation of the MMS content, the content of the MMS message, such as a media element location, a media element ID, and the like, in the form of a SMIL file; the MMS content is composed of media elements, and the media
• the attributes of the element include media element location, media element size, media element time period, and the like;
• the preview module 102 plays the multimedia message according to the SMIL when the preview is needed;
• the preview editing module 103 edits the MMS in the preview mode when previewing the MMS, and saves the SMIL after modification.
• editing the MMS in the preview mode includes adjusting a position, a size, or a time period of the media element, and drawing by the user;
• the progress bar is displayed on the preview interface, and the playback period of the audio and video can be adjusted by pulling the start and end positions.
• the adjustment methods include stretching, shrinking, and so on.
• the mobile phone After the user confirms the saving, the mobile phone searches for the corresponding resource information from the SMIL file according to the modified media element ID, and according to the current location, size or time of the file, etc.
• the attribute value of the SMIL file is changed.
• the user In the full-screen preview state of MMS, the user is allowed to manually draw or sketch the content, such as drawing out key words in the slide, circle, and so on.
• the preview editing module further includes
• the nib control is used to provide the user with a selection control of the nib type and the nib color in the preview interface, so that the user can use different thickness or different color handwriting.
• FIG. 2 it is a flowchart of a second embodiment of the present invention, and provides a method for editing a multimedia message preview, including,
• Step S201 according to the user's operation on the content of the MMS, the content of the MMS after the operation is as The media element location, the media element ID, and the like are described in the form of a SMIL file;
• the MMS content is composed of media elements, specifically including page information of the MMS, page multimedia information, and page layout information;
• Step S202 When the preview is required, the MMS is played according to the SMIL; Step S203: When previewing the MMS, the MMS is edited in the preview mode, and the SMIL is modified and saved.
• the editing the MMS in the preview mode includes adjusting a position, a size or a time period of the media element, and drawing by the user;
• FIG. 3 it is a prior view of the multimedia message element adjustment according to the second embodiment of the present invention.
• the multimedia message includes an audio file, a picture and text information, and the multimedia message is played according to a format preset by the terminal.
• 4-1 and 4-2 are schematic diagrams of adjusting the position of a media element in Embodiment 2 of the present invention, including scenario 1 and scenario 2, where
• scenario 1 as shown in Figure 4-1, long press the picture to pull the picture from position to position 2.
• the image covers the text, that is, the partial or all coordinate points of the image are included in the range of the text information
• the user is prompted.
• the image overlays the text; when the user selects No, the image is restored back to the original location, or the interface is changed to the interface shown in scenario 2.
• the user chooses to save, and the SMIL file of the MMS is updated.
• the SMIL file mentioned in the background as an example, in the case of the scenario 1, the layout in the SMIL file is modified as follows:
• the coordinates of the upper left corner of the picture are (0, 0) and the size is (120*200). (The original size is 240*400. Since the fit is meet, the length and width are scaled to half of the size according to the page size, but the aspect ratio is No change), the coordinates of the upper left corner of the text message are (0, 200).
• Pull the picture pull the picture to the coordinate point (60, 100), and some areas of the picture cover the text information.
• the terminal prompts the user whether to overwrite. If Yes is selected, the text and the picture are overlapped. If No is selected, the picture is restored to the initial position, or the picture is placed to a new position, and the text is changed. As shown in the second scene, the position of the text information and the position of the picture are exchanged.
• FIG. 5 it is a schematic diagram of adjusting the size of a media element in the second embodiment of the present invention, including: pulling an edge or four angles of a picture, and stretching or reducing the size of the picture.
• the original width is doubled, and the size of the picture is changed from the original 120*200 to 240*200.
• the layout of the original SMIL file is changed to Under the mouth:
• the Image property in its SMIL file is modified to hidden after the size of the image is changed.
• Hidden means to keep the size of the multimedia clip unchanged, starting from the upper left corner of the window. If the size of the multimedia clip is smaller than the size of the window, the blank space will be filled with the background color; if the multimedia clip size is larger than the size of the window, then the multimedia The clip is cut out of the window and is not displayed.
• the size of the backup file is the modified size (here 240*200)
• the corresponding ID of the modified SMIL file is the modified ID (for example, the modification is 11313510998 ( 1))
• the changes in the Body part of the original SMIL file related to the picture are:
• FIG. 6 it is a schematic diagram of adjusting a media element time period in the second embodiment of the present invention, including: when a multimedia message enters an edit mode, displaying a time period corresponding to the multimedia audio, and the user can adjust the start and end time of the audio to the MMS audio. The time period is adjusted. If the time period starts from 2s of the audio and ends at 4s, the audio related attributes in SMIL are modified to:
• FIG. 7 it is a schematic diagram of manually drawing a graphic or a mark in the second embodiment of the present invention, including:
• Method 1 Combine the drawn graphic or mark with the original graphic into a picture, save to the text In the system, and generate a new file ID.
• the new graphic ID is Image_new
• the Head portion is modified to:
• the height is modified to 100% here, so that the image can cover the entire screen, and the fit is selected as Hidden, so that the image can be displayed in the original size.
• Method 2 Define a new element type, such as setting the element type to "Mark”, adding a mark and drawing a graphic on the interface, adding a corresponding resource ID and related attributes in the original SMIL file, wherein the ID is automatically generated by the system, and Save the corresponding image to the file system.
• a new element type such as setting the element type to "Mark”
• adding a mark and drawing a graphic on the interface adding a corresponding resource ID and related attributes in the original SMIL file, wherein the ID is automatically generated by the system, and Save the corresponding image to the file system.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Computer Networks & Wireless Communication (AREA)
• Multimedia (AREA)
• Computer Security & Cryptography (AREA)
• General Engineering & Computer Science (AREA)
• Business, Economics & Management (AREA)
• General Business, Economics & Management (AREA)
• Human Computer Interaction (AREA)
• User Interface Of Digital Computer (AREA)
• Document Processing Apparatus (AREA)
• Processing Or Creating Images (AREA)
• Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
• Editing Of Facsimile Originals (AREA)

Priority Applications (3)

Applications Claiming Priority (2)

Publications (1)

Family

ID=45826330

Family Applications (1)

Country Status (5)

Cited By (1)

Families Citing this family (10)

Citations (4)

Family Cites Families (20)

• 2011
  • 2011-10-08 CN CN201110299933.1A patent/CN102387481B/zh not_active Expired - Fee Related
• 2012
  • 2012-01-19 US US14/349,886 patent/US20140248857A1/en not_active Abandoned
  • 2012-01-19 EP EP12782054.6A patent/EP2755409B1/en active Active
  • 2012-01-19 WO PCT/CN2012/070622 patent/WO2012152089A1/zh not_active Ceased
  • 2012-01-19 JP JP2014533756A patent/JP6031110B2/ja not_active Expired - Fee Related
• 2016
  • 2016-05-06 JP JP2016093176A patent/JP2016184411A/ja not_active Withdrawn

Patent Citations (4)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events