WO2009071112A1 - Media embedded in mobile messaging - Google Patents

Media embedded in mobile messaging Download PDF

Info

Publication number
WO2009071112A1
WO2009071112A1 PCT/EP2007/011035 EP2007011035W WO2009071112A1 WO 2009071112 A1 WO2009071112 A1 WO 2009071112A1 EP 2007011035 W EP2007011035 W EP 2007011035W WO 2009071112 A1 WO2009071112 A1 WO 2009071112A1
Authority
WO
WIPO (PCT)
Prior art keywords
media content
media
display
sub area
recorder
Prior art date
Application number
PCT/EP2007/011035
Other languages
French (fr)
Inventor
Mikko A. Nurmi
Original Assignee
Nokia Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Corporation filed Critical Nokia Corporation
Publication of WO2009071112A1 publication Critical patent/WO2009071112A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations

Definitions

  • the present invention relates to mobile messaging. More particularly, the present invention relates to a method and a device for adding media content in a mobile messaging application.
  • Communication devices of today often include at least one media recorder with a corresponding media recorder application, as well as a multimedia messaging application.
  • This allows users to create messages like for instance e-mails, instant messages, short messages (SMS) or multimedia messages (MMS) to send to other users, and other messages for publishing onto forums on Internet sites, blogs etc. that contain both media content and text.
  • multimedia messaging is not as frequently used as could be expected.
  • studies have listed other reasons for this. Users may see no need to send multimedia messages via mobile devices as shown by Kasesniemi et.al, VTT Research Notes 2204, Espoo, 2003, pp. 42 - 47.
  • users are not that well aware of the features it provides.
  • the user may find the procedure to create and send an MMS to complicated to start utilizing the service.
  • S60 a user that has a mobile phone with a camera can start writing a message in a messaging application, take a picture, and then send the message and the attached recorded image. This is typically accomplished by during creation of a message selecting, in a menu, a command like "new image" which activates a camera application to launch and the user is then able to take an image which is attached to the message.
  • the user activates the camera and sends an image as an MMS.
  • media content of a media recorder is displayed on the messaging application display and said media content is also made accessible for embedding into the current message window which makes it convenient for a user to, while creating a message, add multimedia content into a message without having to enter complex menus or to activate additional applications or devices to first record and then add the media content.
  • the media content provided by the media recorder is live media content.
  • the live media content is displayed in the display sub area and the user is thus incited to add the current media content into the message being created.
  • the messaging experience for the user will take upon a new dimension as ad-hoc creation of messages with added media content will increase the desire to share an ongoing event with other message application users. In turn this will also have a positive effect for telecommunication operators since adding of multimedia content in messages will generate more average revenue per user (ARPU) because of an increasing data traffic.
  • the media content provided by the media recorder is stored media content. The stored media content has previously been provided by the media recorder.
  • This provides the possibility to let, for instance, the most recently recorded media content provided by the media recorder to be displayed on the messaging application display. The user is then reminded of an event which he or she might want to share with a fellow message application user, which event the user can include in a message being created in the straight forward way provided by method of the present invention.
  • the stored media content may also have been previously downloaded from an external source.
  • the step of embedding the media content further comprises the step of generating the media content by recording current live media content.
  • the user records the media content and embeds the media content into a current message being created.
  • the method further comprises storing the recorded media content, which is convenient for later use of the recorded media content.
  • the method further comprises determining said display sub area on the messaging application display.
  • the display sub area in which the media content provided by the media recorder is displayed is user customized, such that the positioning, the size, the shape etc. is chosen to suite the user's preferences.
  • the determined display sub area further acts like a predetermined sub area for the embedded media content.
  • the step of determining the display sub area is preformed by one of:
  • the determination of the display sub area is done by retrieving a predetermined sub area stored in a memory device, database or the like in which case the user does not have to make a sub area choice for each message being created, but the sub area is preset.
  • An alternative way of determining the sub area is done by letting the user choose the display sub area by selecting a template sub area from a set of template sub areas, which allows the user to select from a number of templates such that each message is specially customized for its purpose.
  • Another alternative way of determining the display sub area is provided in which the user draws the sub area onto the display, and the user is thus allowed to design the message in a creative and convenient way.
  • the message being written may then be created in a chronological way, where the user writes down a sub message, draws a sub area for displaying media content provided by the media recorder, adds the desired media content in the correct position of the message, and then continues to write a new sub message, draws a new sub area for displaying media content, adds new media content etc.
  • the user is allowed to compose the message, and also decide the size and position of any added media content object, e.g. an image or symbol.
  • the predetermined sub area may be located on a messaging tool bar.
  • the step of enabling the media recorder is done by automatically enabling the media recorder when creating a new message such that the media content provided by the media recorder is automatically accessible for the user.
  • the media recorder is enabled by detecting one of the pressing of a software button, the picking from a list and the pressing of a hardware button.
  • Another alternative way of enabling the media recorder is by opening a media recorder protection cover such that the user who is creating a message and desires to add media content provided by the media recorder may easily display the media content provided by the media recorder.
  • Enabling the media recorder may alternatively be done by using a barcode reader, and by determining a sub area. As described above, in this embodiment, the user thus actively enables the media recorder in a convenient one step operation.
  • the input comprises of one of pressing a hardware button, and pressing a software button.
  • a device comprising: a media recorder unit, a storage unit, which is configured to store media content, a processor unit, which is configured to run a messaging application, and a user interface comprising a display and a user input element for receiving user input.
  • the display is configured to display a message window for the messaging application.
  • the processor unit under instruction from a media content manager application, is further configured to
  • the media content provided by the media recorder may be live or stored media content, or a combination of live and stored media.
  • a device for multimedia messaging with enhanced usability for the user which in a simple way may record and add media content in messages.
  • the invention is based on an insight that displaying media content from a media recorder directly in a messaging application window, and allowing a user to in an intuitive way add the displayed media content into the current message, the embedding of multimedia content in a message is facilitated and multimedia messaging is improved in a user-oriented way.
  • FIG. 1 is a schematic block diagram of an embodiment of the device according to the present invention.
  • Fig. 2 is a schematic flow chart of an embodiment of the method according to the present invention.
  • Fig. 3 a) and b) depict schematic illustrations of a message window according to embodiments of the method and device according to the present invention
  • Fig. 4 a) and b) depict schematic illustrations of a message window according to embodiments of the method and device according to the present invention
  • Fig. 5 depicts a schematic illustration of a message window according to embodiments of the method and device according to the present invention
  • Fig. 6 depicts a schematic illustration of a message window according to embodiments of the method and device according to the present invention.
  • the device 100 may be a mobile phone, a handheld computer or any other suitable mobile device.
  • the device 100 comprises a media recorder 110, a storage element 130, a processor unit 120, and a user interface 140.
  • the device 100 is realised as a mobile phone which has been equipped with a camera as media recorder 110.
  • the user interface 140 of the device 100 comprises a display element 141 , and a user input 142.
  • the display element 141 is realized with an LCD-display.
  • the user input 142 is realised with a key table.
  • the display element 141 and user input 142 are realised with a touch screen display, or a touch screen display in combination with a key table and/or a pointing device, and/or touch pad.
  • the user interface 140 further comprises a second user input 143 which is a media recorder button.
  • the media recorder button 143 is realised as a hardware button or a software button and is typically the shutter release button of the camera, a record button of a video camera or sound recorder etc. depending on what media recorder is utilized in the mobile device 100.
  • the storage element 130 has a storage area allocated for storing media content provided by the media recorder 110 (as well as for other media content or mobile application related data), and is realised with any suitable conventional memory device available on the open market, e.g. a memory card, a RAM-memory like a flash memory, or a ROM-memory.
  • the processor unit 120 is configured for executing at least a messaging application 121 , a media recorder application 123 and a media content application 122 according to the present invention.
  • the messaging application 121 is one of instant messaging, MMS, chatting, blogging, e-mailing or any type of messaging application, including a messaging editor, that can include images, videos or sound clips.
  • the messaging application 121 may also be a telephone application with multimedia capability.
  • the messaging application 121 is displayed on the LCD-display 141 , and more specifically a messaging application message window 300, see Fig. 3, is displayed as the user starts to create a message.
  • Fig. 3 a) and b) depicts schematic illustrations of a message window 300 according to an embodiment of the device and the method.
  • the message window 300 is displayed on the LCD-display 141 and views a message being created in the messaging application 121.
  • the processor unit 120 under the instructions from a media content application 122, which is based on the principles of the method according to the present invention, is configured to enable the media recorder 110, i.e. the camera 110, and in this embodiment its corresponding media recorder application 123, and to display media content provided from the camera 110 in a sub area 320 of the LCD-display 141.
  • the sub area 320 is located on a messaging toolbar 310.
  • the media content provided from the camera is a live image.
  • the live media content is displayed in combination with pre-recorded media content, such that in the case of displaying a live image from the camera, a part of the sub area can view e.g. the last taken picture or a frequently used image.
  • the processor unit is further configured to receive input from the user via the user interface 142 or the camera button 143, and when receiving input from the user embed the media content of sub area 320 into the message window, see 330 in Fig. 3 b).
  • the media recorder application 123 is integrated in the media content application 122.
  • the media recorder 110 is here realised with a camera, and hence the media content displayed and embedded in the message is an image.
  • media recorder 110 another type of media recorder like a video recorder or a sound recorder may be used as media recorder 110. Then the display sub area 320 displaying the media content provided by the media recorder 110 may display a live video image for the video camera, and a predetermined image or symbol for the sound recorder. The sound recorder media content may also be displayed showing a spectrum analysis of the current live audio being registered by the sound recorder.
  • the video or sound file (live or previously recorded) provided by the media recorder may be associated with a thumbnail of an image or a symbol, which thumbnail is displayed in the sub area 320 of the messaging application display 141 , and further on is embedded into the message being created, such that the message will then include media content which is executed when activating the embedded thumbnail or symbol which is associated with the actual media content object, i.e. the sound or video clip.
  • each current media content associated with a specific media recorder may be shown in separate sub areas of the message window.
  • Fig. 2 is a schematic flow chart illustrating an embodiment of the method according to the first aspect of the present invention. In the following, this embodiment of the method will be described. The method is exemplified as being performed in the device 100 as described above, i.e. a mobile phone equipped with a camera, but should not be restricted to use in merely mobile phones as was previously discussed above.
  • the messaging application 121 is here a multi-media messaging application (MMS).
  • MMS multi-media messaging application
  • Box 200 The messaging application is displayed in the user interface display 141 and, for a new message, a message window 300 is displayed on the display 141 , in which message window 300 the user is allowed to create the content of the message.
  • Box 215 A determination of a sub area of display 141 is performed. This is described in more detail herein under.
  • Box 220 As the camera 110 is enabled media content associated with the camera is displayed on sub area 320 of the display 141.
  • the media content is the actual camera viewfinder image, i.e. live media content, but may however be represented by a previously recorded image.
  • the predetermined choice of media content to provide from the camera is set to "live image" in a configuration file.
  • the predetermined choice can also be set in users settings, or as options in a menu. At least a part of the actual viewfinder image is now shown live on the messaging application display 141.
  • the actual area of the image, which is recorded by the camera 110, that is displayed is determined in advance.
  • a camera setting for showing the complete image in a predetermined sub area 320 is here set to be: scale image to show whole image as a thumbnail 320 on a messaging toolbar 310, see Fig. 3 a).
  • Box 240 The image captured by the camera is then embedded in the sub area 330 of the message window 300.
  • this previously stored media content is embedded in sub area 330 of the message window 300.
  • the embedding of the media content of sub area 320 is done by either pressing the hardware camera button 143 or via a software button 142. This may be realized in a number of ways, for instance by clicking on the sub area 320 with a mouse, or pressing on the sub area or camera icon on a touch screen display.
  • the recorded media content is automatically integrated into sub area 330 of the message window 300.
  • the messaging application 121 is instructed by the user to save or send the message, the embedded captured image is also included in the message.
  • the step of embedding the image into the message will for the live image include recording of the current live image. If a video recorder or a sound recorder is used as media recorder 110, the generation of a video clip or sound clip will extend in time, and a thumbnail image or symbol is preferably associated with the clip. The thumbnail is then embedded in the message window. The recorded media content is stored, temporarily or for later use, in the storage element 130.
  • the display area 320 keeps viewing the live image.
  • the viewfinder media content of a video recorder 110 is displayed in the sub area 320.
  • the recording of media content i.e. shooting a video
  • the video is shot as long as the user holds his or her hand or stylus on the defined software button 142.
  • the just recorded media content i.e. the video just shot, may then be played in the sub area 320 or alternatively in another predefined sub area of the messaging display, to illustrate for the user what kind of video that may be included in the message.
  • the video is played in a repeat mode.
  • the user can easily shoot a video by opening the protection cover (video shooting starts) and stop video recording by simply closing the protection cover of the video camera lens.
  • the live media content is displayed in a sub area 420, which is placed in the message window 300 and when the image is embedded into a message window sub area 430, the live image may be deactivated or the display area 420 is repositioned.
  • the media content provided by the camera 110 and which media content is displayed in the message application window 141 can be set to show previously recorded media content, i.e. in this case images that were recorded previously by the camera or which may have been downloaded or stored onto the device 100. These images are stored in the storage 130.
  • Predetermined sub area settings are stored in a storage on the device 100, such that when enabling the media recorder 110, the settings for the sub area are retrieved from the storage.
  • Typical settings for the sub area are: sub area on a messaging toolbar, coordinates for position and size (x, y, size) etc.
  • the settings are preferably set by the manufacturer. However, resetting the settings in a menu is possible. Selecting a template display sub area from a set of template display sub areas allows the user to select a sub area from a list of templates which are presented in a menu that pops up as the camera is enabled.
  • the presentation may be a list of describing names or thumbnail pictures of the templates.
  • Each template is a pre-selected setup for a display sub area in which for instance size, shape, position is specified.
  • the shape of the sub area can be set to any suitable shape, like for instance diamond-shaped, quadratic, star-shaped, heart-shaped, and circle-shaped.
  • the template sub areas may be integrated in a message template, wherein text areas and image areas are specified. For the text in the message font, size, headers etc. are specified.
  • the sub areas are specified according to size, shape, position, total number etc.
  • Fig. 5 a message template 500 for a messaging application with media content management according to the present invention is illustrated.
  • the message template 500 comprises a header 510, a text area 520, a first display sub area template 530 and a second display sub area template 540.
  • the media recorder 110 When opening a message template as illustrated in Fig. 5 to create a message, the media recorder 110 is enabled, and settings for the message and display sub area for displaying the media content provided from the media recorder are retrieved from the template.
  • the displaying of the media content may be done according to number or having the media content displayed in all visible sub areas in the message window.
  • the user activates a sub area by clicking on it. The media content is then displayed in the currently activated sub area.
  • the display sub area is determined by allowing the user to draw a sub area in a message window.
  • a message window 600 is opened on a display.
  • a tool-pane 620 for drawing a sub area 630 in the message window 600 is automatically launched when a new message window is activated.
  • the tool-pane 620 is provided with a number of template sub area shapes, 621 - 625.
  • the shapes of a diamond, rectangle, a star, a heart and a circle may be chosen from the tool-pane 620.
  • any suitable shape may be used. The user selects a shape with a pointing tool.
  • the user is then allowed to, by using the pointing tool which has a symbol 610 visible on the display, draw the selected shape into the message window 600 to form a display sub area 630.
  • the pointing tool may be realized with a mouse- functionality, a light pen in combination with a touch screen or simply by touching the touch screen with a finger.
  • the media recorder is enabled and media content provided by the media recorder is displayed in the display sub area 630.
  • the media recorder is enabled in an earlier stage, in which case only the displaying of the media content provided by the media recorder takes place. Above the media recorder was enabled as the messaging application was started and a new message was created.
  • the launching of the media recorder may be done by pressing a software button on the display, like a media recorder symbol, or by picking a media recorder option from a list.
  • the user may press a hardware button, e.g. the camera shutter button 143 to enable the camera.
  • a hardware button e.g. the camera shutter button 143 to enable the camera.
  • An other alternative is to enable the media recorder when opening the media recorder protection cover or when using a barcode reader.
  • the predetermined choice is set to "latest recorded image”, “favourite image”, “random image” etc.
  • the types of messages that the present method is suitable for are MMS, IMS, e-mail messages, phone calls with multimedia capabilities, etc. although other suitable present or future types of messages are not excluded.
  • the invention is applicable to Internet based applications or services which will then offer a media content sub area in the application window.
  • a web based Flickr service may display a display sub area that shows a viewfinder of a camera of the mobile device.
  • the Flickr service then activates the mobile device camera using a viewfinder API.
  • Another messaging application suitable for the present method is blogging, i.e. in which application users frequently and chronologically publish personal messages about their thoughts and every day life etc. on the Internet.
  • the current message being created is an ongoing phone call.
  • a user A When a user A receives a call from user B, the telephone application is started, and instantly a message window is activated on the mobile phone display. Furthermore, user A ' s mobile phone camera is activated and a live image is shown in a sub area of the message window. User A then chooses to take a picture and send directly to user B. The picture may be sent as a rejection to the call, which may explain to user B why the call is rejected, e.g. taking an image of a meeting room explains "I'm attending a meeting". Alternatively, the image is shown to user B during an ongoing call.
  • a user has a mobile device which is connectable to a personal computer (PC) by means of e.g. Bluetooth, Wifi, or Wimax.
  • PC personal computer
  • the user is using an e-mail application on the PC.
  • the PC contains hardware and software that is arranged to search and recognize mobile devices that are capable of taking images and recording videos and to receive images from said mobile devices. Thus, the functionality of this hardware and software is to act as a media recorder for the PC.
  • the e-mail application is arranged to periodically check if there is information about imaging capable devices within range of the PC. If the mobile device is detected then a live image from the mobile device shows up on the live image area on the message window of the email application on the PC. The user is allowed to take an image using the mobile camera and the image is automatically attached to the e-mail message being created. Any other messaging application can be used.
  • the PC may also be any other type of messaging device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

This invention relates to a method and a device for adding media content in a mobile messaging application. The method comprises displaying a message window in a mobile device messaging application display and enabling a media recorder comprised within the mobile device. Further, at least a portion of the media content that is provided by the media recorder is displayed in a sub area of the messaging application display. The displayed media content is then, upon receiving input, embedded in the in the message window.

Description

MEDIA EMBEDDED IN MOBILE MESSAGING
FIELD OF THE INVENTION
The present invention relates to mobile messaging. More particularly, the present invention relates to a method and a device for adding media content in a mobile messaging application.
BACKGROUND OF THE INVENTION
Communication devices of today often include at least one media recorder with a corresponding media recorder application, as well as a multimedia messaging application. This allows users to create messages like for instance e-mails, instant messages, short messages (SMS) or multimedia messages (MMS) to send to other users, and other messages for publishing onto forums on Internet sites, blogs etc. that contain both media content and text. However, multimedia messaging is not as frequently used as could be expected. In addition to price and compatibility issues, studies have listed other reasons for this. Users may see no need to send multimedia messages via mobile devices as shown by Kasesniemi et.al, VTT Research Notes 2204, Espoo, 2003, pp. 42 - 47. Furthermore, users are not that well aware of the features it provides. In addition, the user may find the procedure to create and send an MMS to complicated to start utilizing the service. The standard platform S60, 3rd edition, Active Idle, provided by Nokia, provides a dynamic idle state of a phone which allows for shortcuts to be defined for the most commonly used messaging applications. With S60 a user that has a mobile phone with a camera can start writing a message in a messaging application, take a picture, and then send the message and the attached recorded image. This is typically accomplished by during creation of a message selecting, in a menu, a command like "new image" which activates a camera application to launch and the user is then able to take an image which is attached to the message. Alternatively the user activates the camera and sends an image as an MMS. However, these prior art solutions for adding multimedia content to messages typically involve a plurality of steps that requires the user to move through a number of menus to attach multimedia content to a message. Furthermore, the user has little influence on how the image is attached to the message when it comes to, for instance, how large the attached image is and where in the message it is positioned.
SUMMARY It is an object of the present invention to solve or at least alleviate the above-mentioned drawbacks and problems of the prior art as discussed above.
This object is achieved by a method, device and user interface according to the present invention as defined in independent claims 1 , 11 and 19.
In accordance with a first aspect of the present invention, there is provided a method comprising:
- displaying a message window in a mobile device messaging application display, - enabling a media recorder comprised within the mobile device,
- displaying at least a portion of media content provided by the media recorder in a display sub area of the messaging application display, and upon receiving input:
- embedding the media content provided by the media recorder in the message window.
Thus, in accordance with the method of the present invention media content of a media recorder is displayed on the messaging application display and said media content is also made accessible for embedding into the current message window which makes it convenient for a user to, while creating a message, add multimedia content into a message without having to enter complex menus or to activate additional applications or devices to first record and then add the media content.
In accordance with an embodiment of the method, the media content provided by the media recorder is live media content. The live media content is displayed in the display sub area and the user is thus incited to add the current media content into the message being created. The messaging experience for the user will take upon a new dimension as ad-hoc creation of messages with added media content will increase the desire to share an ongoing event with other message application users. In turn this will also have a positive effect for telecommunication operators since adding of multimedia content in messages will generate more average revenue per user (ARPU) because of an increasing data traffic. Further, in accordance with an embodiment of the present method, the media content provided by the media recorder is stored media content. The stored media content has previously been provided by the media recorder. This provides the possibility to let, for instance, the most recently recorded media content provided by the media recorder to be displayed on the messaging application display. The user is then reminded of an event which he or she might want to share with a fellow message application user, which event the user can include in a message being created in the straight forward way provided by method of the present invention. The stored media content may also have been previously downloaded from an external source.
In an embodiment of the method the step of embedding the media content further comprises the step of generating the media content by recording current live media content. Thus, in a simple one step operation the user records the media content and embeds the media content into a current message being created.
In an embodiment the method further comprises storing the recorded media content, which is convenient for later use of the recorded media content.
In accordance with an embodiment of the invention the method further comprises determining said display sub area on the messaging application display. The display sub area in which the media content provided by the media recorder is displayed is user customized, such that the positioning, the size, the shape etc. is chosen to suite the user's preferences. When embedding the media content, the determined display sub area further acts like a predetermined sub area for the embedded media content.
The step of determining the display sub area is preformed by one of:
- retrieving a predetermined sub area;
- receiving external selection input selecting a template display sub area from a set of template display sub areas; and - receiving external input defining a sub area by drawing a sub area into the display.
Thus, there is provided a method in which the determination of the display sub area is done by retrieving a predetermined sub area stored in a memory device, database or the like in which case the user does not have to make a sub area choice for each message being created, but the sub area is preset. An alternative way of determining the sub area is done by letting the user choose the display sub area by selecting a template sub area from a set of template sub areas, which allows the user to select from a number of templates such that each message is specially customized for its purpose. Another alternative way of determining the display sub area is provided in which the user draws the sub area onto the display, and the user is thus allowed to design the message in a creative and convenient way. Additionally, the message being written may then be created in a chronological way, where the user writes down a sub message, draws a sub area for displaying media content provided by the media recorder, adds the desired media content in the correct position of the message, and then continues to write a new sub message, draws a new sub area for displaying media content, adds new media content etc. In this way the user is allowed to compose the message, and also decide the size and position of any added media content object, e.g. an image or symbol.
In an embodiment of the method the predetermined sub area may be located on a messaging tool bar.
In an embodiment of the method the step of enabling the media recorder is done by automatically enabling the media recorder when creating a new message such that the media content provided by the media recorder is automatically accessible for the user. In alternative embodiments the media recorder is enabled by detecting one of the pressing of a software button, the picking from a list and the pressing of a hardware button.
Another alternative way of enabling the media recorder is by opening a media recorder protection cover such that the user who is creating a message and desires to add media content provided by the media recorder may easily display the media content provided by the media recorder. Enabling the media recorder may alternatively be done by using a barcode reader, and by determining a sub area. As described above, in this embodiment, the user thus actively enables the media recorder in a convenient one step operation. In accordance with an embodiment of the method the input comprises of one of pressing a hardware button, and pressing a software button. By allowing the user to use the media recorder button (which may be a hardware or a software button) as the external input, adding of media content is done in an intuitive manner.
According to a second aspect of the present invention, there is provided a device comprising: a media recorder unit, a storage unit, which is configured to store media content, a processor unit, which is configured to run a messaging application, and a user interface comprising a display and a user input element for receiving user input. The display is configured to display a message window for the messaging application. The processor unit, under instruction from a media content manager application, is further configured to
- enable the media recorder, - display at least a portion of media content provided by the media recorder in a display sub area of the display, and
- embed the media content provided by the media recorder in the message window.
The media content provided by the media recorder may be live or stored media content, or a combination of live and stored media. Thus, there is provided a device for multimedia messaging with enhanced usability for the user, which in a simple way may record and add media content in messages. The invention is based on an insight that displaying media content from a media recorder directly in a messaging application window, and allowing a user to in an intuitive way add the displayed media content into the current message, the embedding of multimedia content in a message is facilitated and multimedia messaging is improved in a user-oriented way.
These and other aspects, features, and advantages of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
BRIEF DESCRIPTION OF THE DRAWINGS
Embodiments of the present invention will now be described in more detail, reference being made to the appended drawings, in which: Fig. 1 is a schematic block diagram of an embodiment of the device according to the present invention;
Fig. 2 is a schematic flow chart of an embodiment of the method according to the present invention;
Fig. 3 a) and b) depict schematic illustrations of a message window according to embodiments of the method and device according to the present invention;
Fig. 4 a) and b) depict schematic illustrations of a message window according to embodiments of the method and device according to the present invention; Fig. 5 depicts a schematic illustration of a message window according to embodiments of the method and device according to the present invention; and Fig. 6 depicts a schematic illustration of a message window according to embodiments of the method and device according to the present invention.
DESCRIPTION OF PREFERRED EMBODIMENTS Fig. 1 is a functional block diagram of a device according to an exemplary embodiment of the present invention. The device 100 may be a mobile phone, a handheld computer or any other suitable mobile device. The device 100 comprises a media recorder 110, a storage element 130, a processor unit 120, and a user interface 140. In this non-limiting exemplifying embodiment the device 100 is realised as a mobile phone which has been equipped with a camera as media recorder 110. The user interface 140 of the device 100 comprises a display element 141 , and a user input 142. The display element 141 is realized with an LCD-display. The user input 142 is realised with a key table. In alternative embodiments the display element 141 and user input 142 are realised with a touch screen display, or a touch screen display in combination with a key table and/or a pointing device, and/or touch pad.
In an alternative embodiment the user interface 140 further comprises a second user input 143 which is a media recorder button. The media recorder button 143 is realised as a hardware button or a software button and is typically the shutter release button of the camera, a record button of a video camera or sound recorder etc. depending on what media recorder is utilized in the mobile device 100.
The storage element 130, has a storage area allocated for storing media content provided by the media recorder 110 (as well as for other media content or mobile application related data), and is realised with any suitable conventional memory device available on the open market, e.g. a memory card, a RAM-memory like a flash memory, or a ROM-memory.
The processor unit 120 is configured for executing at least a messaging application 121 , a media recorder application 123 and a media content application 122 according to the present invention.
The messaging application 121 is one of instant messaging, MMS, chatting, blogging, e-mailing or any type of messaging application, including a messaging editor, that can include images, videos or sound clips. The messaging application 121 may also be a telephone application with multimedia capability. When executed the messaging application 121 is displayed on the LCD-display 141 , and more specifically a messaging application message window 300, see Fig. 3, is displayed as the user starts to create a message.
Fig. 3 a) and b) depicts schematic illustrations of a message window 300 according to an embodiment of the device and the method. The message window 300 is displayed on the LCD-display 141 and views a message being created in the messaging application 121. Furthermore, when the user starts to create the message, the processor unit 120, under the instructions from a media content application 122, which is based on the principles of the method according to the present invention, is configured to enable the media recorder 110, i.e. the camera 110, and in this embodiment its corresponding media recorder application 123, and to display media content provided from the camera 110 in a sub area 320 of the LCD-display 141. In Fig. 3a) the sub area 320 is located on a messaging toolbar 310. The media content provided from the camera is a live image. In an alternative embodiment, the live media content is displayed in combination with pre-recorded media content, such that in the case of displaying a live image from the camera, a part of the sub area can view e.g. the last taken picture or a frequently used image.
The processor unit is further configured to receive input from the user via the user interface 142 or the camera button 143, and when receiving input from the user embed the media content of sub area 320 into the message window, see 330 in Fig. 3 b).
In an alternative embodiment the media recorder application 123 is integrated in the media content application 122.
The media recorder 110 is here realised with a camera, and hence the media content displayed and embedded in the message is an image.
However, another type of media recorder like a video recorder or a sound recorder may be used as media recorder 110. Then the display sub area 320 displaying the media content provided by the media recorder 110 may display a live video image for the video camera, and a predetermined image or symbol for the sound recorder. The sound recorder media content may also be displayed showing a spectrum analysis of the current live audio being registered by the sound recorder. Also, when having a sound recorder or a video recorder as media recorder the video or sound file (live or previously recorded) provided by the media recorder may be associated with a thumbnail of an image or a symbol, which thumbnail is displayed in the sub area 320 of the messaging application display 141 , and further on is embedded into the message being created, such that the message will then include media content which is executed when activating the embedded thumbnail or symbol which is associated with the actual media content object, i.e. the sound or video clip.
If the mobile device 100 comprises a plurality of media recorders, for instance two cameras, each current media content associated with a specific media recorder may be shown in separate sub areas of the message window.
Fig. 2 is a schematic flow chart illustrating an embodiment of the method according to the first aspect of the present invention. In the following, this embodiment of the method will be described. The method is exemplified as being performed in the device 100 as described above, i.e. a mobile phone equipped with a camera, but should not be restricted to use in merely mobile phones as was previously discussed above.
When the mobile phone user wants to create a message, he or she first activates the messaging application 121. The messaging application 121 is here a multi-media messaging application (MMS).
Box 200: The messaging application is displayed in the user interface display 141 and, for a new message, a message window 300 is displayed on the display 141 , in which message window 300 the user is allowed to create the content of the message. Box 210: The camera 110 is enabled. In this example the camera is enabled automatically as the user starts up the messaging application to create a message.
Box 215: A determination of a sub area of display 141 is performed. This is described in more detail herein under. Box 220: As the camera 110 is enabled media content associated with the camera is displayed on sub area 320 of the display 141. The media content is the actual camera viewfinder image, i.e. live media content, but may however be represented by a previously recorded image. In this example the predetermined choice of media content to provide from the camera is set to "live image" in a configuration file. The predetermined choice can also be set in users settings, or as options in a menu. At least a part of the actual viewfinder image is now shown live on the messaging application display 141. The actual area of the image, which is recorded by the camera 110, that is displayed is determined in advance. A camera setting for showing the complete image in a predetermined sub area 320 is here set to be: scale image to show whole image as a thumbnail 320 on a messaging toolbar 310, see Fig. 3 a). Box 230: Now, as the user is creating a message and sees an interesting motive in the surroundings, the user simply points the camera 110 towards the motive to be included into the current message and presses the camera button 143. The pressed camera button 143 provides input to the media content application to embed the captured image into the current message.
Box 240: The image captured by the camera is then embedded in the sub area 330 of the message window 300. In the case of sub area 320 showing previously stored media content, this previously stored media content is embedded in sub area 330 of the message window 300.
The embedding of the media content of sub area 320 is done by either pressing the hardware camera button 143 or via a software button 142. This may be realized in a number of ways, for instance by clicking on the sub area 320 with a mouse, or pressing on the sub area or camera icon on a touch screen display. When taking the picture, the recorded media content is automatically integrated into sub area 330 of the message window 300. As the messaging application 121 is instructed by the user to save or send the message, the embedded captured image is also included in the message.
The step of embedding the image into the message will for the live image include recording of the current live image. If a video recorder or a sound recorder is used as media recorder 110, the generation of a video clip or sound clip will extend in time, and a thumbnail image or symbol is preferably associated with the clip. The thumbnail is then embedded in the message window. The recorded media content is stored, temporarily or for later use, in the storage element 130.
The display area 320 keeps viewing the live image.
In an embodiment the viewfinder media content of a video recorder 110 is displayed in the sub area 320. The recording of media content, i.e. shooting a video, may be started by pressing on the sub area or alternatively a software button 142, which may be arranged in the vicinity of the sub area 320 on the display. The video is shot as long as the user holds his or her hand or stylus on the defined software button 142. When releasing the hand or stylus the shooting of the video is stopped. The just recorded media content, i.e. the video just shot, may then be played in the sub area 320 or alternatively in another predefined sub area of the messaging display, to illustrate for the user what kind of video that may be included in the message. In an alternative embodiment, the video is played in a repeat mode. In an alternative embodiment in which the media recorder is a video recorder, the user can easily shoot a video by opening the protection cover (video shooting starts) and stop video recording by simply closing the protection cover of the video camera lens. In an alternative embodiment as illustrated in Fig. 4 a) and b) the live media content is displayed in a sub area 420, which is placed in the message window 300 and when the image is embedded into a message window sub area 430, the live image may be deactivated or the display area 420 is repositioned. As mentioned before, the media content provided by the camera 110 and which media content is displayed in the message application window 141 can be set to show previously recorded media content, i.e. in this case images that were recorded previously by the camera or which may have been downloaded or stored onto the device 100. These images are stored in the storage 130.
The determining of display sub area 530, 540, 630 on the messaging application display according to box 215, is now described in more detail. The determining of a sub area is done by o"ne of:
- retrieving a predetermined sub area, - receiving external selection input selecting a template display sub area from a set of template display sub areas, and
- receiving external input defining a sub area by drawing a sub area onto the display.
Predetermined sub area settings are stored in a storage on the device 100, such that when enabling the media recorder 110, the settings for the sub area are retrieved from the storage. Typical settings for the sub area are: sub area on a messaging toolbar, coordinates for position and size (x, y, size) etc. The settings are preferably set by the manufacturer. However, resetting the settings in a menu is possible. Selecting a template display sub area from a set of template display sub areas allows the user to select a sub area from a list of templates which are presented in a menu that pops up as the camera is enabled. The presentation may be a list of describing names or thumbnail pictures of the templates. Each template is a pre-selected setup for a display sub area in which for instance size, shape, position is specified. The shape of the sub area can be set to any suitable shape, like for instance diamond-shaped, quadratic, star-shaped, heart-shaped, and circle-shaped. Furthermore, the template sub areas may be integrated in a message template, wherein text areas and image areas are specified. For the text in the message font, size, headers etc. are specified. Furthermore, the sub areas are specified according to size, shape, position, total number etc. In Fig. 5 a message template 500 for a messaging application with media content management according to the present invention is illustrated. The message template 500 comprises a header 510, a text area 520, a first display sub area template 530 and a second display sub area template 540. When opening a message template as illustrated in Fig. 5 to create a message, the media recorder 110 is enabled, and settings for the message and display sub area for displaying the media content provided from the media recorder are retrieved from the template. In the case of having several display sub areas defined in the template, the displaying of the media content may be done according to number or having the media content displayed in all visible sub areas in the message window. In an alternative embodiment the user activates a sub area by clicking on it. The media content is then displayed in the currently activated sub area.
In an alternative embodiment the display sub area is determined by allowing the user to draw a sub area in a message window. As illustrated in Fig. 6 a message window 600 is opened on a display. A tool-pane 620 for drawing a sub area 630 in the message window 600 is automatically launched when a new message window is activated. The tool-pane 620 is provided with a number of template sub area shapes, 621 - 625. In this illustrative example the shapes of a diamond, rectangle, a star, a heart and a circle may be chosen from the tool-pane 620. However, any suitable shape may be used. The user selects a shape with a pointing tool. The user is then allowed to, by using the pointing tool which has a symbol 610 visible on the display, draw the selected shape into the message window 600 to form a display sub area 630. The pointing tool may be realized with a mouse- functionality, a light pen in combination with a touch screen or simply by touching the touch screen with a finger. When releasing the pointing tool, the media recorder is enabled and media content provided by the media recorder is displayed in the display sub area 630. In an alternative embodiment the media recorder is enabled in an earlier stage, in which case only the displaying of the media content provided by the media recorder takes place. Above the media recorder was enabled as the messaging application was started and a new message was created. In alternative embodiments the launching of the media recorder may be done by pressing a software button on the display, like a media recorder symbol, or by picking a media recorder option from a list. Alternatively, the user may press a hardware button, e.g. the camera shutter button 143 to enable the camera. An other alternative is to enable the media recorder when opening the media recorder protection cover or when using a barcode reader.
In alternative embodiments the predetermined choice is set to "latest recorded image", "favourite image", "random image" etc.
The types of messages that the present method is suitable for are MMS, IMS, e-mail messages, phone calls with multimedia capabilities, etc. although other suitable present or future types of messages are not excluded. The invention is applicable to Internet based applications or services which will then offer a media content sub area in the application window. E.g. a web based Flickr service may display a display sub area that shows a viewfinder of a camera of the mobile device. The Flickr service then activates the mobile device camera using a viewfinder API. Another messaging application suitable for the present method is blogging, i.e. in which application users frequently and chronologically publish personal messages about their thoughts and every day life etc. on the Internet. In an alternative embodiment the current message being created is an ongoing phone call. When a user A receives a call from user B, the telephone application is started, and instantly a message window is activated on the mobile phone display. Furthermore, user A's mobile phone camera is activated and a live image is shown in a sub area of the message window. User A then chooses to take a picture and send directly to user B. The picture may be sent as a rejection to the call, which may explain to user B why the call is rejected, e.g. taking an image of a meeting room explains "I'm attending a meeting". Alternatively, the image is shown to user B during an ongoing call. In an alternative embodiment a user has a mobile device which is connectable to a personal computer (PC) by means of e.g. Bluetooth, Wifi, or Wimax. The user is using an e-mail application on the PC. The PC contains hardware and software that is arranged to search and recognize mobile devices that are capable of taking images and recording videos and to receive images from said mobile devices. Thus, the functionality of this hardware and software is to act as a media recorder for the PC. The e-mail application is arranged to periodically check if there is information about imaging capable devices within range of the PC. If the mobile device is detected then a live image from the mobile device shows up on the live image area on the message window of the email application on the PC. The user is allowed to take an image using the mobile camera and the image is automatically attached to the e-mail message being created. Any other messaging application can be used. The PC may also be any other type of messaging device.
Above, embodiments of the method and device according to the present invention as defined in the appended claims have been described. These should be seen as merely non-limiting examples. As understood by a skilled person, many modifications and alternative embodiments are possible within the scope of the invention. Accordingly, the invention is not limited except as by the appended claims.
It is to be noted, that for the purposes of this application, and in particular with regard to the appended claims, the word "comprising" does not exclude other elements or steps, that the word "a" or "an", does not exclude a plurality, which per se will be apparent to a person skilled in the art.

Claims

1. A method comprising:
- displaying a message window in a mobile device messaging application display; - enabling a media recorder comprised within the mobile device;
- displaying at least a portion of media content provided by the media recorder in a display sub area of the messaging application display; and, upon receiving input:
- embedding the media content provided by the media recorder in the message window.
2. The method according to claim 1 , wherein the media content provided by the media recorder is live media content.
3. The method according to claim 1 , wherein the media content provided by the media recorder is previously stored media content.
4. The method according to claim 2, wherein said step of embedding the media content further comprises generating the media content by recording current live media content.
5. The method according to claim 4, further comprising storing the recorded media content.
6. The method according to any one of the previous claims, further comprising determining said display sub area on the messaging application display.
7. The method according to claim 6, wherein the step of determining the display sub area is performed by one of:
- retrieving a predetermined sub area;
- receiving external selection input selecting a template display sub area from a set of template display sub areas; and
- receiving external input defining a sub area by drawing a sub area onto the display.
8. The method according to claim 7, wherein the predetermined sub area is located on a messaging tool bar.
9. The method according to any one of the preceding claims, wherein the step of enabling the media recorder is done by one of automatically activating the media recorder when creating a new message, pressing a software button, picking from a list, pressing a hardware button, opening media recorder protection cover, using a barcode reader, and determining a sub area.
10. The method according to any one of the preceding claims, wherein the step of receiving input comprises of one of detecting the pressing a hardware button, and detecting the pressing a software button.
11. A device comprising:
- a media recorder unit;
- a storage unit;
- a processor unit;
- a user interface comprising a display, and a user input element for receiving user input; said storage unit being configured to hold at least media content, said processor unit being configured to run a messaging application, and said display being configured to display a message window for the messaging application, wherein the processor unit, under instruction from a media content manager application, is further configured to
- enable the media recorder;
- display at least a portion of media content provided by the media recorder in a display sub area of the display; and
- embed the media content provided by the media recorder in the message window.
12. The device according to claim 11 , wherein the media content provided by the media recorder is live media content.
13. The device according to claim 11 , wherein the media content provided by the media recorder is stored media content.
14. The device according to claim 12, wherein the processor unit is further configured for generating the media content by recording current live media content.
15. The device according to claim 14, wherein the processor unit is further configured for storing the recorded media content in the storage element.
16. A device comprising:
- a media recorder unit; - a storage unit for storing at least media content;
- a processor unit for running a messaging application;
- a user interface comprising a display for displaying a message window for the messaging application and a user input element for receiving user input; wherein the processor unit, under instruction from a media content manager application, is further configured for
- enabling the media recorder;
- displaying at least a portion of media content provided by the media recorder in a display sub area of the display; - embedding the media content provided by the media recorder in the message window.
17. A computer-readable program which program, when executed by a computer, causes the computer to perform a method according to any of claims 1 to 10.
18. A computer-readable medium containing a computer-readable program, the program being executed by a computer to perform a method according to any of claims 1 to 10.
19. A graphical user interface for a device provided with a media recorder and a messaging application comprising: a first display sub area integrated in a message window of said messaging application for displaying at least a portion of media content provided from said media recorder, wherein upon receiving input said media content is embedded in a present message being created in said message window.
20. A graphical user interface according to claim 19, further comprising a second sub area for displaying live or stored media content provided from said media recorder.
21. A user interface according to claim 19 or 20, further comprising a tool bar for defining said first sub area.
22. A user interface according to claim 21 , wherein said tool bar comprises a plurality of predetermined templates for said second sub area, wherein said predetermined templates are selectable by clicking on a template or by performing a drag-and-drop of a template onto said message window.
23. A user interface according to claim 21 , wherein said tool bar comprises drawing tools for drawing said second sub area.
24. A user interface according to any of claims 19 to 23, wherein said first sub area is implemented as a software button, wherein said input is generated by activating said first sub area.
25. A user interface according to any of claims 19 to 23, wherein said input is generated by activating an activation area on said messaging application display.
26. A user interface according to any of claims 19 to 23, wherein said input is generated by activating an external button.
PCT/EP2007/011035 2007-12-03 2007-12-15 Media embedded in mobile messaging WO2009071112A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US99191407P 2007-12-03 2007-12-03
US60/991,914 2007-12-03

Publications (1)

Publication Number Publication Date
WO2009071112A1 true WO2009071112A1 (en) 2009-06-11

Family

ID=39722521

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2007/011035 WO2009071112A1 (en) 2007-12-03 2007-12-15 Media embedded in mobile messaging

Country Status (1)

Country Link
WO (1) WO2009071112A1 (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130021270A1 (en) * 2011-07-19 2013-01-24 Lg Electronics Inc. Mobile terminal and controlling method thereof
CN103279277A (en) * 2013-05-08 2013-09-04 广东欧珀移动通信有限公司 Mobile terminal screenshot picture sending method and system
EP2712165A1 (en) * 2012-09-25 2014-03-26 Samsung Electronics Co., Ltd Method and electronic device for transmitting images during a messaging session
CN106575149A (en) * 2014-05-31 2017-04-19 苹果公司 Message user interfaces for capture and transmittal of media and location content
US9930157B2 (en) 2014-09-02 2018-03-27 Apple Inc. Phone user interface
US9977579B2 (en) 2014-09-02 2018-05-22 Apple Inc. Reduced-size interfaces for managing alerts
US9998888B1 (en) 2015-08-14 2018-06-12 Apple Inc. Easy location sharing
US10375519B2 (en) 2011-05-23 2019-08-06 Apple Inc. Identifying and locating users on a mobile network
US10375526B2 (en) 2013-01-29 2019-08-06 Apple Inc. Sharing location information among devices
US10382378B2 (en) 2014-05-31 2019-08-13 Apple Inc. Live location sharing
US10613608B2 (en) 2014-08-06 2020-04-07 Apple Inc. Reduced-size user interfaces for battery management
US10715380B2 (en) 2011-05-23 2020-07-14 Apple Inc. Setting a reminder that is triggered by a target user device
US11099704B2 (en) 2012-10-31 2021-08-24 Lg Electronics Inc. Mobile terminal and control method for displaying images from a camera on a touch screen of the mobile terminal
US11513667B2 (en) 2020-05-11 2022-11-29 Apple Inc. User interface for audio message
US11743375B2 (en) 2007-06-28 2023-08-29 Apple Inc. Portable electronic device with conversation management for incoming instant messages

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040239686A1 (en) * 2003-05-22 2004-12-02 Casio Computer Co., Ltd. Data communications device, image transmission method and image transmission program
US20050018050A1 (en) * 2003-07-23 2005-01-27 Casio Computer Co., Ltd. Wireless communication device, dynamic image preparation method and dynamic image preparation program
US20060077266A1 (en) * 2004-10-08 2006-04-13 Nokia Corporation Image processing in a communication device having a camera
US20060101122A1 (en) * 2004-11-10 2006-05-11 Fujitsu Limited Cell-phone terminal device, mail processing method, and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040239686A1 (en) * 2003-05-22 2004-12-02 Casio Computer Co., Ltd. Data communications device, image transmission method and image transmission program
US20050018050A1 (en) * 2003-07-23 2005-01-27 Casio Computer Co., Ltd. Wireless communication device, dynamic image preparation method and dynamic image preparation program
US20060077266A1 (en) * 2004-10-08 2006-04-13 Nokia Corporation Image processing in a communication device having a camera
US20060101122A1 (en) * 2004-11-10 2006-05-11 Fujitsu Limited Cell-phone terminal device, mail processing method, and program

Cited By (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11743375B2 (en) 2007-06-28 2023-08-29 Apple Inc. Portable electronic device with conversation management for incoming instant messages
US11665505B2 (en) 2011-05-23 2023-05-30 Apple Inc. Identifying and locating users on a mobile network
US10375519B2 (en) 2011-05-23 2019-08-06 Apple Inc. Identifying and locating users on a mobile network
US10715380B2 (en) 2011-05-23 2020-07-14 Apple Inc. Setting a reminder that is triggered by a target user device
US10863307B2 (en) 2011-05-23 2020-12-08 Apple Inc. Identifying and locating users on a mobile network
US10382895B2 (en) 2011-05-23 2019-08-13 Apple Inc. Identifying and locating users on a mobile network
US11700168B2 (en) 2011-05-23 2023-07-11 Apple Inc. Setting a reminder that is triggered by a target user device
US20130021270A1 (en) * 2011-07-19 2013-01-24 Lg Electronics Inc. Mobile terminal and controlling method thereof
US9792036B2 (en) * 2011-07-19 2017-10-17 Lg Electronics Inc. Mobile terminal and controlling method to display memo content
CN106060308A (en) * 2012-09-25 2016-10-26 三星电子株式会社 Method for transmitting image and electronic device thereof
US10785440B2 (en) 2012-09-25 2020-09-22 Samsung Electronics Co., Ltd. Method for transmitting image and electronic device thereof
US9800817B2 (en) 2012-09-25 2017-10-24 Samsung Electronics Co., Ltd. Method for transmitting image and electronic device thereof
EP3567838A1 (en) * 2012-09-25 2019-11-13 Samsung Electronics Co., Ltd. Method and electronic device for transmitting images during a messaging session
US9414003B2 (en) 2012-09-25 2016-08-09 Samsung Electronics Co., Ltd. Method for transmitting image and electronic device thereof
EP2712165A1 (en) * 2012-09-25 2014-03-26 Samsung Electronics Co., Ltd Method and electronic device for transmitting images during a messaging session
CN103685729A (en) * 2012-09-25 2014-03-26 三星电子株式会社 Method for transmitting image and electronic device thereof
US20180041730A1 (en) 2012-09-25 2018-02-08 Samsung Electronics Co., Ltd. Method for transmitting image and electronic device thereof
CN106060308B (en) * 2012-09-25 2018-12-21 三星电子株式会社 For sending the method and its electronic device of image
US10298872B2 (en) 2012-09-25 2019-05-21 Samsung Electronics Co., Ltd. Method for transmitting image and electronic device thereof
US11099704B2 (en) 2012-10-31 2021-08-24 Lg Electronics Inc. Mobile terminal and control method for displaying images from a camera on a touch screen of the mobile terminal
EP2728455B1 (en) * 2012-10-31 2022-03-16 LG Electronics Inc. Mobile terminal
US10375526B2 (en) 2013-01-29 2019-08-06 Apple Inc. Sharing location information among devices
CN103279277A (en) * 2013-05-08 2013-09-04 广东欧珀移动通信有限公司 Mobile terminal screenshot picture sending method and system
CN106575149B (en) * 2014-05-31 2021-10-12 苹果公司 Message user interface for capturing and transmitting media and location content
US10732795B2 (en) 2014-05-31 2020-08-04 Apple Inc. Message user interfaces for capture and transmittal of media and location content
US10382378B2 (en) 2014-05-31 2019-08-13 Apple Inc. Live location sharing
US10416844B2 (en) 2014-05-31 2019-09-17 Apple Inc. Message user interfaces for capture and transmittal of media and location content
US11943191B2 (en) 2014-05-31 2024-03-26 Apple Inc. Live location sharing
US10564807B2 (en) 2014-05-31 2020-02-18 Apple Inc. Message user interfaces for capture and transmittal of media and location content
US10592072B2 (en) 2014-05-31 2020-03-17 Apple Inc. Message user interfaces for capture and transmittal of media and location content
US11513661B2 (en) 2014-05-31 2022-11-29 Apple Inc. Message user interfaces for capture and transmittal of media and location content
US11775145B2 (en) 2014-05-31 2023-10-03 Apple Inc. Message user interfaces for capture and transmittal of media and location content
JP2021064374A (en) * 2014-05-31 2021-04-22 アップル インコーポレイテッドApple Inc. Message user interface for capture and transmission of media and location
CN106575149A (en) * 2014-05-31 2017-04-19 苹果公司 Message user interfaces for capture and transmittal of media and location content
JP2018125001A (en) * 2014-05-31 2018-08-09 アップル インコーポレイテッド Message user interface for capture and transmittal of media and location content
EP3217341A1 (en) * 2014-05-31 2017-09-13 Apple Inc. Message user interfaces for capture and transmittal of media and location content
US10901482B2 (en) 2014-08-06 2021-01-26 Apple Inc. Reduced-size user interfaces for battery management
US11256315B2 (en) 2014-08-06 2022-02-22 Apple Inc. Reduced-size user interfaces for battery management
US11561596B2 (en) 2014-08-06 2023-01-24 Apple Inc. Reduced-size user interfaces for battery management
US10613608B2 (en) 2014-08-06 2020-04-07 Apple Inc. Reduced-size user interfaces for battery management
US10320963B2 (en) 2014-09-02 2019-06-11 Apple Inc. Phone user interface
US10771606B2 (en) 2014-09-02 2020-09-08 Apple Inc. Phone user interface
US11379071B2 (en) 2014-09-02 2022-07-05 Apple Inc. Reduced-size interfaces for managing alerts
US11989364B2 (en) 2014-09-02 2024-05-21 Apple Inc. Reduced-size interfaces for managing alerts
US10379714B2 (en) 2014-09-02 2019-08-13 Apple Inc. Reduced-size interfaces for managing alerts
US9977579B2 (en) 2014-09-02 2018-05-22 Apple Inc. Reduced-size interfaces for managing alerts
US11700326B2 (en) 2014-09-02 2023-07-11 Apple Inc. Phone user interface
US9930157B2 (en) 2014-09-02 2018-03-27 Apple Inc. Phone user interface
US10015298B2 (en) 2014-09-02 2018-07-03 Apple Inc. Phone user interface
US10003938B2 (en) 2015-08-14 2018-06-19 Apple Inc. Easy location sharing
US9998888B1 (en) 2015-08-14 2018-06-12 Apple Inc. Easy location sharing
US10341826B2 (en) 2015-08-14 2019-07-02 Apple Inc. Easy location sharing
US11418929B2 (en) 2015-08-14 2022-08-16 Apple Inc. Easy location sharing
US11513667B2 (en) 2020-05-11 2022-11-29 Apple Inc. User interface for audio message

Similar Documents

Publication Publication Date Title
WO2009071112A1 (en) Media embedded in mobile messaging
US11099704B2 (en) Mobile terminal and control method for displaying images from a camera on a touch screen of the mobile terminal
US11036782B2 (en) Generating and updating event-based playback experiences
EP1840897B1 (en) User interface for creating and using media keys
US8909810B2 (en) Systems and methods for multimedia content sharing
US9143601B2 (en) Event-based media grouping, playback, and sharing
US7163151B2 (en) Image handling using a voice tag
CN104346099B (en) Mobile terminal and its control method
US8724004B2 (en) Mobile terminal and tag editing method thereof
US8429534B2 (en) Graphical user interface, display control device, display method, and program
JP5508015B2 (en) Method for storing and accessing data
US10139994B2 (en) Capturing and processing multi-media information using mobile communication devices
EP2487584A2 (en) Operation method for memo function and portable terminal supporting the same
KR101873750B1 (en) Mobile terminal and method for controlling thereof
CN108172247A (en) Record playing method, mobile terminal and the device with store function
JP2007318454A (en) Position information history display method and mobile terminal
EP2273772A2 (en) Method for transmitting and receiving data in mobile terminal and mobile terminal using the same
EP2711853B1 (en) Methods and systems for media file management
JP2012059067A (en) Data management device, data management method and data management program
CN102447717A (en) Portable electronic equipment and content publishing method for same
McFedries iPad Portable Genius: Covers iOS 8 and all models of iPad, iPad Air, and iPad mini
CN102447716A (en) Portable electronic equipment and prompting method for content selection
Gookin Android phones for dummies
WO2009037522A2 (en) Mobile messaging
KR100652656B1 (en) Method for processing photo in mobile terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07856772

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07856772

Country of ref document: EP

Kind code of ref document: A1