JP2006526330A - Multimedia communication device for capturing and inserting multimedia samples - Google Patents

Abstract

The present invention relates to an apparatus for multimedia communication provided with a control means. In response to a single activation of the control means, the device takes a sample of some multimedia content, adds the sample to the processed message, and optionally sends a message with attached samples to the recipient. This allows the recipient of the transmitted message to easily identify and authenticate the message writer. Also, when processing a message, it becomes easier to express the writer's emotions and convey the writer's situation and environment. When the transmitted message has a command to control the communication session, a new sample can be played back under the recipient, describing the command. Example, has the greeting of hello, or goodbye from the sender of the message. The sent message may have an invitation to the communication session, for example, avoiding the hassle of obtaining, storing and holding a sample for caller identification locally, and the recipient decides to join the session To make it easier.

Description

  The present invention relates to an apparatus for multimedia communication, comprising capture means for capturing a sample of multimedia content and processing means for processing a message.

  The invention also relates to a method of multimedia communication, the method comprising capturing a sample of multimedia content and processing a message.

  The device described at the beginning is known from the Sony Ericsson P800 mobile phone, published by Sony Ericsson Mobile Communications AB, "User Guide", 1st edition, November 2002, issue number EN / LZT1086040R1A (non- As described in Patent Document 1). Many mobile phones today have the ability to take pictures in addition to the ability to send multimedia message service (MMS) messages. Smile character

のような所謂顔文字は、書き手の感情を表現するようメッセージの文章中に挿入され得る。顔文字を挿入することは比較的単純である。書き手の感情を表現するという同一の目的のために、カメラを使って写真又は静止画像等のサンプル又はスナップショットが、メッセージに有され得る。サンプルが有されていると、メッセージの受信者は、より容易に書き手を識別及び認証し得るようにもなる。更に、サンプルは、また、書き手の近況を容易に伝え、従ってメッセージを解釈するフレームワークを与える。しかしながら、含まれたサンプルを有するメッセージを送信することは、サンプルを取る段階、サンプルを格納する段階、メッセージを編集することによるメッセージ内のサンプルを含む段階、及び、格納されたサンプルを選択する段階を有する。最後に、メッセージは送信され得る。かかる段階の殆どは、ユーザに、装置を手動で反復して操作することを要求する。これは、偶発的又は意図的エラーを発生させる可能性を増加し、このことは、認証を目的とするサンプルの値を低下させる。また、装置を使用したかかるメッセージの送信は、ユーザにとって困難且つ複雑なものとなる。
Sony Ericsson Mobile Communications AB社発行、「ユーザ・ガイド」、第１版、２００２年１１月、発行番号ＥＮ／ＬＺＴ１０８６０４０Ｒ１Ａ (Outside 1)

So-called emoticons such as can be inserted into the message text to express the writer's emotions. Inserting emoticons is relatively simple. For the same purpose of expressing the writer's emotion, a sample or snapshot, such as a photo or still image, can be included in the message using the camera. Having a sample also makes it easier for message recipients to identify and authenticate the writer. In addition, the sample also provides a framework for easily communicating the current state of the writer and thus interpreting the message. However, sending a message with included samples includes taking a sample, storing a sample, including a sample in the message by editing the message, and selecting a stored sample. Have Finally, the message can be sent. Most of these steps require the user to manually and repeatedly operate the device. This increases the possibility of generating accidental or intentional errors, which reduces the value of the sample for authentication purposes. Also, sending such messages using the device is difficult and complicated for the user.
Published by Sony Ericsson Mobile Communications AB, "User Guide", 1st edition, November 2002, issue number EN / LZT1086040R1A

  The invention aims to provide an apparatus for multimedia communication of the kind described at the outset, which does not have the above-mentioned problems.

  This object is achieved in that the device has control means for controlling the capture means and the processing means, so that the sample is captured and added to a message in response to a single activation of the control means. Is done. With single activation, capturing and adding becomes an inseparable action, making it more difficult to tamper with the sample. Single activation eliminates the separate steps of operating the device for sample capture, storage, retrieval and insertion.

  Advantageously, the device further comprises transmission means for transmitting a message with the added sample in response to a single activation. This further reduces the possibility of tampering with the transmitted message, omitting other additional manual steps to operate the device.

  Advantageously, the capture means comprises a camera and the sample comprises a photograph. Photographs taken with a camera to capture the writer's emotions have the added advantage of easily using facial expressions. Another advantage is that photos can easily convey the actual situation of the writer to interpret the message.

  Advantageously, the device comprises a mobile phone. This has the advantage of easy switching to a more interactive voice phone in response to receiving the message. Alternatively, messages with samples can be easily sent to other parties during a voice call or during other communication sessions.

  Advantageously, the message comprises commands that control the communication session. This has the advantage that the sample can provide additional information related to the sender or session of the message. Also, there is no risk of being an old or late sample. For example, it may be useful to display photos of participants leaving the session, especially if there are many participants in the session. The sample can also be used during a session, for example, as a reminder of a participant in a session or to identify one participant relative to another participant.

  Advantageously, the message may have an invitation to a communication session. This has the advantage of avoiding the hassle of creating, storing and maintaining entries in the address book for so-called multimedia caller identification services. With such a service, samples are played at the recipient, simplifying the perception of the attracting party. One example is displaying a thumbnail picture of the caller of the incoming call. Another example is an acoustic sample with the name of the caller, or a short clip that introduces the subject of the session. The device according to the present invention enables caller identification by photo without any prior contact between the caller and the receiver. Further, the sample may provide additional and actual information regarding the intent about the session or its situation, making it easier for the recipient to decide to participate. Further, the sample may prompt the recipient to join the session.

In one embodiment of the method for multimedia communication according to the present invention, the method comprises:
-Capturing a sample of multimedia content;
-Processing the message;
-Triggering a single control to capture the sample and add the sample to the message;
Have Such a method reduces the possibility of tampering with the sample and eliminates multiple steps of operating the device that captures, stores, retrieves, and inserts the sample.

  Advantageously, activating single control also sends a message and further reduces the possibility of tampering with the message and eliminates other additional manual steps in the operation of the device.

  The above objects and characteristics of the present invention will become more apparent from the following description of preferred embodiments with reference to the accompanying drawings. FIG. 1 is a block diagram of one embodiment of an apparatus according to the present invention.

  Some of the characteristics shown in the figure may be implemented in software, which itself represents a software entity such as a software module or object.

  The apparatus 100 for multimedia communication includes a control unit 110, a capture unit 121, and a processing unit 122. Optionally, the device 100 has a transmission means 123. Device 100 may be provided having separate physical portions connected to perform the function as a whole. An example of this is a device 100 having a mobile phone and a so-called snap-on camera that can be attached to the phone. Another example is a so-called personal digital assistant (PDA) or desktop or palmtop computer (PC) that communicates wirelessly with a separate multimedia recorder, for example based on the so-called BlueTooth standard. Thus, the device 100 is directed to a single logical entity rather than a single physical entity. The device 100 may also be a multimedia terminal that may be portable, portable, handheld, or fixed, wireless or preferred. The device 100 may also have a general purpose hardware platform that provides the functionality of the multimedia terminal given the means or instructions.

  Using the control signal 131, the control unit 110 controls the capture unit 121, the processing unit 122, and the transmission unit 123. In response to a single activation 130 of the control means 110, the control means 110 ensures that samples are captured and added to the message 134 and optionally that the message 134 is sent 135.

  The message 134 can be, for example, a short message service (SMS), or a multimedia message (MMS), an email message, or a general message used for instant messaging or chat, or unified messaging. Or it may be a general message used for multimedia communication.

  The capture means 121 may capture a sample 133 of multimedia content 136. Capturing multimedia content 136 may include capturing multiple components. One component can be a still image or a snapshot. Another example of a component is a series of images, or a series of images often captured with a short video or clip. Other components are sounds such as audio samples for a few seconds, or stereo sound samples. Another example is a voice message or voice mail. Also, capturing a color or capturing a barcode results in a component. Other components have temperature and odor. Yet another component may be tactile information derived from feeling with a hand or glove. All of the examples described above are easily extended to have additional components and are therefore not intended to limit the components in any way. Combinations of components can also be made. An example is a combination of video and audio components that are typically adapted to obtain audio-visual samples that are played on a television receiver. The capture is started by a control signal 131 from the control means 110 in response to the single activation 130. After capture, the sample 133 is transferred to the processing means 122. To inform the user that a capture is in progress, the device 100 may have visual or audible indication means (not shown). An example may have a light emitting diode (LED) that emits light as long as the capture is in progress, and a speaker that mimics the “fladack” sound of a reflector camera. Another example is an indicator such as a bar that shows progress while capturing a sample or clip at a fixed period of time.

  The processing means 122 serves the purpose of creating, composing, and / or editing the message 134. The processing means 122 may provide an end user (not shown) a tool (not shown) to insert text or other objects into the message 134. This typically has hardware and software as known from the text processor that provides the editing environment. The content of the message 134 is modified at a point normally indicated by a cursor (not shown). In response to the control signal 131 from the control means 110, the processing means 122 inserts the sample 133 with the cursor without any further user intervention along with all the captured components received from the capture means 121. When the process is finished, the message 134 is optionally transferred to the transmission means 123.

  If message 134 has not already been processed on single activation 130, control means 110 may also cause message 134 to be created by processing means 122.

  The transmission means 123 enables transmission of the processed message 134. This causes the message 135 to be transmitted from the device 100 in either a wired or wireless medium (not shown) towards the message recipient (not shown) or waypoint (not shown). The message 134 received from the processing means is transmitted in response to the control signal 131 from the control means.

  What actually happens is upon activation of the control means 110, the sample 133 is captured 132, the sample 133 is added to the message 134, and the message 134 is optionally transmitted 135.

  The control means 110 may have a physical button (not shown) on the device 100. Alternatively, so-called soft buttons can be rendered on a display screen (not shown). A soft button is activated by clicking with the mouse or by tapping the touch screen with a stylus or finger. The control means 110 may be arranged to send a message on activation to the recipient represented on the display screen. In particular, upon activation, the control means 110 sends a message to one or more selected recipients that are part of the list shown on the display screen. The recipient selection may be based on how the recipient is listed, such as highlighted or differently colored. Recipient selection may also be based on the distance between the displayed recipient and the point to click so that the closest recipient is selected. The recipient may also be selected from a group recently engaged in a communication session, such as a voice phone or chat session of the device 100.

  The received samples can be stored and subsequently used at the receiving device. An example of the use of such stored samples is to serve as a reminder for session participants. Another example is the identification of one specific participant for all participants, or for example, identifying the session chair to enhance the so-called floor control mechanism.

  Message 134 may have commands (not shown) that control a communication session (not shown). The recipient of the sent message 135 is requested to apply the command to the communication session. In response to receiving the message, the sample 133 can then be played at a receiving device (not shown) as part of handling the received message 135. An example of a command is to accept or reject an invitation to the session, terminate the session, or remove the sender as a participant in the session or change several other parameters of the session. The parameters are streaming details such as port, address, packet routing, symbolization, decoding, buffering, protocol, flow control and the like. Sample 133 may identify, for example, a person entering or leaving the session or a new greeting from that person.

  Message 134 may also have an invitation (not shown) for a communication session (not shown). The recipient of the sent message 135 is invited to engage in a communication session. In response to receiving the message, the sample 133 can then be played at a receiving device (not shown) as part of handling the received message 135. With the replayed sample, the recipient can easily determine whether to accept or reject the invitation and, as a result, can easily determine participation in the communication session. The sample may also describe the sender or session. Examples are the subject of the session, its settings or status, the status of the sender associated with the session, etc. Presenting a sample can also be more descriptive to the recipient than presenting a phone number, nickname, or user identifier, etc. The sample may also convince the recipient to participate. If the recipient accepts the invitation, the recipient is added to the session participants. Upon request, a session can be created in response to the invitation by either the receiving device or the sending device.

  Alternatives are possible. In the above description, the verb “having” and its use do not exclude other elements or steps, but exclude the case where there are a plurality of such elements if the element is described in the singular. It is not a thing. A single processor or other unit may also perform the functions of several means recited in the claims.

One embodiment of an apparatus 100 according to the present invention is illustrated in a block diagram.

Claims (10)

A device for multimedia communication,
-Capture means for capturing samples of multimedia content;
-Processing means for processing the message;
A control means for controlling the capture means and the processing means;
Have
The sample is captured and added to the message in response to a single activation of the control means;
apparatus. The apparatus further comprises transmitting means for transmitting the message with the sample added in response to the single activation;
The apparatus of claim 1.   The apparatus of claim 1, wherein the capture means comprises a camera and the sample comprises a photograph.   The apparatus of claim 1, wherein the apparatus comprises a mobile phone.   The apparatus of claim 2, wherein the message comprises a command that controls a communication session.   The apparatus of claim 2, wherein the message comprises an invitation to a communication session. A method for multimedia communication,
-Capturing a sample of multimedia content;
-Processing the message;
-Triggering a single control to capture the sample and add the sample to the message;
Having a method. The step of activating the single control also sends the message;
The method for multimedia communication according to claim 7. The message comprises a command for controlling a communication session, and the method further comprises the step of controlling the communication session in dependence on the control command.
The method of claim 8. The message has an invitation to a communication session, and the method further comprises the step of establishing the communication session in response to accepting the invitation.
The method of claim 8.

Images