EP1631102A1 - Elektronisches Gerät für ein drahtloses Kommunikationssystem zum Senden und Empfangen von Informationsinhalten während einer laufenden Verbindung - Google Patents

Elektronisches Gerät für ein drahtloses Kommunikationssystem zum Senden und Empfangen von Informationsinhalten während einer laufenden Verbindung Download PDF

Info

Publication number
EP1631102A1
EP1631102A1 EP04020191A EP04020191A EP1631102A1 EP 1631102 A1 EP1631102 A1 EP 1631102A1 EP 04020191 A EP04020191 A EP 04020191A EP 04020191 A EP04020191 A EP 04020191A EP 1631102 A1 EP1631102 A1 EP 1631102A1
Authority
EP
European Patent Office
Prior art keywords
video
audio
video signal
audio signal
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP04020191A
Other languages
English (en)
French (fr)
Inventor
Fredrik Ramsten
Emil Hansson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Mobile Communications AB
Original Assignee
Sony Ericsson Mobile Communications AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Ericsson Mobile Communications AB filed Critical Sony Ericsson Mobile Communications AB
Priority to EP04020191A priority Critical patent/EP1631102A1/de
Priority to EP04023698A priority patent/EP1631105A1/de
Priority to PCT/EP2005/009198 priority patent/WO2006021444A2/en
Publication of EP1631102A1 publication Critical patent/EP1631102A1/de
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H04M3/567—Multimedia conference systems

Definitions

  • the present invention relates to an electronic equipment for a wireless communication system. Specifically, the present invention relates to the problem of keeping up a communication and at the same time transmitting and receiving information content.
  • most electronic equipments for a wireless communication system either enable the user to set up a communication to another person, i.e. a call, a video conference or the like, or to transmit and receive information content such as images, videos, sound, drawings, sketches, text, documents and the like.
  • information content such as images, videos, sound, drawings, sketches, text, documents and the like.
  • the object of the present invention is therefore to provide an electronic equipment for a wireless communication system as well as a method for an electronic equipment for a wireless communication system, which enable the user to transmit and receive information content during an ongoing communication thereby getting an instant feedback from the person he is communicating with.
  • the present invention relates to an electronic equipment for a wireless communication system enabling communication within the wireless communication system by transmitting a first audio signal and a first video signal, and enabling transmission of information content within the wireless communication system by transmitting a second video signal and a second audio signal and comprising an encoder for encoding audio and video signals to be transmitted within the wireless communication system and an audio mixing means for interleaving said second audio signal with said first audio signal and submitting the interleaved audio signal to the encoder.
  • the present invention further relates to an electronic equipment for wireless communication enabling communication within the wireless communication system by transmitting a first audio signal and a first video signal, and enabling transmission of information content within the wireless communication system by transmitting a second video signal and a second audio signal and comprising the steps of encoding audio and video signals to be transmitted within the wireless communication system by an encoder and interleaving said second audio signal with said first audio signal and submitting the interleaved audio signal to the encoder.
  • the term “electronic equipment for a wireless communication system” includes any kind of portable radio communication equipment.
  • portable radio communication equipment includes all equipments such as mobile telephones, mobile self-phones, pagers, personal digital assistants, communicators, i.e. electronic organisers, smart phones or the like.
  • wireless communication system relates to any kind of communication or tele-communication system which enables the wireless transfer of information.
  • a file system contains a file consisting of said second audio signal and/or said second video signal.
  • an audio converter converts said second audio signal to a predefined format.
  • a separation means separates the second video signal from the second audio signal.
  • a selecting means selects said second video signal or said first video signal and submits the selected video signal to the encoder.
  • the selecting means selects the first video signal only when no second video signal is present.
  • a video converter converts said second video signal to a predefined format.
  • FIG. 1 shows a schematic block diagram of the system according to the present invention.
  • An electronic equipment 1 comprises an audio input means 2, which may be a microphone or, a voice recognition means or the like, for accepting voice, sounds, noise or other audio signals from the environment of the electronic equipment 1.
  • a video input means 4 which may be a camera or the like, serves for accepting videos, still images or other video signals.
  • a file system 3 contains information content, that is files consisting of audio and/or video components including images, videos, sound, drawings, sketches, text, documents and the like.
  • audio according to the present invention relates to acoustic data, like speech, music, noises or the like and "video” relates to optical data like images, texts and the like.
  • Combined audio and video data may be music videos, a video conference or the like.
  • the electronic equipment is able to transmit and receive information in a wireless communication system, such as e.g. the UMTS, GPRS; GSM or any other available wireless telecommunication system.
  • the electronic equipment 1 further comprises an encoder 5 for encoding signals which have to be transmitted within the wireless communication system.
  • the encoder 5 encodes an audio signal and a video signal which then are multiplexed and transmitted within the wireless communication system.
  • the voice signals e.g. speech
  • the audio input means 2 receives this first audio signal from the user and this first audio signal is submitted to the encoder 5.
  • the image or video signals e.g. the face of the user, the ambience or the like
  • the video input means 4 receives this first video signal from the decoder.
  • the first audio and/or the first video signal serve for keeping up a vocal, visual or combined vocal and visual communication.
  • the user can select a file from the file system 3 he wants to transmit to the person he is communication with.
  • the file is then submitted to a separation means 6 where the file is split into a second audio signal and a second video signal.
  • an audio mixing means 13 the second audio signal is then interleaved with said first audio signal deriving from the audio input means 2 and the interleaved audio signal is then submitted to the encoder 5.
  • the second video signal deriving from the file and the first video signal deriving from the video input means 4 are submitted to an selecting means 8.
  • the selecting means 8 selects which of the video signals is submitted to the encoder 5. If no second video signal from the file is present, then the selecting means 8 will select the first video signal deriving from the video input means. Otherwise if a second video signal from the file is submitted to the selecting means 8, then the selecting means 8 will select the second video signal and submit it to the encoder 5.
  • the information content hereby consists of audio and/or video components including images, videos, sound, drawings, sketches, text, documents and the like.
  • the information content may either be an audio file, a video file or a combined audio and video file.
  • Fig. 2a shows a block diagram of a system used during an ordinary video call.
  • the video input means 4 serves for taking pictures or videos from objects persons or the like.
  • the images are already in the negotiated video transmit format and a buffer 9 can be filled with frames containing the images.
  • the encoder 5 then reads from the buffer 9 and encodes the frames in order to submit them to the transceiver (not shown).
  • Fig. 2b shows a schematic block diagram of a system where a still image is replacing the camera images.
  • the video converter 10 for example converts the file for example into JPEG decompression. If the file has a different resolution then the transmitted video, i.e. QCIF 176x144 it has to be resized or cropped to the outgoing format.
  • the video signal is then sent to the selecting means 8, which then will select the second video signal from the file to be transmitted to the buffer 9.
  • the buffer 9 is then filled with frames containing the converted image.
  • the encoder 5 then reads from the buffer 9 and encodes the frame to the negotiated format, i.e. H.263.
  • the encoded image can then be multiplexed along with the audio signal and transmitted to the other electronic equipment 1 just like during a normal video call, that is the audio from the microphone is still transmitted along with the video containing the still image.
  • Fig. 3a shows a schematic block diagram of a system for transmitting a simple audio signal received the audio input means 2 of the electronic equipment 1.
  • the audio input means 2 integrated in the electronic equipment 1 submits the received voice signals to an AD converter 12 which then converts the analogue signal to digital signals. Afterwards the signal is encoded by the encoder 5 and submitted to the transceiver (not shown).
  • Fig. 3b shows a schematic block diagram of the system used for sharing a sound file during an ongoing communication. If the user wants to transmit an audio file then the audio file is fetched from the file system 3 and afterwards an audio converter 14 converts to file to an appropriate format. Afterwards the converted file is then mixed with the audio data received from the microphone 11 in the audio mixing means 13 by using audio channel mixing. The combined audio data is then encoded to the negotiated format by the encoder 5, i.e. AMR, multiplexed with the video and transmitted as during a standard video call.
  • the encoder 5 i.e. AMR
  • Fig. 4 shows a schematic block diagram of a system for transmitting a video clip. If the user decides to transmit a video clip then video is fetched from the file system 3 and a separation device 6 separates the audio signal from the video signal. As explained above the second audio signal derived from the file in the audio converter 14 is then converted to the appropriate format and afterwards is mixed in the audio mixing means 13 with the sampled first audio signal from the audio input means 2. After separating the second audio signal from the second video signal in the separation device 6 the second video signal is converted by a video converter 10 and afterwards submitted to the selecting means 8. The selecting means then selects the second or the first video signals and stores the selected signal in the buffer 9. The encoder 5 then encodes the video signal from the buffer 9 and the audio signal from the audio mixing means and submits them to the transceiver (not shown).
  • Fig. 5 shows a flow chart of the steps according to the process of the present invention.
  • the user selects a file from the file system 3 he wants to transmit and the selection is accepted by the electronic equipment 1.
  • step S2 it is checked, whether the selected file contains an audio signal. If the file does not contain an audio signal then in step S3 the video signal is converted to the needed format.
  • step S4 it is checked, whether the converted video signal has the correct resolution. If the video signal does not have the correct resolution then the video is resized in step S12. The process then goes back to step S4 where it is checked again whether the video has the correct resolution.
  • step S4 If in step S4 it is decided, that the video has the correct resolution then video submitted to the selecting means in step S5 and the selected video signal is buffered in the buffer 9 in step S6. In the next step S7 the buffered signals are encoded and in step S8 they are transmitted by the transceiver.
  • step S9 the audio signal is separated from the video or image signal.
  • the video or image signal is then processed according to the step S3 and following as explained above.
  • the audio signal in step S10 is converted to the appropriate format and in step S11 it is mixed with the audio signal from the microphone in the audio mixing means 13.
  • the audio signals are then encoded by the encoder 5 in step S6 and afterwards also transmitted in step S7 by the transceiver.
  • the electronic equipment 1 will not switch into the video mode for communication but continue the voice call. In the same way if during a video conference when a combined first audio and video signal is submitted to keep up the communication an audio content is submitted, then the electronic equipment will keep up the video conference and will not switch into a voice call. It may be provided an option for the user to switch between different communication modes, e.g. between voice call and video conference, but the electronic equipment will not switch automatically.
  • Fig. 6a to 6d show different display images during the process serving as an user interface.
  • the face of the other person to which the user of the electronic equipment 1 is communicating can be shown.
  • a control display part 18 may be provided where the user can see what at present the other person to which he is communicating is seeing, e.g. that is his own face during a video call or images or the like he wants to share or he is transmitting.
  • the display further comprises a main menu 16 through which the user can scroll and the actual selectable menu is high-lighted in a form for example enlarged or the colour is changed.
  • the user can select between menus A, B, C, D, or E.
  • the menu B actually can be selected.
  • the display may further comprise information lines 19A and 19B in order to inform the user on the actual selected menu or file.
  • Selectable menus may be the feature of a video call or a normal call, sharing pictures or text, sharing videos, sharing sounds or playing interactive video games with other persons. If, for example, the user has selected as shown in Fig. 6b the menu for sharing pictures then in a sub-menu 20a the pictures contained in the file system 3 are shown. By scrolling through the pictures the actual selectable picture again is high-lighted, which in the present example is picture 4.
  • Fig. 6c shows the situation where the picture 4 is selected and has been transmitted to the other person.
  • control display part 18 the user can see what the other person actually is viewing, that is in the present example the picture 4, and in the main display part 17 at the same time he can see the face of the other person and the reaction of the other person on the picture he has just received.
  • FIG. 6d Another example is shown in Fig. 6d, where instead of sharing pictures the user has selected the main menu E, which in the present example is the option for playing games.
  • the sub-menu 20b again is shown with different games the user can select.
  • the user has selected the game chess and therefore a chess board 21 is shown in the main display part 17.
  • a chess board 21 is shown in the main display part 17.
  • a possibility of scrolling through the menu may be a joy-stick or a special key pad having direction keys and a selection key for scrolling through the menus and selecting the actual high-lighted menu.
  • the users of mobile equipments can either create a situation like in a conference where while keeping eye contact with each other they can discuss on sketches, diagrams or the like or the users can play games and share pictures at the same time having the impression of a normal face to face conversation.
  • This solution gives the user the possibility to talk, look at pictures, play games and experience each other's face expressions in real time.
  • the user can spontaneously select content while still having eye contact. It is very easy to select content in real time and at the same time have control over what the user is actually showing to the other party.
  • the solution further is comfortable with existing video conferencing, applications, and infrastructure.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
EP04020191A 2004-08-25 2004-08-25 Elektronisches Gerät für ein drahtloses Kommunikationssystem zum Senden und Empfangen von Informationsinhalten während einer laufenden Verbindung Withdrawn EP1631102A1 (de)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP04020191A EP1631102A1 (de) 2004-08-25 2004-08-25 Elektronisches Gerät für ein drahtloses Kommunikationssystem zum Senden und Empfangen von Informationsinhalten während einer laufenden Verbindung
EP04023698A EP1631105A1 (de) 2004-08-25 2004-10-05 Elektronisches Gerät für ein drahtloses Kommunikationssystem zum Senden und Empfangen von Informationsinhalten während einer laufenden Verbindung
PCT/EP2005/009198 WO2006021444A2 (en) 2004-08-25 2005-08-25 Electronic equipment for a wireless communication system to transmit and receive information content during ongoing communication

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP04020191A EP1631102A1 (de) 2004-08-25 2004-08-25 Elektronisches Gerät für ein drahtloses Kommunikationssystem zum Senden und Empfangen von Informationsinhalten während einer laufenden Verbindung

Publications (1)

Publication Number Publication Date
EP1631102A1 true EP1631102A1 (de) 2006-03-01

Family

ID=34926302

Family Applications (1)

Application Number Title Priority Date Filing Date
EP04020191A Withdrawn EP1631102A1 (de) 2004-08-25 2004-08-25 Elektronisches Gerät für ein drahtloses Kommunikationssystem zum Senden und Empfangen von Informationsinhalten während einer laufenden Verbindung

Country Status (1)

Country Link
EP (1) EP1631102A1 (de)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0782364A2 (de) * 1995-12-29 1997-07-02 Lsi Logic Corporation Verfahren und Gerät zur dynamischen Signalbandbreitenzuordnung zwischen Audio-, Video-, und Datensignalen
GB2383723A (en) * 1998-06-03 2003-07-02 Orange Personal Comm Serv Ltd A video telephone for conferencing
US20030125018A1 (en) * 2001-12-31 2003-07-03 Cheng-Shing Lai Method and system for wireless-enabled teleconferencing with wireless data transmit and receive function

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0782364A2 (de) * 1995-12-29 1997-07-02 Lsi Logic Corporation Verfahren und Gerät zur dynamischen Signalbandbreitenzuordnung zwischen Audio-, Video-, und Datensignalen
GB2383723A (en) * 1998-06-03 2003-07-02 Orange Personal Comm Serv Ltd A video telephone for conferencing
US20030125018A1 (en) * 2001-12-31 2003-07-03 Cheng-Shing Lai Method and system for wireless-enabled teleconferencing with wireless data transmit and receive function

Similar Documents

Publication Publication Date Title
US7508413B2 (en) Video conference data transmission device and data transmission method adapted for small display of mobile terminals
US8487956B2 (en) Communication terminal, system and display method to adaptively update a displayed image
KR101880656B1 (ko) 모바일단말기, 디스플레이장치 및 그 제어방법
JP4994646B2 (ja) 通信端末および通信システム、並びに通信端末の表示方法
KR100748700B1 (ko) 화이트보드를 이용한 원격회의 시스템 및 그 방법
WO2008079505A2 (en) Method and apparatus for hybrid audio-visual communication
JP2005123804A (ja) コミュニケーションシステム及び方法
KR20070012059A (ko) 휴대단말기의 화상통화모드에서 감정표시 방법
EP1139663A2 (de) Kommunikationsverfahren, Kommunikationsdienstgerät, Kommunikationsendgerät und Kommunikationssystem
JP4352381B2 (ja) テレビ電話装置
US20040189791A1 (en) Videophone device and data transmitting/receiving method applied thereto
US7277115B2 (en) Communication terminal device capable of transmitting visage information
KR101273227B1 (ko) 이동 통신 장치용 콜센터 지원을 향상시키기 위한 장치 및 방법
WO2006021444A2 (en) Electronic equipment for a wireless communication system to transmit and receive information content during ongoing communication
EP1631105A1 (de) Elektronisches Gerät für ein drahtloses Kommunikationssystem zum Senden und Empfangen von Informationsinhalten während einer laufenden Verbindung
JPH1020997A (ja) ディスプレイ装置
US8781138B2 (en) Method for outputting background sound and mobile communication terminal using the same
EP1631102A1 (de) Elektronisches Gerät für ein drahtloses Kommunikationssystem zum Senden und Empfangen von Informationsinhalten während einer laufenden Verbindung
JP2008306558A (ja) 情報処理装置
US8140955B2 (en) Image communication portable terminal and method for carrying out image communication using the same
KR20000052141A (ko) 휴대용 정보 단말 장치
KR101392319B1 (ko) 파일 트랜스포밍 기능을 갖춘 이동통신 단말기 및 그제어방법
KR101030418B1 (ko) 미리 준비된 미디어 데이터를 전송하는 화상통화 방법
KR100584352B1 (ko) 동영상 전화장치의 영상 송,수신 제어방법
KR100570079B1 (ko) 아바타를 이용한 화상통화 방법 및 시스템

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL HR LT LV MK

AKX Designation fees paid
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20060905

REG Reference to a national code

Ref country code: DE

Ref legal event code: 8566