Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M1/00—Substation equipment, e.g. for use by subscribers
  • H04M1/02—Constructional features of telephone sets
  • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04B—TRANSMISSION
  • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
  • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
  • H04B1/3827—Portable transceivers
  • H04B1/3833—Hand-held transceivers
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M1/00—Substation equipment, e.g. for use by subscribers
  • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
  • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M1/00—Substation equipment, e.g. for use by subscribers
  • H04M1/02—Constructional features of telephone sets
  • H04M1/23—Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M2250/00—Details of telephonic subscriber devices
  • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera

Definitions

• the present invention relates generally to wireless communications devices, and particularly to camera-equipped wireless communications devices capable of Push-To-Talk functionality.
• Push-To-Talk is becoming an increasingly popular technology for wireless communications devices.
• PTT allows point-to-point or point-to-multipoint communications between users. Transmissions are half-duplex (i.e., only one person can speak at a time), and require a user to press and hold a button on the wireless communications device while speaking into a microphone. Once the user is finished speaking, the user releases the button to give other participants a chance to speak.
• PTT is a function that is most often associated with private circuit-switched radio systems.
• recent efforts have led to a set of standards that will also permit PTT services over packet-switched public mobile networks.
• PTT PTT over Cellular
• SIP Session Initiation Protocol
• a great many wireless communications devices come equipped with a digital camera.
• Camera-equipped devices permit users to capture still images and/or video and transmit them to remote parties via a wireless communications network.
• users operate the camera separately from communicative functions. That is, a user can capture an image, for example, and transmit the image to the remote party independently of a phone call.
• Some existing technologies permit users to take advantage of real-time video telephony applications. In these types of applications, users are able to converse with remote parties and send images/video simultaneously. With these technologies, communications are full-duplex, and thus, do not require the user to push and hold a PTT button. However, because conventional PTT devices require the user to activate the PTT button and the camera functionality separately, it would be difficult for users to be able to enjoy these types of services. Accordingly, a system and method that allows a user of a PTT camera- equipped device to activate the microphone and camera substantially simultaneously would be desirable.
• the present invention provides a wireless communications device having a housing, a microphone, a camera, a transceiver, a controller, and a push-to-talk actuator.
• the controller monitors an operational state of the push-to-talk actuator when the wireless communications device is placed in a push-to-talk communications mode.
• the operational states include a depressed state and a released state. Based on this operational state, the controller generates one or more control signals to control the activation and deactivation of the microphone, the camera, and the transceiver. In one embodiment, the controller detects when the push-to-talk actuator is in the depressed state.
• the controller Based on this detected state, the controller generates a first control signal to activate the microphone to capture the user's voice, and a second control signal to activate the camera to capture images and/or video.
• the transceiver then transmits the voice and image/video being captured to the remote party in a half-duplex mode.
• the user may select the operational mode of the camera, specifying whether the camera should capture a still image or a video.
• the controller Upon detecting that the push-to-talk actuator is in the released state, the controller generates additional control signals to stop the microphone and camera from capturing voice and image data, respectively.
• the controller also generates control signals to stop the transceiver from transmitting the voice and image data captured by the microphone and the camera.
• Figure 1 illustrates a block diagram of a camera-equipped PTT wireless communications device according to one embodiment of the present invention.
• Figure 2 illustrates a perspective view of a camera-equipped PTT wireless communications device according to one embodiment of the present invention.
• Figure 3 illustrates a block diagram of a communications network in which one embodiment of the present invention may operate.
• Figure 4 illustrates one embodiment of a menu displayed to the user according to one embodiment of the present invention.
• Figure 5 illustrates a method according to one embodiment of the present invention.
• Figure 1 illustrates a camera-equipped PTT wireless communications device 10 according to the present invention. While the figures illustrate device 10 in terms of a camera- equipped cellular telephone, those skilled in the art will readily appreciate that the present invention is applicable to any hand-held wireless communications device having media imaging capability including, but not limited to, Personal Digital Assistants (PDAs), cellular telephones, satellite telephones, Personal Communication Services (PCS) devices, palm computers, or the like.
• PDAs Personal Digital Assistants
• PCS Personal Communication Services
• device 10 comprises a housing 12, user interface 14, communications circuitry 16, and a camera assembly 18.
• User interface 14 includes a display 22, a keypad 24, a PTT actuator 26, a microphone 28, and a speaker 30.
• User interface 14 provides a user with the necessary elements to interact with device 10.
• Display 22 permits users to view dialed digits, call status, menu options, and service information typically associated with wireless communications.
• Display 22 also acts as a viewfinder when device 10 is in a camera mode and as a videoconferencing display when device 10 is in a videoconferencing mode.
• Keypad 24, disposed on a face of device 10, includes an alphanumeric keypad and other input controls such as a joystick, button controls, or dials. Keypad 24 allows the operator to dial numbers, enter commands, and select options from menu systems, as well as permit the user to control the functionality of camera assembly 18. For example, the user may employ designated keys or other controls on keypad 24 to focus camera assembly 18, or store captured images and/or video to memory in device 10.
• PTT actuator 26 comprises a spring-loaded actuator, for example, that the user depresses when the user desires to speak to a remote party.
• depressing the PTT actuator 26 causes controller 32 to send a request for a floor grant to the wireless communications network. If the request is granted, controller 32 may render an audible alert, for example, a "beep" or a series of "beeps," and enable microphone 28. Once microphone 28 is enabled, the user may speak to the remote party. According to the present invention, however, depressing PTT actuator 26 will activate camera assembly 18 such that both voice and image/video data may be transmitted to the remote party.
• Microphone 28 converts the user's speech into electrical audio signals
• speaker 30 converts audio signals into audible sounds that can be heard by the user.
• Microphone 28 and speaker 30 may be any type of audio transducer known in the art, and are usually disposed on the housing 12 of device 10, although this is not required.
• microphone 28 is enabled whenever the user depresses and holds PTT actuator 26, provided the user is granted the floor. When the user releases the PTT actuator 26, the microphone 28 is disabled.
• Communications circuitry 16 comprises a controller 32, memory 34, an audio processing circuit 36, and a long-range transceiver 38 having an antenna 40.
• Memory 34 represents the entire hierarchy of memory in device 10, and may include both random access memory (RAM) and read-only memory (ROM).
• Computer program instructions and data required for operation of device 10 are stored in non ⁇ volatile memory, such as EPROM, EEPROM, and/or flash memory, and may be implemented as discrete devices, stacked devices, or integrated with controller 32.
• Controller 32 controls the operation of device 10 according to programs stored in memory 34, and may use known techniques to digitally alter images captured by camera assembly 18.
• the control functions may be implemented, for example, in a single microprocessor, or in multiple microprocessors. Suitable microprocessors may include, for example, both general purpose and special purpose microprocessors and digital signal processors.
• Controller 32 may interface with audio processing circuit 36, which provides basic analog output signals to speaker 30 and receives analog audio inputs from microphone 28. As described in more detail below, controller 32 may also generate control signals to control the operation of camera assembly 18, microphone 28, and transceiver 38 responsive to the user depressing PTT actuator 26.
• Transceiver 38 is coupled to antenna 40 for receiving and transmitting cellular signals from and to one or more base stations in a wireless communications network.
• Transceiver 38 is a fully functional cellular radio transceiver, and operates according to any known standard, including but not limited to Global System for Mobile Communications (GSM), TIA/EIA-136, cdmaOne, cdma2000, UMTS, and Wideband CDMA.
• GSM Global System for Mobile Communications
• TIA/EIA-136 TIA/EIA-136
• cdmaOne cdma2000
• UMTS Universal Mobile Communications
• Wideband CDMA Wideband CDMA
• Transceiver 38 preferably includes baseband-processing circuits to process signals transmitted and received by the transceiver 38. Alternatively, the baseband-processing circuits may be incorporated in the controller 32.
• transceiver 38 uses an access independent session control protocol (SCP), such as SIP, to support signaling for multi-media applications.
• Camera assembly 18 includes a camera and graphics interface 42, a camera 46, and an optional integrated flash device 44.
• Camera assembly 18 may be any camera assembly known in the art, and may further include such elements as a lens assembly (not shown), an image sensor (not shown), and an image processor (not shown).
• Camera and graphics interface 42 interfaces camera assembly 18 with controller 32.
• an image processor (not shown) may be interposed between camera and graphics interface 42 and camera 46 and/or flash device 44 to control camera 46 and/or flash device 44 and process images. While the camera and graphics interface 42 are shown as separate components in Figure 1, it should be understood that camera and graphics interface 42 might be incorporated with the image processor or controller 32.
• Camera assembly 18 captures images that can be digitized and stored in memory 34, digitally altered by controller 32, output to display 22, or transmitted over a wireless network via transceiver 38. Camera assembly 18 may be used to capture still images, video, or both. Flash device 44 emits a flash of light to illuminate, if required, the subject of the image being captured. Flash device 44 may be integrated with device 10, or alternatively, may be a peripheral device coupled to device 10 via a system interface port (not show) typically provided with wireless communications devices. It should be noted that both flash device 44 and camera assembly 18 are responsive to control signals generated by controller 32 whenever the user depresses PTT actuator 26.
• Figure 2 illustrates the physical appearance of an exemplary wireless communications device 10.
• the housing 12 of device 10 includes keypad 24, display 22, microphone 28, and speaker 30.
• the keypad and joystick control serve as user input 18, and are disposed on a face of housing 12.
• PTT actuator 26 which in Figure 2 is a button, is disposed on a side of the housing 12.
• a user wishing to communicate in a PTT (i.e., half-duplex) mode simply depresses PTT actuator 26 and speaks into microphone 28. When the user is finished transmitting, the user releases PTT actuator 26.
• PTT i.e., half-duplex
• PoC is a set of standards that define PTT functionality over cellular networks, and is intended for use over a packet switched network.
• the present invention may also be employed over these networks.
• the present invention is not limited to these networks, and may also be used over UTMS and CDMA packet switched networks, as well as circuit-switched PTT networks.
• Figure 3 illustrates the functional elements of one embodiment of a network 50 in which the device 10 of the present invention may operate.
• Network 50 comprises a packet-switched network 60 to communicate with one or more devices 10 and a core network 70.
• core network 60 may connect to a public or private IP network 80.
• Packet switched network 60 comprises a Base Station Subsystem (BSS) 62 having one or more Base Transceiver Stations (BTS) 64, and a Base Station Controller (BSC) 66.
• BSS Base Transceiver Stations
• BSC Base Station Controller
• BTS Base Transceiver Stations
• the BTS 64 contains radio transmission and reception equipment, up to and including the antennas 68, and includes the signal processing specific to the radio interface.
• the BSC 66 connects the BTS 64 with the core network 70, and performs most of the management and control functions of the BSS 62, for example, resource allocation and handover management.
• BSC 66 may also connect to other components not explicitly shown in the figures, such as a Serving GPRS Support Node (SGSN), a Gateway GPRS Support Node (GGSN), a Home Location Register (HLR), and a Serving Mobile Location Center (SMLC).
• SGSN Serving GPRS Support Node
• GGSN Gateway GPRS Support Node
• HLR Home Location Register
• SMLC Serving Mobile Location Center
• Core network 70 is an embodiment of a PoC network as described in the technical specification "Push-to-talk over Cellular (PoC); Architecture; PoC Release 2.0 (V2.0.8)” published jointly by Comneon, Ericsson, Motorola, Nokia, and Siemens.
• Core network 70 communicates with BSC 66, and comprises a PoC server 72 and a Group List Management Server (GLMS) 74.
• GLMS Group List Management Server
• Core network 70 provides IP connectivity to devices 10, and provides authentication and authorization services to devices 10.
• Core network 70 also routes SIP signaling messages, for example, call set-up messages, between devices 10 and PoC server 72.
• core network 70 may also include one or more proxy servers, such as SIP proxies and/or SIP registrars, to route SIP signaling messages between devices 10 and PoC server 72.
• the PoC server 72 is a network entity that provides services needed for PoC functionality, such as
• the PoC server 72 may function as a participating PoC server 72 or a controlling PoC server 72.
• the PoC server 72 is an endpoint for SIP, RTP (Real-Time Transport Protocol) and RTCP (Real Time Transport Control Protocol) signaling.
• SIP is the protocol used for signaling to establish, modify and terminate communication sessions.
• RTP is the protocol used to transport voice packets
• RTCP is the protocol used to perform floor control during PTT sessions.
• RTCP is described in the IETF standard RFC 3550.
• the GLMS 74 is responsible for managing group lists, contact lists, and access lists associated with each device 10.
• a group list is a list of PTT groups to which a user belongs. Each PTT group comprises a collection of PoC user identities defined by a user creating the group. The user creating the group is the group owner and may modify or delete the group. The group is assigned an SIP address that serves as the group identifier.
• the contact list is a kind of address book accessible by devices 10 including addresses for other users or groups. Access lists define access restrictions for each device 10.
• a user wishing to communicate using device 10 of the present invention initially launches a PTT application stored in memory 34 of device 10. As seen in Figure 4, the user may do this by simply selecting a menu option. As part of launching the PTT application, device 10 may prompt the user to select either a "STILL IMAGE CAPTURE," or a "VIDEO CAPTURE.” Based on this selection, controller 32 may generate control signals to prepare camera assembly 18 for the selected option. Controller 32 may use this information to determine whether the remote parties have devices that are capable of receiving image and/or video data. Once the user selects the type of call to be made (e.g., still image or video), the user selects one or more remote parties to invite to the call.
• the type of call to be made e.g., still image or video
• PTT actuator 26 Once the PTT session is established, the user depresses PTT actuator 26 and speaks into the microphone 28, as is conventional. In addition, however, depressing PTT actuator 26 also causes camera assembly 18 to capture the still image or video as specified by the user, provided the remote parties have the capability to receive the image/video stream.
• FIG. 5 illustrates a method according to one embodiment of the present invention.
• the method begins when the user of device 10 launches the PTT application (box 90). The user then selects whether to send still images or video with his or her voice (box 92). Upon selection, controller 32 may generate control signals that enable camera assembly 18, or prepare camera assembly 18, to capture images/video according to the user's selection. The user then selects one or more remote parties with which to communicate, as previously described (box 94). A PTT session is then established with the selected one or more remote parties (box 96). As is known in the art, SIP may be used for the signaling to establish the PTT session; however, any suitable signaling protocol may also be used.
• controller 32 detects when the user has depressed PTT actuator 26 (box 98). If controller 32 has determined that the user has depressed PTT actuator 26, controller 32 causes transceiver 38 to send a message to PoC server 72 to request a control of the floor (box 100).
• all users on a PTT session i.e., half-duplex communications
• the process that determines which party gets to communicate is called "floor control.” The user that gets control of the floor receives a "floor grant,” and is permitted to speak while the other users on the call must listen.
• controller 32 When the user of device 10 receives control of the floor, controller 32 will generate a control signal to cause camera assembly 18 to capture image/video as previously specified by the user (box 102). In addition, controller 32 also generates a control signal that enables microphone 28 to capture the user's voice (box 104). It should be understood that controller 32 may trigger the microphone 28 and camera assembly 18 together using a single generated control signal, or separately using multiple control signals.
• Transceiver 38 then transmits the captured image/video and the user's voice (box 106) to the selected remote parties, while controller 32 monitors the PTT actuator 26 to determine when the user releases it (box 108). Transceiver 38 will transmit the captured image/video so long as the user keeps the PTT actuator 26 depressed.
• controller 32 may generate one or more control signals that deactivate camera assembly 18, microphone 28, and transceiver 38 (box 110). Alternatively, controller 32 may simply stop sending the one or more control signals used to activate camera assembly 18, microphone 28, and transceiver 38.
• controller 32 may generate a control signal that causes camera assembly 18 to capture a still image of the user. This image can then be transmitted as part of the initial INVITE SIP message to the selected remote party, and displayed on the remote party's display as a type of caller ID. If the remote party accepts the invitation, controller 32 can then generate one or more control signals to capture video for transmission to the remote parties as previously described. In addition, this still image captured by the camera could be used to update remote party's address book. In this manner, users throughout the network are assured of having the "latest" image of any other user.
• controller 32 generates the control signals that cause camera assembly 18 to capture images/video after the requesting user has been granted control of the floor.
• controller 32 generates the control signal to camera assembly 18 to capture images/video before requesting the floor control grant from the PoC server 72. This might cause camera assembly 18 to begin capturing images/video early, but would minimize transmission delays upon receiving the floor grant.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Computer Networks & Wireless Communication (AREA)
• Human Computer Interaction (AREA)
• Telephonic Communication Services (AREA)
• Mobile Radio Communication Systems (AREA)
• Studio Devices (AREA)
• Telephone Function (AREA)

Priority Applications (3)

Applications Claiming Priority (2)

Publications (1)

Family

ID=35613849

Family Applications (1)

Country Status (6)

Cited By (1)

Families Citing this family (30)

Citations (5)

Family Cites Families (13)

• 2004
  • 2004-11-19 US US10/993,067 patent/US20060114314A1/en not_active Abandoned
• 2005
  • 2005-10-20 EP EP05815571A patent/EP1825599B1/en not_active Expired - Lifetime
  • 2005-10-20 JP JP2007543062A patent/JP2008521344A/ja not_active Ceased
  • 2005-10-20 DE DE602005012730T patent/DE602005012730D1/de not_active Expired - Lifetime
  • 2005-10-20 CN CNA2005800469070A patent/CN101103542A/zh active Pending
  • 2005-10-20 WO PCT/US2005/037903 patent/WO2006055172A1/en not_active Ceased

Patent Citations (5)

Also Published As

Similar Documents

Legal Events