JP2010502134A - Method and apparatus for controlling a display in an electronic device - Google Patents

Abstract

A novel method and apparatus for controlling a display of an electronic device is provided. In one embodiment, the device is a portable electronic device having a combined wireless email and wireless telephone mechanism. The portable electronic device also includes a camera. The device includes a trackball that can be used to control the image shown in the viewfinder when the device is used as a camera. The device also includes a processor that interconnects the trackball, photosensitive transducer, display, persistent storage device, and volatile storage device, the processor receiving rotational input from the trackball and transmitting the rotational input Depending on the direction, it is configured to enlarge or reduce the image on the viewfinder.

Description

(Field)
The present disclosure relates generally to electronic devices, and more particularly to an apparatus and method for controlling a display in an electronic device.

(background)
Portable electronic devices are becoming smaller and incorporating more functions. It is well known to incorporate the functionality of a conventional personal digital assistant ("PDA") with wireless e-mail capability into a single device, and Blackberry ^TM by Research in Motion in Waterloo, Canada is an example. It is also well known to incorporate wireless audio functionality, music players and video players into portable electronic devices.

  As more features and functions are incorporated into portable electronic devices, it is very difficult to configure device controls and displays to maximize usability. Cameras are increasingly being incorporated into portable electronic devices, which presents unique challenges to enhancing device usability.

In fact, the input device on the device should serve multiple purposes so as to improve the usability of the device and maintain the small form factor desired to ensure portability. For example, the Blackberry ^™ 7100 portable electronic device, and its predecessor, includes a track wheel positioned on the side of the portable electronic device. The trackwheel can be actuated by the thumb while the user is holding the device and looking at the display of the device, and can be pushed inward to scroll through menus and make menu selections. One skilled in the art recognizes that a track wheel can be a versatile input device that is very useful for portable electronic devices.

  However, trackwheels become a problem when incorporating cameras in portable electronic devices. This is because the lens for the camera is generally located behind the portable electronic device. When the user grips the portable electronic device and orients the thumb to operate the track wheel, the user's index finger may cover the camera lens. This is because the person holds the portable electronic device. In fact, those skilled in the art will recognize that the conventional form factor for cameras is fundamentally different from the form factor for cellular phones or personal digital assistants. This is because conventional camera form factors are designed for usability when associated with taking photographic images, whereas cellular phones or personal digital assistants form factors are either telephony or text-based. This is because it is designed for usability to interact with the display.

  Another aspect of the prior art is that camera functionality mechanisms such as zoom on / off, flash on / off, etc. are generally via separate physical buttons that are uniquely dedicated to that particular camera function. In the prior art camera, it is activated. However, in a portable electronic device with which primary functions (eg, telephone calls and email) are communicating, the device does not have a dedicated button as a primary input for the camera function. Therefore, it is important to use existing keys and controllers on the device for camera functions. However, the use of such a key should be intuitive for the user.

  Although it is known to couple camera mechanisms in cellular phones and / or personal digital assistants, the usability of prior art devices is still regrettable.

(Overview)
One aspect provides a method for controlling a display of a portable electronic device having a camera function. The portable electronic device includes a light sensitive transducer for receiving a first image and a trackball for use as a user input device. The method
Setting a default zoom level;
Activating a viewfinder by generating a second image corresponding to the image on the display, the second image having a field of view corresponding to the default zoom level;
Receiving a rotational input from the trackball, wherein the input represents an indication of either zooming in or out of the field of view;
Adjusting the zoom level based on whether the indication indicates zooming in or zooming out;
Regenerating the second image on the viewfinder with a field of view enlarged or reduced according to the zoom level from the adjusting step.

  The device may include at least one additional function in addition to the camera function, and the method may further include receiving a request to launch a camera application prior to the setting step.

  The at least one additional function may include at least one of a wireless phone, wireless email, and wireless instant messaging.

  A trackball rotation input in a first direction may represent zooming in, and a trackball rotation input in a second direction opposite to the first direction may represent zooming out. In any case, the trackball can be rotated in any direction.

  The method may further include receiving input from the trackball corresponding to the trackball being depressed and capturing an image corresponding to the image on the viewfinder according to the zoom level.

  The method may further include generating an icon image of the trackball on the display corresponding to whether the trackball is in a stationary position or a rotational position.

  The stationary position may correspond to a zoom at any one of a minimum zoom level, an intermediate zoom level, and a maximum zoom level, and the method generates one of three icon images. A step may further be included.

  An icon corresponding to the minimum zoom level may indicate that only zooming in is available. An icon corresponding to the intermediate level may indicate that both zooming in and zooming out are available. The icon corresponding to the maximum zoom level may indicate that only zooming out is available.

  The device may include a phone application or an instant messaging application, the method overlaying and displaying a notification screen on the finder indicating that an incoming communication is being received via the application. Can further be included.

  The notification screen may include an identifier of the incoming communication caller, which may include a picture of the caller, or may include a graphic representing the caller instead of a picture.

  The notification screen may include an ignore field and a field to accept. When the notification screen is first activated, the ignore field can be highlighted by default.

  Another aspect provides a portable electronic device comprising a processor that interconnects a trackball, a photosensitive transducer, a display, a persistent storage device, and a volatile storage device. The processor may be configured to generate a viewfinder on the display. The viewfinder reproduces an image received in real time via the photosensitive transducer in real time. The processor is further configured to receive rotational input via a trackball and to enlarge or reduce the image on the viewfinder depending on the direction of the rotational input.

  The photosensitive transducer may be an array of charge coupled devices (“CCD”).

  The processor receives a signal corresponding to the trackball being depressed and, in response, captures at least a portion of the image received by the photosensitive transducer for storage on the persistent storage device. Can be configured to. The field of view of the captured image corresponds to the field of view of the image on the viewfinder.

  A rotation input in a first direction may represent zooming in, and a rotation input in a second direction opposite to the first direction may represent zooming out.

  The processor of the device may be further configured to generate an icon image of the trackball corresponding to whether the trackball is in a stationary position or a rotational position on the display in cooperation with the viewfinder.

  The rest position may correspond to a zoom at any one of a minimum zoom level, an intermediate zoom level, and a maximum zoom level.

  The processor may be configured to generate three icons corresponding to the rest position. The first icon of the plurality of icons corresponds to a minimum zoom level and may indicate that only zooming in is available. A second icon of the plurality of icons corresponding to an intermediate level may indicate that both zooming in and zooming out are available. A third icon of the plurality of icons corresponding to the maximum zoom level may indicate that only zooming out is available.

  The device may include a telephone application or an instant messaging application. The processor may be further configured to generate a notification screen on the finder indicating that an incoming communication is being received via the telephone application or the instant messaging application. The notification screen may include an identifier of the caller of the incoming communication, and the identifier may include a picture of the caller. The notification screen may include fields to ignore and fields to accept. In one embodiment, the ignore field is highlighted by default.

  Another aspect provides a computer-readable medium for storing a set of programming instructions according to any of the above.

  A novel method and apparatus for controlling a display of an electronic device is provided. In one embodiment, the device is a portable electronic device having a combined wireless email and telephone mechanism. The portable electronic device also includes a camera. The device includes a trackball that can be used to control the image shown in the viewfinder when the device is used as a camera. In other embodiments, the trackball can be replaced with a touchpad.

FIG. 1 is a schematic front view of a portable electronic device according to one embodiment. FIG. 2 is a schematic view of the back surface of the portable electronic device of FIG. FIG. 3 is an isometric exploded view of certain components of the device of FIG. FIG. 4 shows the trackball of the device of FIG. 1 in more detail and in three modes of operation. FIG. 5 is a block diagram of certain internal components of the device of FIG. FIG. 6 is a flowchart depicting a method for controlling a display of a portable electronic device according to another embodiment. FIG. 7 shows the device of FIG. 1 in relation to the subject being imaged. FIG. 8 shows the object of FIG. 7 through the viewfinder of the device of FIG. FIG. 9 illustrates control of the display of the device of FIG. 7 during execution of a portion of the zoom-in function. FIG. 10 illustrates control of the display of the device of FIG. 7 during execution of a portion of the zoom out function. FIG. 11 shows control of the display of the device of FIG. 7 at the end of performing the zoom-in function. FIG. 12 shows control of the display of the device of FIG. 7 at the end of performing the zoom out function. FIG. 13 shows a preview screen that may be generated according to another embodiment. FIG. 14 illustrates a crop selection screen that may be generated according to another embodiment. FIG. 15 shows the trimming selection screen of FIG. 14, but the selection window is moved. FIG. 16 shows an incoming call screen according to another embodiment.

  Simply exemplary embodiments will now be discussed with reference to the accompanying drawings.

(Detailed description of embodiment)
Referring now to FIG. 1, a front view of a portable electronic device according to one embodiment is indicated generally at 30. In this embodiment, device 30 includes the functionality of a wireless telephone, a wireless email paging device, and a digital camera.

  As best shown in FIG. 1, the device 30 includes a housing 34 that frames a plurality of input devices in the form of a keyboard 38, a set of soft keys 42, a trackball 46 and a microphone 50. The housing 34 also frames a plurality of output devices in the form of a display 54 and speakers 58.

  Thus, a user of device 30 can interact with input and output devices, send and receive emails, make voice phone calls, manage appointments and contacts, browse the Internet, and device 30 etc. Perform such other functions that may be found on known or undeveloped electronic devices.

Device 30 has been simplified for purposes of illustration, and in other embodiments, device 30 may include additional functions and / or applications, and / or various functions and / or applications, accordingly. It should be understood to include input devices and output devices. Such other functionality may include music playback, audio recording and video playback. Examples of coupled input / output devices include a universal serial bus (“USB”) port, a headset jack that connects a hands-free headset to the device 30, or a Bluetooth ^™ (or equivalent technology) transceiver. Yes. Similarly, it will be understood from the teachings herein that certain functions included in device 30 may be omitted.

  In this embodiment, device 30 also includes a camera. Referring now to FIG. 2, a rear view of device 30 is shown. Thus, the device 30 also includes an additional input device in the form of a camera lens / photosensitive transducer 62 and an additional output device in the form of a flash 66. One skilled in the art will recognize that the photosensitive transducer 62 may be implemented as a plurality of photosensitive transducers with each transducer placed in an array corresponding to a pixel. An example of a known photosensitive transducer includes a charge coupled device (CCD) that actually creates an electronic signal of an image received via the camera's photosensitive transducer.

  At this point, in this embodiment, the form factor of the device 30 allows the user to grip the device 30 with either the left hand or the right hand and activate the soft key 42 and the trackball 46 with the thumb. It can be pointed out that it is built. (It should be understood that although the trackball 46 is configured for the thumb, the user can also use other fingers in his hand). Similarly, the lens and photosensitive transducer 62 is behind the display 54 so that when the user's index finger is wrapped around the device 30, it does not obscure the lens and thus prevent the use of the device 30 as a camera. Placed in. The positioning of the photosensitive transducer 62 behind the display 54 also improves the usability of the display 54 as a viewfinder when the device 30 operates as a camera. This is because the display 54 presents the scenery immediately behind the display 54 to the user.

  Referring now to FIG. 3, the keyboard 38, soft keys 42, trackball 46, and a portion of the housing 34 (which forms the framework of the display 54) are shown in more detail. In this embodiment, the keyboard 38 is a reduced QWERTY style keyboard so that the width of the device 30 allows the device 30 to be grasped with one hand. However, other keyboard arrangements and configurations are contemplated. Note that the trackball 46 and softkeys 42 are placed below the display 54 and above the keyboard 38. The trackball 46 is disposed between the soft keys 42. The trackball 46 and softkeys 42 are arranged so that their functions can change according to the context of the application or data presented on the display 54. The soft keys 42 are particularly positioned so that the functions associated with those soft keys can be properly presented on the display 54 at a position that intuitively corresponds to the position of the particular soft key 42.

  Also shown in FIG. 3 is a transducer housing 70 that holds a trackball 46 and presents a cavity that allows the trackball 46 to freely rotate inside. As discussed further below, the trackball 46 can be moved in any direction to provide user input. The rotation of the trackball 46 is sensed by a transducer in the transducer housing 70. The trackball 46 may also be depressed inward, thereby providing input in substantially the same manner as the soft keys 42 and any other keys on the keyboard 38. Also included in FIG. 3 is a skirt 74 that is mounted on the transducer housing 70 around the periphery of the trackball 46.

  Referring now to FIG. 4, the trackball 46, transducer housing 70 and skirt 74 are shown in more detail in three different modes of operation. In mode A, the user's thumb T is moving in the direction of arrow F, which causes the trackball 46 to rotate in the direction of arrow F1. From now on, direction F1 will be referred to as forward direction F1. In mode B, the thumb T is moving in the direction of the arrow R, which rotates the trackball in the direction of the arrow R1 (the direction opposite to the forward direction F1). From now on, direction R1 will be referred to as reverse direction R1. In mode C, the thumb T is shown moving in the direction of arrow D toward the skirt 74, thereby depressing the trackball 46 and pushing the trackball 46 in the direction of arrow D1. From now on, direction D1 will be referred to as push-down direction D1. The person skilled in the art now recognizes that the depression direction D1 is substantially the same as the effect on the key when the thumb T depresses the key on the keyboard 38.

  It will be appreciated that mode A and mode B are essentially in opposite directions. It will also be appreciated that the trackball 46 can be moved in any direction and is not limited to the directions shown in Mode A and Mode B. Mode A and Mode B, and similar rotation of the trackball 46, move the cursor on the display 54, scroll the content displayed on the display 54, browse the content, or dialog box Can be used to change the focus within. Similarly, it will be appreciated that mode C can be used to make a final selection of the content displayed on display 54.

  For this embodiment, the depth of the skirt 74 and the taper that slopes inward toward the trackball 46 are selected to fit the shape of the thumb T so that the trackball 46 is in mode A and mode B. Note that the thumb T does not touch the skirt 74 between Mode A and Mode B by keeping the trackball 46 in a relatively exposed position when rotated at. However, the depth of the skirt 74 also causes the exposed edge of the skirt to engage the thumb T during mode C when the thumb T moves in the push-down direction D1, resulting in friction on the thumb T. Introduces and is selected to reduce the likelihood that the user will inadvertently rotate the trackball 46 while the user actually attempts to push the trackball 46 down through Mode C. This aspect is further discussed below.

  Referring now to FIG. 5, a block diagram representing certain internal components of device 30 is shown. Thus, device 30 includes processor 78, which includes input devices of device 30 (ie, trackball 46, softkey 42, keyboard 38, camera photosensitive transducer 62 and microphone 50) and device 30. Output devices (ie, speaker 58, display 54, and flash 66). The processor 78 is also connected to the persistent storage device 82. (Persistent storage device 82 may be implemented using flash memory or the like and / or may include other programmable read-only memory (PROM) technology, and / or may include read-only memory (ROM) technology, and And / or a removable “smart card” and / or a combination of the above). The device 30 also includes a wireless communicator 86 disposed within the housing 34, which wirelessly connects to one of the network's base stations to provide wireless email, phone and web for the device 30. Provides browsing functionality.

  The device 30 also typically includes a rechargeable battery 90 to provide power to the components of the device 30. In the exemplary embodiment only, battery 90 is a lithium battery having an operating voltage between a minimum of about 3.0 volts and a maximum of about 42 volts. In FIG. 5, for simplicity, the battery 90 is shown connected only to the processor 78, but the battery 90 may be any component within the device 30 that requires power to operate (eg, the photosensitive transducer 62). Connected to a CCD, a wireless communicator 88, a display 54 and a flash 66).

  Device 30 also includes volatile storage 94, which can be implemented as random access memory (RAM) and is used to temporarily store applications and data when used by processor 78. obtain.

  Referring now to FIG. 6, a method for controlling a display in an electronic device is represented by a flowchart and is generally designated 300. To assist in understanding method 300, method 300 will be described with respect to the operation of the method using device 30 in the context of trackball 46. However, it should be understood that this discussion is not to be construed in a limiting sense, and that method 300 may be performed on devices other than device 30, and / or that method 300 may be modified.

  Beginning at step 310, a camera application request is received. On device 30, this step may be performed according to the menu screen of FIG. 7, which presents many applications to the user of device 30. The user can rotate the trackball 46 to scroll through the various applications until the camera application is highlighted. Once highlighted, the user can depress the trackball 46 to actually request a camera application. A user may select a camera application to capture a digital image of subject S. If the processor 78 receives input via the trackball 46 that the user desires to use the camera application, the method 300 proceeds from step 310 to step 315.

  Next, in step 315 and step 320, the viewfinder is activated at the default zoom level.

  For device 30, the term “finder” refers to a digital finder implemented as a software application that is executed by processor 78 in conjunction with transducer 62 and display 54. This software application mimics the functionality of an optical viewfinder used on conventional cameras. However, the teachings herein may be applied to optical viewfinders used on conventional cameras and / or cameras having both optical and digital viewfinders.

  Note also that for device 30, the term "zoom" refers to digital zoom. The zoom is a zoom effect performed via a software application running on the processor 78. The software application processes the image received from transducer 62 and generates a corresponding image on display 54 in a manner known to those skilled in the art. However, it should also be understood that the method 300 is applicable to devices that utilize “optical zoom” where the zoom effect is performed through movement of the camera lens. Accordingly, the teachings herein apply to digital zoom, optical zoom, and combinations thereof.

  Between step 310 and step 315, it is recognized that the function of the trackball 46 changes immediately from a navigation input device to a zoom control input device, at least from the user's perspective. Thus, during the remainder of the operation of method 300, the behavior of device 30 mimics a prior art camera with a dedicated input device (ie, trackball 46) for controlling the zoom level, and thus the user experience. (Experience) is substantially similar to the experience when the user operates a prior art camera.

  In the present embodiment, the default zoom level is set to 2.6x (2.6 times). Steps 315 and 320 are represented in FIG. 8, where the display 54 is shown presenting the viewfinder 100. The viewfinder 100 is implemented by configuring the processor 78 to receive an image of the subject S via the photosensitive transducer 62 and then generate a display of that image on the display 54. In this embodiment, the size of the object S on the viewfinder 100 corresponds to a 2.6x zoom level, and therefore the entire object S is not shown occupying the range of the viewfinder on the display 54. .

  In addition to viewfinder 100, processor 78 is also configured to control display 54 and presents status bar 104 on display 54. The status bar 104 includes a zoom level indicator 108 and a flash icon 112. Accordingly, the zoom level indicator 108 is shown in FIG. 8 together with the value “2.6x” indicating the zoom level. The flash icon 112, when active, indicates that the flash 66 will fire when an actual picture is taken. The status bar 104 also includes a picture count indicator 116 that shows the number of pictures that can be taken and stored in the memory of the device 30. The status bar 104 also includes a shutter control indicator 120.

  A shutter control indicator 120 is drawn on the display 54 in-line with the trackball 46 to indicate that the operation of the trackball 46 controls the operation of the camera. The shutter control indicator 116 includes an icon in the form of a camera picture in the center, and if the user depresses the trackball 46 in a manner corresponding to mode C, then the subject picture in the viewfinder 100 is taken and stored. Represents what is being done.

  The shutter control indicator 120 is also drawn as a solid circle in a hollow circle so that rotation of the trackball 46 in a manner corresponding to mode A or mode B (or similar mode) zooms in on the object S. Or the control of the camera to zoom out from the object S. The shutter control indicator 120 is placed substantially at the intersection of the horizontal and vertical midlines of the status bar 104. This position represents that the trackball 46 is stationary and not rotating. It will be appreciated that the appearance of the shutter control indicator 120 mimics the overall appearance of the trackball 46 and, as a result, shows the function of the trackball 46 intuitively with respect to the camera.

  Next, in step 325, a determination is made as to whether the trackball is rotating. If not, the method 300 proceeds to step 330 where a determination is made as to whether the trackball 46 is depressed. If “not depressed”, method 300 proceeds from step 330 to step 335 where a determination is made as to whether to continue the camera function. A “no” determination may be made at step 335 for various reasons. For example, an incoming call may cause the camera function to be automatically interrupted for an application on the device 30 that manages the incoming call. Alternatively, the user of device 30 may use soft key 42 or keyboard 38 to enter a command indicating that the user has desired to exit the camera application.

  However, returning to step 330, if the trackball 46 is depressed in a manner corresponding to mode C, the method 300 proceeds from step 330 to step 345 where the object appears when it appears in the viewfinder 100. Images are captured.

  However, returning to step 325, if the trackball 46 is being rotated, the method 300 proceeds from step 325 to step 350. In step 350, a determination is made as to whether the rotation of the trackball 46 indicated a “zoom in” instruction. In this embodiment, if the trackball 46 is rotated in a manner corresponding to mode A, a “yes” determination is made at step 350, and thus the direction F is toward the shutter control indicator 120. In other words, if the direction that can be rotated by the trackball 46 corresponds to the main orientation of the compass, then “yes” if the trackball is rotated in the “north” direction (as shown in FIG. 8). Is made. (Alternatively or additionally, if the trackball 46 is rotated in the “east” direction, a “yes” determination may be made at step 350).

  If the determination in step 350 is “no”, a determination is made in step 360 as to whether the rotation of the trackball 46 indicated a “zoom out” instruction. In this embodiment, when the trackball 46 is rotated in a manner corresponding to mode A, a “yes” determination is made at step 350, and thus the direction R is toward the keyboard 38. In other words, if the direction that can be rotated by the trackball 46 corresponds to the main orientation of the compass, a “yes” determination is made if the trackball is rotated in the “south” direction. (Alternatively or additionally, if the trackball 46 is rotated in the “west” direction, a “yes” determination may be made at step 350).

  Steps 355 and 365 are therefore reserved for performing the actual zoom-in function or zoom-out function, respectively. As the first part of step 355, when the trackball is rotated in the north direction, the shutter control indicator 120 changes in appearance and appears in the form of an icon 120a as shown in FIG. A shutter control icon 120 a appears in the status bar 104 at a position above the horizontal center line of the status bar 104. Icon 120a indicates to the user that an input for a trackball being rotated in the “north” direction has been received. The icon 120a also features a bulge at the top of the outer perimeter, where the line thickness at the bulge is greater than the thickness of the line at the bottom of the outer perimeter. In addition, a “plus” sign appears on the icon 120a, indicating that a command to “zoom in” has been received.

  Similarly, as the first part of step 365, when the trackball is rotated in the south direction, the shutter control indicator 120 changes in appearance and appears in the form of an icon 120b as shown in FIG. The shutter control icon 120b appears in the status bar 104 at a position below the horizontal center line of the status bar 104. Icon 120b indicates to the user that an input for a trackball being rotated in the “south” direction has been received. Icon 120b also features a bulge at the bottom of the outer perimeter, where the line thickness at the bulge is greater than the thickness of the top line at the outer perimeter. Furthermore, a “minus” sign appears on the icon 120b, indicating that a command to “zoom out” has been received.

  The end of the zoom-in at step 355 (and extended by returning to step 320) is represented in FIG. In FIG. 11, the zoom level indicator indicates “5x” here, and the magnification is the maximum level at which the device 30 is zoomed in in this embodiment. Accordingly, the object S appears to be closer in the viewfinder 100. Here, the icon 120c appears at the intersection of the horizontal and vertical midlines of the status bar 104. The position of the icon 120c indicates that the trackball 46 is currently stationary. The icon 120c looks otherwise the same as the icon 120, except that the icon 120c includes a “minus” sign at the bottom. The “minus” sign indicates that it is not possible to “zoom in” further, and “zoom out” is the only option here. If the user attempts to continue “zooming in”, optionally, the processor 78 is configured to draw an icon 120c that appears above the horizontal midline of the status bar 104 (at the same location as the icon 120a). Although getting, further zooming in doesn't really happen. Instead, a “minus” sign indicator that indicates that it is not possible to zoom in further remains as a visual cue to the user. For further assistance, the user may investigate a zoom level indicator 108 that informs the user of the current zoom level. The user may verify that the zoom level does not change while the icon 120 changes in appearance during the rotation of the trackball 46. The user is thus provided by visual feedback that the device 30 is receiving input but cannot respond because the extreme zoom level has been reached.

  Similarly, the end of zoom-out in step 365 (and extended by returning to step 320) is represented in FIG. In FIG. 12, the zoom level indicator indicates “1x” here, and the magnification is the minimum level of zoom for the device 30 in this embodiment. Accordingly, the object S appears farther away in the viewfinder 100. Here, the icon 120d appears at the intersection of the horizontal and vertical midlines of the status bar 104. The position of the icon 120d indicates that the trackball 46 is currently stationary. The icon 120d looks otherwise the same as the icon 120, except that the icon 120c includes a “plus” sign at the top. The “plus” sign indicates that it is not possible to “zoom out” further, and that “zoom in” is the only option here. If the user attempts to continue “zoom out”, optionally, the processor 78 is configured to draw an icon 120d that appears below the horizontal midline of the status bar 104 (at the same position as the icon 120b). Although it can be done, further zooming in does not actually happen. Instead, a “plus” sign indicator that indicates that further zoom-out is not possible remains as a visual cue to the user. Again, for further assistance, the user may examine the zoom level indicator 108. The user may verify that the zoom level does not change while the icon 120 changes in appearance during the rotation of the trackball 46. The user is thus provided by visual feedback that the device 30 is receiving input but cannot respond because the extreme zoom level has been reached.

  While the above embodiment contemplates three levels of zoom, it should be understood that any number of zoom levels may be implemented as desired. However, in this embodiment, it has been determined that three levels achieve a high degree of usability. The above embodiment also provides for a given rotation of the trackball 46 so that one zoom level (either zoomed in or zoomed out) does not accidentally move directly from 1x to 5x. This is not essential. This aspect of the embodiment may be understood by referring back to FIG. 4, where, in order to achieve a “yes” determination in step 350, the trackball 46 rotates the minimum distance in the forward direction F1. Need to be done. However, once the minimum distance is exceeded, step 350 is not completed until the trackball 46 returns to the rest position and stops rotating. The actual distance (that is, the number of angles) by which the trackball 46 is actually rotated is not limited. The minimum distance helps to ensure that accidental rotation of the trackball 46 during depression of the trackball 46 is not misunderstood as a zoom in or zoom out command. Similarly, to achieve a “yes” determination at step 360, the trackball 46 is rotated a minimum distance in the reverse direction R1. However, once the minimum distance is exceeded, step 350 is not completed until the trackball 46 stops rotating in that direction. The actual distance (that is, the number of angles) by which the trackball 46 is actually rotated is not limited.

  At this stage, it should be emphasized that the composition of the picture of the object S is complex and requires a lot of concentration on the user side. Therefore, there is a need for a high degree of usability of the device 30. While deciding on the picture composition, the user may need to deal with troublesome lighting conditions, object movement, and obstructions from other objects that appear between the photosensitive transducer 62 and the object S. Other difficulties can arise when determining picture composition. Accordingly, it is presently desirable to configure the trackball 46 to be sufficiently sensitive to rotation so that zoom is not triggered by the trackball 46 being accidentally depressed when taking a picture. In this embodiment, when the method 300 operates between steps 325 and 330 due to the arrangement of the skirt 74, the trackball 46 and the transducer housing 70 according to the structure shown in FIG. In addition, as described above, the possibility that the user erroneously communicates his intention to the processor 78 is reduced, thus increasing the usability of the device 30 to the user. That is, this configuration allows the user to interact explicitly with the trackball 46 to provide either a command to explicitly zoom in or zoom out, or the user can explicitly The trackball 46 is pushed down so that it is possible to take a picture as in the currently determined composition in the viewfinder 100.

  In another embodiment, a new preview screen is provided for viewing pictures previously taken by an electronic device such as device 30. A new screen according to an embodiment is shown generally at 124 in FIG. The preview screen 124 may be generated on the display 54 by the processor 78 after, for example, step 345 of the method 300 has been performed. Continuing with the specific embodiment, the screen 124 in FIG. 13 is shown with a picture of the subject S that is composed according to FIG. Accordingly, the preview screen 124 includes a picture window 128 showing the target S as determined in the finder 100 of FIG. The preview screen 124 also includes a preview status bar 132 that replaces the status bar 104.

  The preview status bar 132 includes five icons that correspond to the five different options available to the user. These icons are 136 back to viewfinder, delete picture 140, crop 144, send 148, and file 152. When the preview screen 124 is presented after execution of the method 300, the picture (in the picture 124) is stored in a file icon adjacent to the file icon, file 152. Return to finder 136 leaves the picture shown in picture window 128 stored in persistent storage device 82 according to the file name and location found adjacent to file 152, as the name implies. Keep it. The selection of 136 back to the viewfinder can be used to start the method 300 anew. Delete picture 140 may be used to delete the picture shown in picture window 128 from persistent storage device 82. Once 140 is selected to delete the picture, the picture is deleted and then the method 300 starts again. Trimming 144 may be used to select a particular portion of a picture stored in picture window 128, such portion may be stored as a new picture on persistent storage device 82, and / or device 30 may be associated with one or more contacts in a contact manager application running on 30. Send 148 may be used to send a picture in picture window 128 using the wireless email capability of device 30 via email, multimedia messaging service (MMS), etc. File 152 may view and / or edit the file name of the picture and / or browse through other photos stored on persistent storage device 82 and view those photos for viewing in preview screen 124. Can be used to load.

  Individual icons on the preview status bar 132 may be selected using the trackball 46 to sequentially highlight each one of the plurality of icons until the desired icon is highlighted and then associated with that icon. The trackball 46 is depressed to actually select the function.

  In another embodiment, a trim selection screen is provided that can be accessed via selection of the trim icon 144. A new screen according to the embodiment is shown generally at 156 in FIG. In this embodiment, the crop selection screen 156 can be used to create a cropped picture that can be stored in association with a contact in the contact manager application on the device 30. Although a cropped picture is generally an individual face, this is not essential. The trimming selection screen 156 includes a selection window 160 including a selection subwindow 164 and a context subwindow 168 in order. The selection sub-window 164 is circular and transparent, preferably completely transparent, as shown, with a visible visible border. The context subwindow 168 is rectangular and occupies all of the height of the display 54 but not all of the width. The context subwindow is translucent and is preferably less transparent than the selection subwindow 164. The crop selection screen 156 is optimized to allow the user to crop the picture and makes a selection to store the face of interest or primarily the face in the picture. Trimming selection screen 156 is also optimized for usability to simplify the trimming function for the user when selection screen 156 is implemented on device 30 or the like. Capturing the subject's face image is desired so that the same captured face image of the subject can be stored as a field in a record of a contact manager application running on device 30.

  By way of background, a record in the contact manager is associated with a full set of contact and address details for the subject being photographed. This again can improve the overall usability of the device 30. This is because the user can scroll through the photos in the contact manager application for the purpose of selecting the desired person to call, email, or otherwise contact using the device 30. Similarly, a “visual” identification function (eg, “caller-ID”) may be configured within device 30, thereby allowing an incoming call (or email or instant messaging) from the subject to device 30. Other communications, such as an application) causes the stored pictures of interest to be displayed on the display 54, thus assisting the user of the device 30 in identifying the source of incoming communications, It makes it possible to react accordingly.

  When the user accesses the screen 156, the user has the option of using the trackball 46 to move the selection window 160 "east" or "west" (with respect to the display in FIG. 14). As can be seen in FIG. 14, the face of object S appears in the center of selection subwindow 164 because selection subwindow 164 does not frame the face of object S. The trackball 46 can be used to move the selection sub-window 164 to the left as shown in FIG. 15, thereby positioning the face of the subject S in the center of the selection sub-window 164. The context sub-window 168 allows the user to see the portion of the picture that surrounds the selected portion, so that the user has more information during the movement of the selection window 160 through the trackball 46, It is advantageous to be able to select the desired part of the picture. Once the selection window 160 is in the desired position, the user can depress the trackball 46 (or provide an equivalent input) and actually trim the picture according to the selection.

  In the above embodiment, the selection sub-window 164 is circular and transparent, while the context sub-window 168 is rectangular and occupies all of the height of the display 54 but not all of the width. It should be understood that the selection sub-window 164 can be any shape including a square or a rectangle within the context sub-window 168. The context sub-window 168 can also be various shapes and can be smaller than the selection sub-window 164. Similarly, the selection sub-window 164 can be omitted entirely, so that the selection window corresponds to the area covered by the context sub-window. It may also be desirable to configure the device 30 such that the user can predefine the shape and / or size of the selection sub-window 164 and / or the shape and / or size of the context sub-window 168.

  When the user selects the crop icon 144 in addition to or instead of the crop selection screen 156, the user is given the option to set the picture in the preview screen 124 as the home screen for the device 30. By obtaining this picture, for example, this picture appears as a background on the main menu screen shown in FIG. Selecting crop icon 144 gives the user the option to go to crop selection screen 156, or simply set that picture as the picture for the home screen, or in conjunction with a contact in the contact manager. It may result in storing the picture. Alternatively, the crop selection screen 156 can be used to crop a picture for other purposes than simply selecting a personal face for storage within the contact manager application.

  In another embodiment, an incoming call screen that can be generated at any time during the execution of the method 300 is provided. A new incoming call screen according to an embodiment is shown generally at 172 in FIG. The incoming call screen 172 appears when the device 30 receives a telephone communication (such as) that enters during the execution of the method 300, and thus the incoming call screen 172 overlays the viewfinder 100 and the incoming call is sent to the user. To inform.

  The incoming call screen 172 includes an identification field 176 which, in the present embodiment, informs “incoming call from Sally Chan +1 (555) 555-5555”. Accordingly, the identification field 176 identifies the nature of the incoming communication (ie, phone-to-instant message), the name of the caller (ie, Sally Chan), and the caller's phone number.

  The incoming call screen 172 also includes a photo field 180 where a photo of the calling party (in this case, “Sally Chan”) is displayed. The photo displayed in the photo field 180 could have been previously captured using the method 300 and stored in the persistent storage device 82, or the photo could be stored on the persistent storage device 82 by some other method. Could have been.

  The incoming call screen 172 also includes an ignore field 184 and an accept field 188. Either one of the ignore field 184 and the accept field 188 can be selected by using the trackball 46 to scroll between them. The actual field selected is highlighted, and in the case of FIG. 16, the ignore field 184 is highlighted. The option corresponding to the highlighted field can ultimately be activated by the depressed trackball 46. Selecting the ignore field 184 results in the incoming call being rejected and processed via voice mail or another method desired. If the ignore field 184 is selected, the device 30 resumes operation of the method 300. It results in this embodiment returning the display 54 to the state shown in FIG. Selecting the accept field 188 results in the incoming call being accepted and communication between the device 30 and the caller being established in the normal manner. If desired, device 30 may be configured to continue performing method 300 during a telephone call, possibly by a user activating a speakerphone option or using a headset. While completing the method 300, it is possible to carry out a telephone call. Alternatively, if an incoming call is accepted, device 30 may be configured to end method 300.

  In this embodiment, the screen 172 is configured to highlight the ignore field 184 by default so that the user can quickly evaluate the nature of the incoming call and simply depress the trackball 46 to answer the incoming call. By allowing the rejection and allowing the user to return to performing method 300 as quickly as possible, the incoming call presents the least amount of interruption to performing method 300. However, it may also be desirable to configure the screen 172 such that the accept field 188 is highlighted by default, allowing the user to accept incoming calls quickly. It is also contemplated that device 30 may be configured to allow a user to select whether to ignore or accept field 188 by default when screen 172 is activated. Is done.

  The above discussion relating to screen 172 is also applicable to other types of notifications that may appear while a picture is being taken. Incoming emails, incoming text messages, incoming instant messages, and calendar alarms are examples of such other types of notifications. If desired, device 30 may be configured to have a screen, such as screen 172, that may appear during execution of method 300. Alternatively, the user may be given the option of configuring which types of such notifications are allowed to interrupt the execution of the method 300 and which types of notifications are not allowed according to personal preferences. .

  The foregoing represents exemplary embodiments and is not intended to limit the scope of the claims appended hereto.

Claims (21)

A method for controlling a display of a portable electronic device having a camera function, the portable electronic device comprising a photosensitive transducer for receiving a first image and a track for use as a user input device A ball, the method comprising:
Setting a default zoom level;
Activating a viewfinder by generating a second image corresponding to the first image on the display, the second image having a field of view corresponding to the default zoom level When,
Receiving a rotational input from the trackball, wherein the input represents an indication of either zooming in or out of the field of view;
Adjusting the zoom level based on whether the indication indicates zooming in or zooming out;
Regenerating the second image on the viewfinder with a field of view enlarged or reduced according to the zoom level from the adjusting step.   2. The device of claim 1, wherein the device includes at least one additional function in addition to the camera function, and the method further comprises receiving a request to launch a camera application prior to the setting step. the method of.   The method of claim 2, wherein the at least one additional function includes at least one of a wireless telephone and wireless email.   The rotation input in a first direction represents zooming in, and the rotation input in a second direction opposite to the first direction represents zooming out. Or the method according to 1 of 3 above.   Receiving input from the trackball corresponding to the trackball being depressed, and capturing at least a portion of the first image, the portion being in the viewfinder according to the zoom level The method of claim 1, further comprising: corresponding to the second image.   6. The method of claim 1, further comprising generating an icon image of the trackball on the display corresponding to whether the trackball is in a stationary position or a rotational position. The method described.   The stationary position corresponds to the zoom at any one of a minimum zoom level, an intermediate zoom level, and a maximum zoom level, and the method generates one of three icon images. The method of claim 6 further comprising a step.   The icon corresponding to the minimum zoom level indicates that only zooming in is available, and the icon corresponding to the intermediate level is used for both zooming in and zooming out. 8. The method of claim 7, indicating that it is possible, and wherein the icon corresponding to the maximum zoom level indicates that only zooming out is available.   The device includes a telephone or instant messaging application, and the method further includes overlaying and displaying a notification screen on the finder indicating that an incoming communication is being received via the application. The method according to one of 1 to 8.   The method according to claim 9, wherein the notification screen includes an identifier of a caller of the incoming communication, and the identifier includes a photograph of the caller.   The method of claim 10, wherein the notification screen includes fields to ignore and fields to accept, wherein the fields to ignore are highlighted by default. A portable electronic device,
A processor that interconnects trackballs, photosensitive transducers, displays, persistent storage devices and volatile storage devices,
The processor is configured to generate a viewfinder on the display, the viewfinder playing back an image being received via the photosensitive transducer, the image having a field of view;
The processor is configured to receive rotational input from the trackball and to enlarge or reduce the field of view of the image on the viewfinder depending on the direction of the rotational input.
device.   The processor is further configured to receive a signal corresponding to the trackball being depressed and to capture a captured image for storage on the persistent storage device in response to the signal; The device of claim 12, wherein the captured image corresponds to an image on the viewfinder according to the zoom level.   14. A rotation input in a first direction represents zooming in, and a rotation input in a second direction opposite to the first direction represents zooming out. Device described in.   The processor is further configured to generate an icon image of the trackball corresponding to whether the trackball is in a stationary position or a rotational position on the display in cooperation with the viewfinder. The device according to claim 12, 13 or 14.   The device of claim 15, wherein the rest position corresponds to the zoom at any one of a minimum zoom level, an intermediate zoom level, and a maximum zoom level.   The processor is configured to generate three icons corresponding to the rest position, and the first icon of the plurality of icons corresponding to the minimum zoom level is only available to zoom in. And the second icon of the plurality of icons corresponding to the intermediate level indicates that both zooming in and zooming out are available, corresponding to the maximum zoom level The device of claim 16, wherein a third icon of the plurality of icons indicates that only zooming out is available.   The device includes at least one of a phone application or an instant messaging application, and the processor overlays the viewfinder with a notification screen indicating that an incoming communication is being received via the phone application or the instant messaging application. 18. A device according to one of claims 12 to 17, further configured to generate the same.   The device of claim 18, wherein the notification screen includes an identifier of a caller of the incoming communication, the identifier including a picture of the caller.   The device of claim 19, wherein the notification screen includes fields to ignore and fields to accept, wherein the fields to ignore are highlighted by default.   A computer readable medium for storing a set of programming instructions according to the method of claims 1-11.

Images