GB2483491A

GB2483491A - Apparatus for integrating with a handheld computing device.

Info

Publication number: GB2483491A
Application number: GB1015067.0A
Authority: GB
Inventors: Thomas Steven Hulbert; Durrell Grant Bevington Bishop
Original assignee: Luckybite LLP
Current assignee: Luckybite LLP
Priority date: 2010-09-10
Filing date: 2010-09-10
Publication date: 2012-03-14
Also published as: GB201015067D0

Abstract

A system for augmenting a handheld computing device such as a PDA or smart phone running a software application which has a relationship with an additional element that contains attaches or otherwise integrates with the device. The system uses a software application, such as a driver, to enable the handheld device to interact with the apparatus. The system may have windows or openings in the apparatus to allow images produced by the handheld device to be seen. The system may make use of the sensors and features of the handheld such as tilt sensors and/or GSP sensors to align and select content to be displayed on the screen of the handheld device. The apparatus may include a docking port or a USB port. The apparatus may be in the form of a soft toy, cushion, game accessory or cuckoo clock that is animated and controlled by the handheld device. The apparatus may be in the form of a stereo Hi-fi system, a radio, or alarm clock in which the handheld device provides the media content ie the music. Content may downloaded to the device over a network.

Description

APPARATUS FOR AUGMENTING A HANDHELD DEVICE

BACKGROUND OF THE INVENTION

There are many and varied types of products that benefit from the use of a colour display screen, multimedia capabilities such as video and audio, or sensor inputs such as accelerometers.

However, due to manufacturing constrains and expense, particularly when considering entertainment products such as toys and games, it is often not possible to utilize such technologies.

Further, many people own and use portable handheld devices with colour display screens and multimedia capabilities hut use them for a relatively limited set of uses and, although it is possible to adapt such devices within software (by installing additional applications and 50 forth), there are limited possibilities to adapt such devices physically.

Existing solutions that relate to the problems oudined above are: * Multimedia enhancing peripherals for mobile devices, such as amplified speaker docks for mp3 players.

* Cases for mobile devices that have some fashionable or entertaining design but which are passive and do not relate to the function of the device.

SUMMARY OF THE INVENTION

Apparatus and system that enables a handheld multimedia device (e.g. an mp3 player, such as the AppleTM iPodTM Touch, or a mobile telephone, such as the AppleTM iPhoneTM, or any other device that includes one or more multimedia technologies such as a display screen, touch input, video, audio and networking capabilities) to be adapted, both in software and physically, so as to be used for a new or enhanced purpose.

The intention is to augment an existing handheld device by using a software application combined with an additional physical element, so as to enable the device to be used for a new purpose -the additional physical element containing, attaching to or otherwise integrating with the handheld device and having an intrinsic relationship to features of the device (e.g. cut-outs that enable only certain areas of the screen to be visible) so as to appear to transform the device into a new product. The additional physical element may be constructed from various materials, such as papers, cards, plastics, rubbers, fabrics and so on, and may have various physical designs and graphics applied.

For example, a software application and a stuffed-fabric cover could be provided to adapt a handheld device into an animated soft-toy -the application being installed on the handheld device and the device being inserted into the stuffed-fabric cover. Such an example embodiment would combine the handheld device, application and cover in an integrated way so as to appear to transform the device into a new product, and therefore the cover may relate to and integrate with various features of the handheld device (e.g. a cover in the form of an animal's face may have cut-outs to enable areas of the screen of the device to be visible so as to display content that relates to the cover, such as a pair of animated eyes).

BRIEF DESCRIPTION OF THE DRAWINGS

Figure 1 is an example embodiment of the invention for application as an animated soft-toy.

Figure 2 shows the elements of the example embodiment shown in Figure 1 combined to illustrate the embodiment in use.

Figure 3 shows the user interacting with the example embodiment shown in Figure 1.

Figure 4 shows some further possible enhancements of the example embodiment shown in Figure 1.

DETAILED DESCRIPTION

The apparatus incorporates, but is not hmited to, three main elements -a handheld multimedia device, such as an mp3 player, mobile telephone, PDA or similar device; a software application (which is installed on the device); and a physical element that contains, attaches to or otherwise integrates with the handheld device. All three elements combine to augment the handheld device, adapting it for a new purpose, whereby the device appears to be transformed into a new product. Figure 1 shows an example embodiment of the apparatus.

In the preferred embodiment, the handheld device is incorporated into the additional physical element in such a way that the physical element and features of the device (such as the display) become intrinsically related and therefore the content output from the software apphcation (e.g. in the form of video and audio) interplays with the physical element so as to appear to transform the device into a new product. For example, the handheld device may be inserted into a stuffed-fabric cover in the shape of an animal's face in such a way that the display of the device aligns with cut-out areas on the cover, so that animated eyes (generated from the software application) are visible through the cut-out areas and therefore the animal face appears to have ccreal animated eyes (see the soft-toy example embodiment in Figure 1).

In most embodiments, the apparatus may utilize various technologies that may be available on the handheld device (such as a video display output, touch display input, audio, networking, GPS, accelerometer sensors, tilt/orientation sensors, microphone) so as to enhance the purpose for which the device is being adapted. For example, it may utilize the touch display input of the device to respond to user interaction (such as an eye blinking when a user touches the eye with his finger, as in the case of a soft-toy similar to the example embodiment shown in Figure 1); or it may use the tilt/orientation sensors of the device to automatically align content displayed on the screen of the device with graphics printed on the physical element.

In some embodiments, the additional physical element will integrate with the device in a more Cactive way, whereby a technological relationship between the device and the physical element is created, rather than the physical element merely containing or attaching to the device, so as to enhance the overall functionality or interactivity. For example, the physical element may contain a cable and dock type connector to enable it to be connected to the device and for the device to be charged via the physical element; or the physical element may contain a dock type connector and a speaker so as to amplify the sound from the device; or the physical element may contain a dock type connector and sensors (e.g. switches, potentiometers, capacitive sensors, microphones, JR receivers, LDRs, FSRs and so on) so that interaction with the physical element results in communication from the physical element to the device via the dock connector causing the software application to respond in some way; or the physical element may contain sections of material that when touching the touch display of the device cause the device to register a touch input, and therefore when a user presses certain corresponding areas of the physical element the material thus comes into contact with the touch display causing a touch input to be registered and the software application to respond in some way.

Jn some embodiments the software application may output content that is up-to-date or enhanced, either by prompting the installation of new version of the application from time to time (or an alternative hut related additional application); or by loading or streaming content from a remote source using the networking capabilities of the handlield device.

The present invention may be applied to many alternative configurations, and used in many varied applications, some examples include: 1. A Soft-Toy, where the handheld device, software application and physical element are combined to make a soft-toy that appears animated (e.g. the handlield device is inserted into a stuffed fabric cover in the form of an animal's face which has circular cut-outs that enable areas of the display of the device to be visible so as to show an animation of eyes moving).

2. A Radio or "Hi-fl", where the handheld device is electrically connected to the physical element (e.g. a plastic case in the form of a Radio or "Hi-fl") and where the handheld device, software application and physical element are combined to play digital and/or internet radio stations or audio files, such as mp3s, which are amplified via speakers in the physical element (e.g. the handheld device is inserted into a plastic case in the form of a Radio which has a dock connector, speaker and cut-outs that enable areas of the display of the device to be visible so as to show graphics that mimic the interface of a Radio and which enable the selection and control of internet radio stations, which are then played hack via the speaker in the case).

3. An Alarm Clock, \vhere the handheld device, sothvare application and physical element ate combined to display the time and output audible alarms and where the physical element is an appropriate form to allow the clock to be placed on a surface or hung on a wall or otherwise be easily viewed (e.g. the handheld device is inserted into a plastic box which has cut-outs that enable areas of the display of the device to be visible so as to display the time and which is also a suitable form to be placed on a bed-side table, enabling the time to be easily viewed).

4. A Board Game Accessory, where the handheld device, software application and physical element are combined to create video/audio output that enhances the game play (e.g. to enhance a board game with the theme of Battleships, the handheld device is inserted into a plastic case in the form of a submarine's instrument panel winch has cut-outs that enable areas of the display of the device to be visible so as to display a sonar image).

5. A Cushion, where the handheld device, software application and physical element are combined to make a cushion that appears animated (e.g. the handheld device is inserted into a cushion which has circular cut-outs that enable areas of the display of the device to be visible so as to show an animation of eyes moving).

6. A Printed Card Promoting a Film, where the handheld device, software application and physical element are combined to create a printed film promotion which presents video/audio content relating to a film and where the card is printed with graphics representing characters or scenes from the film or other similar graphics relating to the film (e.g. the handheld device is attached to the back side of a printed card which includes on its front side graphics representing a character from a children's animated film and which has a cut-out that enables an area of the display of the device to be visible so as to display the face of the character so that the character on the printed card appears to be animated and begins to speak, enacting dialog from the film for example).

7. A Cuckoo Clock, where the handheld device, software application and physical element are combined to make a "bird house" which appears to have an animated bird inside (e.g. the handlield device is inserted into a box constructed from printed shaped cardboard sections joined together which when assembled give the appearance of a "bird house", and \vhich has a circular cut-out in the front face that enables an area of the display of the device to be visible so as to show an animation of a bird, the bird appearing to CCCuckoo at certain times of the day which is also accompanied by audio of the bird's sound played from the device).

8. A Viewing Device, where the handheld device, software application and physical element are combined to make a monocular or binocular eye piece which when viewed shows visual imagery (e.g. the handheld device is inserted into a plastic case with monocular eye piece protruding from the case and which has a circular cut-out on the interior of the case that enable an area of the display of the device to be visible so as to show images that appear magnified, such as planets in the night sky -such images could alternatively appear 3D if the appropriate optics where included within the eye piece and the images on the display of the device was rendered in such a way to create a 3D effect when viewed through the optics).

10. A Retro Appliance, \vhere the handheld device, software application and physical element are combined to make an appliance that appears animated and which may produce video or audio which is typically associated with that appliance (e.g. the handheld device is inserted into a box constructed from printed shaped cardboard sections joined together which when assembled give the appearance of a cassette tape WalkmanTM, and which has a cut-out in the front face that enables an area of the display of the device to be visible so as to show an animation of a cassette tape spoiling which is accompanied by music being played from the handheld device).

A scenario of use is described below, representing one such embodiment of the invention in more detail: The example embodiment is described with reference to the figures.

Detailed Description -example embodiment (Animated Soft-Toy) Figure 1 User 101 has a handheld multimedia device 102 (containing a software application 105); and a physical element 106.

Device 102 includes a video display 103, touch input 104, and a software application 105 (which has been installed on the device and is intended to be used in combination with the physical element 106).

Physical element 106 is a stuffed fabric cover in the form of an animal's face which includes an internal space 107, into which the handheld device 102 is to be inserted and thus supported, and two cut-out areas 108, which align with the display screen of the device (when the device is inserted into the physical element) and enable two areas of the device display to be visible.

When running on the device, software application 105 displays a pair of animated eyes on the screen of the device, which become visible through the cut-out areas in the physical element when the device is inserted into the physical element. Application 105 also responds to touch input so that when the device display is touched within the area of the screen displaying the eyes, the eyes will be animated so as to appear to blink in response to the touch.

Figure 2 User 201 has launched the software application (105 in Figure 1) on multimedia handheld device 202, and has inserted the device into the physical element 206. The cut-out areas 208 on the physical element align with the display of the device 202. The software application displays a pair of animated eyes, which are visible though the cut-outs 208 and therefore appear to be the eyes of the animal's face (the physical element 206). Thus, the handheld device, software application and physical element have been combined to transform the device into a new product, an animated soft-toy.

In a further enhancement of this embodiment, the software application (105 in figure 1) on the multimedia handheld device 202 outputs sound by playing audio files stored locally on the device or by streaming audio files from a remote location via a network connection.

The sound may be audio content that relates to the physical element 206 and the overall context of use. For example, the sound could be a narrated story where the dialog appears to be spoken by the soft-toy, the voice being appropriate to the character of the soft-toy.

Further, sensors in the device 202 could he utilized by the software application to enable the user to control the sound playback (i.e. play, pause, stop etc.) by interacting with the soft-toy. For example, an accelerometer in device may be utilized so that when the soft-toy is tilted the sound playback is controlled (e.g. the user tilts the soft-toy backward to stop the sound, tilts it fonvard to play the sound, tilts it left to go to the previous sound, and tilts it right to go to the next sound).

In a further enhancement of this embodiment, the software application on the multimedia handheld device 202 receives or loads new content via a network connection. This new content may be loaded into the software application free of charge to the user, or the user may purchase this new content via the software application. Examples of new content that could be loaded into the software application are: new audio content (e.g. the latest episode of an audio story that the soft-toy will narrate to the user); new graphical content (e.g. the user may be able to customise the appearance of the soft-toy by updating the colour of the eyes); new game content (e.g. different games each week could be loaded into the software application so that the user would be able to interact with the soft-toy in different ways).

Figure 3 User 301 inserts his finger through the cut-out 308 in physical element 306 and touches the display of handheld device 302. The device registers a touch input and in response the software application animates the eye so as to make the eye appear to blink. Thus the soft-toy becomes interactive, blinking when it is touched or "poked" in the eye.

Figure 4 Further enhancements of this embodiment may be to utilize the date/time features of the device to make the soft-toy 410 appears to sleep at appropriate times (e.g. close the animated eyes on screen when it becomes evening; to utilize the accelerometer sensors in the device so that when the soft-toy 411 is shaken or tilted the eyes appear dizzy or dazed (e.g. the animated eyes may spin or become "crossed") or the physical element may include an external cable and a dock type connector within the internal space (107 in Figure 1) to which the handheld device would be connected, enabling the device to be powered and charged via the soft-toy 412.

So, in use, a user receives a software application and a physical element (a soft-toy in the form of an animal face). He installs and runs the software apphcation on his handheld multimedia device and inserts the device into the physical element. The software application displays a pair of animated eyes, which are visible through two cut-outs in the physical element. The soft-toy thus appears to "come to life", having a pair of animated eyes. If the user inserts his finger through one of the cut-outs and touches the display screen, the "eye" blinks, thus the soft-toy also becomes interactive.

According to one aspect of the invention, there is provided an apparatus comprising a hand-held device and a container, the container including a window or cut-out, the hand-held device including a screen, the hand-held device being removable from the container, the hand-held device arranged in the container such that some or all of the screen is exposed through the window, the hand-held device running a software application that provides screen content which relates to the design or function of the container.

The apparatus may be one in which the container is a toy.

The apparatus may be one in which the container is a soft toy.

The apparatus may be one in which the software application makes the toy or soft toy appear animated.

The apparatus may be one in which the software application generates audio output from the hand-held device.

The apparatus may be one in which only some of the screen is exposed through the window or cut-out.

The apparatus may be one in which less than half of the screen is exposed through the window or cut-out.

The apparatus may be one in which software applications can be purchased from an application store.

The apparatus may he one in which video or audio content can be purchased from a vendor using the hand-held device.

Claims

CLAIMSI. Apparatus for augmenting an existing handheld device by using a software application in conjunction with an additional physical element containing, attaching to or otherwise integrating with the handheld device and having an intrinsic relationship to the device and the software application running on the device, so as to enable the device to be used for a new or enhanced purpose.
2. Apparatus as claim 1 whereby the handheld device, software application installed on the device and additional physical element combine to augment the handheld device in such a way that the device appears to be transformed into a new product.
3. Apparatus as in claims I and 2 where the handheld device is a portable multimedia device, which includes a video display and audio and video capabilities, such as an mp3 player, mobile telephone, smartphone, PDA or similar device.
4. Apparatus as in all previous claims whereby the handheld device is integrated into the additional physical element in such a way that the physical element and features of the device become intrinsically related and therefore the output from the software application interrelates with the physical element.
5. Apparatus as in claim 4 whereby the physical element contains the handheld device and has one or more cut-out areas which enable areas of the display on the device to be visible so as to create an in intrinsic relationship between the physical element and the device and therefore cause video content output from the software application to interrelate with the physical element.
6. Apparatus as in all previous claims where the additional physical element is constructed from a material such as paper, card, wood, plastic, rubber or fabrics or a combination of these.
7. Apparatus as in all previous claims where the physical element has a physical form that relates to the content of the software application.
8. Apparatus as in all previous claims where the physical element has graphics applied to it that relate to the content of the software application.
9. Apparatus as in all previous claims which utilizes one or more of the technologies that may be available on the handheld device (such as a video display output;, touch display input, audio, networking, GPS, accelerometer sensors, tilt/orientation sensors, microphone) so as to enhance the purpose for which the device is being augmented.
10. Apparatus as in claims 8 and 9 which utilizes the tilt/orientation sensors of the handheld device so as to automatically align content displayed on the screen of the device with graphics printed on the physical element
11. Apparatus as in all previous rlsims where the additional physical element integrates with the handheld device in such as way that a technological relationship between the device and the physical element is created so as to enhance the overall ftanctionality or interactivity of the apparatus.
12. Apparatus as in claim 11 where the technological relationship is an electrical connection between the handheld device and the physical element for the purpose of transmitting power or communication signals.
13. Apparatus as in daim 12 where the physical element includes a cable and dock type connector to enable it to be electrically connected to the handheld device so that the device can be charged via the physical element
14. Apparatus as in claim 13 where the cable from the physical element is connected to a nisins power adaptor.
15. Apparatus as in claim 13 where the cable from the physical element is connected to a USB port of a personal computer.
16. Apparatus as in claim 12 where the physical element includes a dock type connector, to enable itto be electrically connected to the handheld device, and a speaker so as to amplify the sound from the handheld device.
17. Apparatus as in claim 12 \vhere the physical element includes a dock type connector, to enable it to he electrically connected to the handheld device, and sensors (e.g. switches, potentiometers, capacitive sensors, microphones, IR receivers, LDRs, FSRs and so on) so that interaction with the physical element results in communication from the physical element to the device via the dock connector causing the software application to respond in some way.
18. Apparatus as in claim 11 where the technological relationship is a touch input transmitted from the physical element to the touch display of the handheld device whereby the physical element contains sections of material that when touching the touch display of the device cause the device to register a touch input, thus causing the software application to respond in some way.
19. Apparatus as in claim 18 where a user presses certain areas of the physical element causing the corresponding area to come into contact with the touch display causing a touch input to be registered and the software application to respond in some way.
20. Apparatus as in all previous claims where the software application may output content that is up-to-date or enhanced by prompting the installation of new version of the application from time to time (or an alternative but related additional application.
21. Apparatus as in all previous claims where the software application may output content that is up-to-date or enhanced by loading or streaming content from a remote source using the networking capabilities of the handheld device.
22. Apparatus as in all previous claims, which is used as a Soft-Toy, where the handheld device, software application and physical element are combined to make a soft-toy that appears animated.
23. Apparatus as in all previous claims, which is used as a Radio, where the handheld device is electrically connected to the physical element and where the liandheld device, software application and physical element are combined to make a product that appears to be a radio which plays digital and/or internet radio stations output from the handheld device that are amplified via speakers in the physical element.
24. Apparatus as in all previous claims, which is used as a "Hi-fl", where the handheld device is electrically connected to the physical element and where the handheld device, software application and physical element are combined to make a product that appears to be a hi-fl which plays music files, such as mp3 files, output from the handheld device that are amplified via speakers in the physical element.
25. Apparatus as in all previous claims, which is used as an Alarm Clock, where the handheld device, software application and physical element are combined to display ±e time and output audible alarms and where the physical element is an appropriate form to allow the clock to he placed on a surface or hung on a wall or otherwise be easily viewed.
26. Apparatus as in all previous claims, which is used as a Board Game Accessory, where the handheld device, software application and physical element are combined to create a physical prop with video/audio output that enhances the game play.
27. Apparatus as in all previous claims, which is used as a Cushion, where the handheld device, software application and physical element are combined to make a cushion that appears animated.
28. Apparatus as in all previous claims, which is used as a Printed Card Promoting a Film, where the handlield device, software application and physical element are combined to create a printed film promotion which presents video/audio content relating to a film and where the card is printed \vith graphics representing characters or scenes from the film or other similar graphics relating to the film.
29. Apparatus as in all previous claims, which is used as a Cuckoo Clock, where the handheld device, software application and physical element are combined to make a "bird house" which appears to have an animated bird inside.
30. Apparatus as in all previous claims, which is used as a Viewing Device, where the handheld device, software application and physical element are combined to make a monocular or binocular eye piece which when viewed shows visual imagery.
31. Apparatus as in all previous claims, which is used as a "Retro" Appliance, where the handlield device, software application and pliysical element are combined to make an appliance that appears animated and which may produce video or audio which is typically associated with that appliance
32. Apparatus of any previous daim, in which the multimedia handheld device outputs sound by playing audio flies stored locally on the device or by streaming audio files from a remote location via a network connection.
33. Apparatus of any previous chum, in which the sound is audio content that relates to the physical element and the ovetall context of use.
34. Apparatus of any previous claim, in which the sound is a narrated story where the dialog appears to be spoken by the soft-toy, the voice being appropriate to the character of the soft-toy.
35. Apparatus of any previous claim, in which sensors in the device are utilized by the software application to enable the user to control the sound playback (i.e. play, pause, stop etc.) by interacting with the soft-toy.
36. Apparatus of any previous claitn, in which an accelerometer in the device is utilized so that when the soft-toy is tilted the sound playback is controlled (e.g. the user tilts the soft-toy backward to stop the sound, tilts it forward to play the sound, tilts it left to go to the previous sound, and tilts it right to go to the next sound).
37. Apparatus of any previous claim, in which the software application on the multimedia haridbeld device receives or loads new content via a network connection.
38. Apparatus of claim 37, in which the new content is loaded into the software application free of charge to the user, or the user may purchase this new content via the software application.
39. Apparatus of claim 38, in which the new content is new audio content, or new graphical content, or new game content.
40. Apparatus comprising a hand-held device and a container, the container including a window or cut-out, the hand-held device including a screen, the hand-held device being removable from the container, the hand-held device arranged in the container such that some or all of the screen is exposed through the window, the hand-held device running a software application that provides screen content which relates to the design or function of the container.
41. Apparatus of claim 40 in which the container is a toy.
42. Apparatus of claim 40 in which the container is a soft toy.
43. Apparatus of any of claims 41 to 42, in which the software application makes the toy or soft toy appear animated.
44. Apparatus of any of claims 40 to 43, in which the software application generates audio output from the hand-held device.
45. Apparatus of any of claims 40 to 44, in which only some of the screen is exposed through the window or cut-out.
46. Apparatus of any of claims 40 to 44, in which less than half of the screen is exposed through the window or cut-out
47. Apparatus of any of rkirns 40 to 46, in which software applications can be purchased from an application store.
48. Apparatus of any of chinis 40 to 47, in which video or audio content can be purchased from a vendor using the hand-held device.