WO2008125832A2

WO2008125832A2 - Projector device

Info

Publication number: WO2008125832A2
Application number: PCT/GB2008/001291
Authority: WO
Inventors: Yann Le Bouedec; Stuart Browning
Original assignee: Blue Sky Designs Ltd
Priority date: 2007-04-12
Filing date: 2008-04-11
Publication date: 2008-10-23
Also published as: WO2008125832A3; GB0707093D0

Abstract

An embodiment of the invention provides a projector device comprising a sound module, a controller operable to analyse a sound input from the sound module and to generate a moving image which, in use, moves in a manner responsive to one or more predetermined characteristics of the sound input, and a projector arranged to receive the moving image and to project it for display.

Description

PROJECTOR DEVICE

TECHNICAL FIELD

This invention relates to a system of projecting images. Embodiments of the invention relate to a device suitable for projecting a sound-responsive image, generated from a sound source, onto a wall or other suitable surface.

BACKGROUND

Music visualisation is a feature found in many leading software applications, as well as certain pieces of hardware. The basis of such visualisations is the generation of moving images or spectrums based on a sound source, such as a piece of music, spoken word or any other.

With software applications, the sound source is typically a CD or compressed digital media file, such as an MP3 or AAC file. The images are usually generated and rendered in real time and synchronised with the music as it is played through the application. A user of such software is then provided with a visual representation of the sound source, which can be displayed on a monitor or other viewing means.

The most common, and often simplest, visualisation techniques involve the simulation of an oscilloscope or spectrogram display. More elaborate visualisations may include a multitude of 3D-rendered composite effects. All categories of visualisations are generally determined and controlled by the dynamic properties of the sound source, for example, a change in the loudness and/ or fluctuations in the frequency spectrum.

Recently, music visualisations have become more sophisticated. For example, software applications are available for personal computers that are capable of generating an animated character which is responsive to changes in loudness or fluctuations in the frequency spectrum of a sound source. Windows Dancer for Microsoft Windows XP is one such example. While this category of visualisation software provides visual entertainment to users of personal computers, the disadvantage is that they necessarily require the use of a personal computer.

Embodiments of the present invention provide a device capable of displaying a music visualisation, such as a dancer or animated character, onto a wall or other suitable surface using a projector.

SUMMARY OF THE INVENTION

According to an aspect of the present invention, there is provided a projector device comprising: a sound module; a controller operable to analyse a sound input from the sound module and to generate a moving image which moves in a manner responsive to one or more predetermined characteristics of the sound input; and a projector arranged to receive the moving image and to project it for display.

Preferably, the sound module comprises a microphone. Alternatively, the sound module comprises a personal music player and/or an audio input line.

Preferably the sound module comprises a loudspeaker.

The disclosed embodiments include a controller comprising a visualisation module operable to receive a sound input for analysis and to analyse said sound input by processing based on frequency filters.

Alternatively, the disclosed embodiments include a controller comprising a visualisation module operable to receive a sound for analysis and to analyse said sound input by digital signal processing techniques.

According to an aspect of the present invention, there is provided a projector device, wherein the visualisation module comprises a mapping unit for mapping the results of the analysis on to an image in a manner which uses predetermined criteria to drive movement of said image.

According to another aspect of the present invention, the projector device comprises a game module. Preferably the game module has access to a library of games, wherein at least a part of said library of games is accessed via the Internet.

According to another aspect of the present invention, there is provided a time module.

According to another aspect of the present invention, there is provided a switch interface.

The disclosed embodiments include an IR interface arranged to receive and process user control inputs.

According to another aspect of the present invention, there is provided a USB interface.

According to a preferred embodiment of the present invention, the projector comprises a light source arranged to project light through a substantially transparent screen. Preferably the screen is an LCD screen. More preferably still, the screen is driven by a screen controller receiving a driving input from the controller.

According to an aspect of the present invention, the projector has a light source comprising one or more LEDs. Preferably the light source comprises elements of a plurality of predetermined colours and colour selection is based at least in part on one or more predetermined characteristics of said sound input.

According to an aspect of the present invention, the projector device comprises a lens.

According to an aspect of the invention, the projector device comprises a battery power supply.

According to a preferred embodiment of the present invention, the projector device comprises a controller operable to analyse the characteristic of the put sound selected from one or more of: frequency; tempo; and loudness.

Preferably the projector device comprises an image store for holding, temporarily or otherwise, one or more images to be projected. More preferably still, the image to be projected is a character which, in use, exhibits animated movements driven in coordination with said predetermined characteristics of the sound input.

Preferably said sound input comprises music.

According to another aspect of the present invention, the projector device is capable of coupling with a remote storage facility holding a plurality of characters suitable for display via said projector.

According to another aspect of the present invention, there is provided a time module coupled to the projector.

According to another aspect of the present invention, there is provided a projector device comprising: a microphone, a visualisation controller operable to receive a sound input from the microphone, to analyse said sound input and to generate a moving image exhibiting movements which are responsive to said sound input such that the movements are coordinated with one or more predetermined characteristics of said sound input in real-time, and a projector unit.

According to another aspect of the present invention, there is provided a projector device comprising: a screen controller; a substantially transparent screen; a light source arranged to project through said substantially transparent screen; and a visualisation unit arranged to generate moving images which, in use, exhibit movements coordinated with one or more predetermined characteristics of a sound.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of the invention and as to how the same may be carried into effect, reference will now be made, by way of example only, to the accompanying drawings, in which:

Figure 1 is a schematic illustrating a projector according to an embodiment of the invention having a sound module, a controller and a projector;

Figure 2 is a schematic illustrating an embodiment of the sound module;

Figure 3 is a schematic illustrating an embodiment of the controller; Figure 4 is a schematic illustrating a more detailed version of the controller in Fig 3;

Figure 5 is a schematic illustrating an embodiment of the projector;

Figure 6 is a schematic illustrating various components of an embodiment of the invention;

Figure 7 illustrates a process according to one embodiment of the invention whereby the device displays a projected moving image based on a sound source from a microphone;

Figure 8 illustrates a further process according to an embodiment of the invention whereby the device displays a projected moving image based on a sound source from a digital audio file stored on an internal or external memory;

Figure 9 illustrates a further process according to an embodiment of the invention whereby the device displays projected interactive video games; and

Figure 10 illustrates a further aspect of an embodiment of the invention whereby the device displays the time.

DETAILED DESCRIPTION

Those skilled in the art will appreciate that while this disclosure describes what is considered to be the best mode and, where appropriate, other modes of performing the invention, the invention should not be limited to the specific configurations and methods disclosed in this description of the preferred embodiment.

Figure 1 illustrates a device according to the present invention 100. The device is managed by a controller 102, which takes an input from a sound module 104 and feeds an output image 105 through a projector 106 onto a wall 108 or other suitable screen. Figure 2 illustrates an exemplary sound module 104 according to the present invention. The sound module has an audio interface 202, which may take an audio input from a range of sound sources including, but not limited to, a microphone 204 or an on-device MP3 player 206. The audio interface also has a sensitivity control 208, which allows a user of the device to change the input gain of the sound source. This may be useful, for example, when the user needs to adjust the sensitivity of the microphone in order to compensate for varying levels of background noise.

According to the disclosed embodiment of the invention, it is possible to connect an external sound source via a suitable line-in port 210. For example, a connection may be present which allows a user to directly input sound from an iPod, portable CD player or other music player.

The audio interface is connected to an amplifier 212, which allows music from the on-device MP3 player, or an externally connected sound source, to be played though loudspeakers 214. There is also present an amplifier interface 216, which allows a user of the device to control aspects of the sound output. For example, the interface may allow the user to change the volume of the sound output, as well as other variables such as the bass and treble 218.

Figure 3 illustrates an embodiment of the controller 102. The controller is made up of a number of modules including a music visualisation module 302, a games module 304 and a time module 306. The music visualisation module is configured to perform the functions of: processing the frequency spectrum of frames of an audio signal from the sound module; and outputting a visual representation of the frequency content of a signal as it changes over time, i.e. it produces a visual representation of a sound source. The visualisation module may be configured to create visualisations from sound sources using any one of a selection of methods.

One such method is the use of a series of bandpass filters. According to this method, the frequency range of an analogue input audio signal may be divided into equal sections, for example linearly or logarithmically, and the signal passed to a corresponding bandpass filter. The bandpass filter then removes parts of the signal that do not fall within a certain frequency band. The magnitudes of each signal output from the filter are recorded as a function of time. The module then maps each recording to a corresponding image. Over time, the visualisation module produces a series of changing images which exhibit movements corresponding, for example, to changing frequencies, tempo and/or loudness of the sound input. The moving image output thus represents a dynamically changing, animated image responsive to (in other words coordinated with) the input sound signal.

According to another method, the music visualisation module 302 may be configured to produce the animated image using Digital Signal Processing (DSP). DSP methods are generally used to measure or filter continuous real time analogue signals. During this process, the signal is converted from analogue to digital form, using an analogue to digital converter (ADC). According to known DSP methods, digitally sampled data in the time domain may be apportioned into blocks and Fourier transformed to calculate the magnitude of the frequency spectrum for each block. Each block can then be mapped onto an image and, over time, a series of changing images forms an animation based on the input sound signal.

Thus according to preferred embodiments of the invention, the controller is capable of outputting an animated character which appears to be responsive to an audio input from the sound module. Typically, the character is configured to perform a dance, or series of movements, according to dynamic changes within the input audio signal.

Figure 4 shows a detailed illustration of the controller in Fig. 3. The controller 102 is made up of a music visualisation module 302, a games module 304 and a time module 306. The controller further comprises an internal memory 402. Typically, this is a Flash, or non-volatile computer memory, that can be electrically erased and reprogrammed by a user of the device. It will be clear to the skilled reader, however, that any type of memory may be used. The memory is used to store any graphical data used by the music visualisation module 302, as well as any games used by the games module 304. Additionally, the memory may also be used to store digital audio files such as MP3 files, which may be decoded and played by an on-device MP3 player 206. In this case, the output from the MP3 player may also be used as an input to the music visualisation module, before being output through the amplifier and loudspeakers as illustrated in Fig. 2.

The controller 102 also has a micro-controller 301 with processing means and control code capable of controlling the various processes described hearin.

In addition, this embodiment has an external memory interface 404. This allows a user to plug in an external memory device 408 such as a USB flash device, SD memory card or any other non-volatile memory device. It may also allow the user to connect the device to a personal computer in order to download content to the memory, e.g. via a USB cable, Bluetooth port or any other data transfer means.

The controller also preferably has input interfaces which allow the user to operate the various modules of the controller. The switch input interface 410 receives input from one or more buttons or switches 412 which allow a user of the device to select which of the controller modules is active. For example, the user may select between the music visualisation module, the games module and the time module. The switch input interface also performs functions such as setting the time when the time module is active, as well as allowing the user to power on and off the device.

There is also provided an infra red (IR) interface 414, IR receiver 416 and IR remote control 418 which allows a user of the device to control aspects of the controller modules remotely. For example, as well as selecting which module is active, the IR remote control may be used as a game control when the games module is active, to set the time displayed by the time module or to change various aspects of the music visualisation module such as colours or the character or animation in use.

According to another embodiment of the invention, it may be possible to produce high-resolution animations in the music visualisation module using high-resolution data stored within an internal 402 or external memory 404. For example, separate objects (or illustrations) and layers may be stored in the memory, and the music visualisation module contains one or more processors capable of rendering moving characters in real time, based on the stored illustrations and layers.

The various components of the control of 102 are connected via the bus 401.

According a preferred aspect of the invention, the controller has a download capability, provided for example by a USB port 406, which allows users to download data to the memory, which may be used by the music visualisation module 302. For example, a user may visit a website to download new characters, animations, upgrades or customisations which may be downloaded to the device to enhance its functionality.

The games module 304 allows a game to be projected as an image through the projector. Typically, one or more games will be loaded on to an internal memory 402. Examples of games loaded in to the internal memory might include classic arcade games such as Space Invaders, Pac-man, Battlezone and Tetris. It is also an aspect of the present invention to allow the use of an external memory device 404, which users may utilise to download and play other games through the device. According to one embodiment of the invention, aspects of the game may be combined with the music visualisation module to create in-game graphics responsive to music or other sound inputs.

The time module 306 allows the device to display the time, animated in various ways. For example, it is a function of the time module to integrate with the music visualisation module to produce an animation in which there is a transition between a moving character and a display of the time. It is another aspect of the music visualisation module to use the time from the time module as a basis for the music visualisations, i.e. an image of the time is animated and displayed through the device. The time module may also include an alarm clock which activates at a user- defined time with one or more different animations or characters in a random or user- defined manner.

Figure 5 shows the projector 106. The projector comprises a light source 502, a liquid crystal display (LCD) 504 or similar display which is substantially light transmissive, an LCD controller 506 and a lens system 508. The light source in this illustration is provided by one or more super-bright LEDs, however the skilled reader will appreciate that any alternative light source may be used. The LCD controller 506 is connected to the controller 102, as illustrated in Fig. 4, and receives an image from the music visualisation module 302, the games module 304 and/or the time module 306 accordingly.

Light from the super-bright LEDs shines though the LCD, producing an image 510 on the lens. The lens then focuses the image so that it may be projected onto a wall or other screen 512.

According to one embodiment of the invention, a bank or array of coloured super- bright LEDs are deployed as light sources, and the user is able to select a preferred colour or colours from the LEDs, for example using the switch or IR interface. The projected image will then be displayed in the user-selected colour or colours. Alternatively, the LEDs may be configured to periodically cycle though the range of colours or change given a certain response from the music visualisation module. For example, the LEDs may be integrate with the music visualisation module and the animation may not only move according to changes in loudness or frequency, as described above, but may also change colour according to one or more of the changes.

The disclosed embodiment employs an active-matrix LCD, allowing the display of a high-resolution image. A skilled person will appreciate that in active-matrix LCDs, each pixel has its own dedicated transistor. Active-matrix displays are brighter, sharper and capable of higher resolutions than passive-matrix displays of the same size, due to their quicker response times.

On the other hand in another embodiment of the invention, the LCD is a passive- matrix LCD. In such an LCD, each column or row of the display employs an individual electrical circuit. The pixels are addressed individually by row and column and the pixel retains a given state between charge refreshes. The output resolution of passive-matrix LCDs is generally lower than that of an active-matrix LCD. Figure 6 shows a more detailed schematic of how the controller 102, sound module 104 and projector 106 may be connected according to an embodiment of the present invention 600. This schematic, however, is intended only to be illustrative and other configurations or layouts of the components may be used. The sound module, controller and projector all share a common power source 602, which may be a mains power connection, a battery or both.

Figure 7 shows a typical process 700 by which the device displays an animated music visualisation. In step 702 a user of the device places a sound source 702 in close proximity to the device 100. This sound source may be a hi-fi, CD player, radio or other portable music playing device capable of playing sound through a loudspeaker. In step 704 sound is then picked up by the built-in microphone 204 and is converted 706 into a digital signal within the sound module 104. The signal is then fed in step 708 to the controller 102 and to the music visualisation module 302. The music visualisation module processes the digital signal 710 and maps the signal to images based on, for example, frequency, loudness and/ or tempo 712. The music visualisation module may access images stored in memory 402 from a character 716 or image 718 library. The music visualisation unit then generates an animation 714 and feeds the output in step 720 to the LCD controller 506 in order to produce a real time animation displayed on the LCD screen 504 illuminated by super-bright LEDs such that the image is projected 722 through the lens system to produce the moving image on a wall or other surface 724.

Figure 8 shows a typical process 800 by which the device uses a digital audio file, such as an MP3, or externally connected music player 802 to produce an animated image. The process by which the music visualisation module produces animated images according to this process is analogous to that illustrated in figure 7, however, the audio input is taken in step 802 from an on-device MP3 player or externally connected music source rather than a microphone. Additionally, the audio signal from the on-device MP3 player or externally connected music player is fed in step 804 to the amplifier 212 and through one or more loudspeakers 214, which allows the music to be heard though the device 806, as well as displaying the animated images through the projector. Figure 9 illustrates a process 900 whereby the device displays projected interactive games. According to this process, the device acts much like a typical games console, providing a user with interactive entertainment through a video display. Typically, the user selects a game 902 from a library of at least one game 904 using a player interface 906, which may be an IR remote control or other interface. In step 910 the games module 304 feeds the output through the projector 106 and an image is produced 912 on a wall or other suitable screen. The user is able to control 914 aspects of the game, based on the projected image, using the player interface 410.

Figure 10 illustrates an alternative process 1000 according to an embodiment of the invention whereby the device displays an animated image of the time. Generally, the time module is integrated with the music visualisation module, however, it is possible to engage the time module in isolation to simply provide a projected image of the time. The embodiment in figure 10 is analogous to the embodiments shown in 7 and 8, however, when the time module is engaged by the user 1002, the time module becomes integrated with the music visualisation module. Once the time module has been engaged, the music visualisation module incorporates an image of the time into the currently displayed animation. For example, an animated character may be moving in response to some music, as described in previous figures, however, the music visualisation module then performs a smooth pixel transition 1004 between the animated character and the time image. The animated image is updated in real time 1006. The updated images are then fed in step 1008 to the LCD controller and the image is projected 1010 on to a wall via the screen, as has already been described in Fig. 5.

Those skilled in the art will recognise that the invention has a broad range of applications in displaying digital media, and that the embodiments may take a wide range of modifications without departing from the inventive concept as defined in the appended claims. For example, the invention may be used to display other digital media such as video and or/ photographs which may be responsive to an audio input.

Claims

1. A projector device comprising:

a sound module;

a controller operable to analyse a sound input from the sound module and to generate a moving image which moves in a manner responsive to one or more predetermined characteristics of the sound input; and

a projector arranged to receive the moving image and to project it for display.

2. A projector device according to claim 1 , wherein the sound module comprises a microphone.

3. A projector device according to claim 1 , wherein the sound module comprises a personal music player.

4. A projector device according to claim 1 , wherein the sound module comprises an audio input line.

5. A projector device according to any of claims 1-4, wherein the sound module comprises a loudspeaker.

6. A projector device according to any preceding claim, wherein the controller comprises a visualisation module operable to receive a sound input for analysis and to analyse said sound input by processing based on frequency filters.

7. A projector device according to any of claims 1-5, wherein the controller comprises a visualisation module operable to receive a sound for analysis and to analyse said sound input by digital signal processing techniques.

8. A projector device according to claim 6 or 7, wherein the visualisation module comprises a mapping unit for mapping the results of the analysis on to an image in a manner which uses predetermined criteria to drive movement of said image.

9. A projector device according to any preceding claim, comprising a game module.

10. A projector device according to claim 9, wherein said game module has access to a library of games.

11. A projector device according to claim 10, wherein at least a part of said library of games is accessed via the Internet.

12. A projector device according to any preceding claim, comprising a time module.

13. A projector device according to any preceding claim, comprising a switch interface.

14. A projector device according to any preceding claim comprising an IR interface arranged to receive and process user control inputs.

15. A projector device according to any preceding claim, comprising a USB interface.

16. A projector device according to any preceding claim, wherein the projector comprises a light source arranged to project light through a substantially transparent screen.

17. A projector device according to claim 16, wherein the screen is an LCD screen.

18. A projector device according to claim 16 or 17, wherein the screen is driven by a screen controller receiving a driving input from the controller.

19. A projector device according to any preceding claim, wherein the projector has a light source comprising one or more LEDs.

20. A projector device according to claim the projector has a light source comprising elements of a plurality of predetermined colours and colour selection is based at least in part on one or more predetermined characteristics of said sound input.

21. A projector device according to any preceding claim, comprising a lens.

22. A projector device according to any preceding claim, comprising a battery power supply.

23. A projector device according to any preceding claim, wherein said controller is operable to analyse the characteristic of the put sound selected from one or more of: frequency; tempo; and loudness.

24. A projector device according to any preceding claim, comprising an image store for holding, temporarily or otherwise, one or more images to be projected.

25. A projector device according to claim 23, wherein an image to be projected is a character which, in use, exhibits animated movements driven in coordination with said predetermined characteristics of the sound input.

26. A projector device according to any preceding claim, wherein said sound input comprises music.

27. A projector device according to any preceding claim, capable of coupling with a remote storage facility holding a plurality of characters suitable for display via said projector.

28. A projector device according to any preceding claim, comprising a time module coupled to the projector.

29. A projector device comprising: a microphone, a visualisation controller operable to receive a sound input from the microphone, to analyse said sound input and to generate a moving image exhibiting movements which are responsive to said sound input such that the movements are coordinated with one or more predetermined characteristics of said sound input in real-time, and a projector unit.

30. A projector device comprising: a screen controller; a substantially transparent screen; a light source arranged to project through said substantially transparent screen; and a visualisation unit arranged to generate moving images which, in use, exhibit movements coordinated with one or more predetermined characteristics of a sound.