WO2012080785A1

WO2012080785A1 - Imaging device and imaging method

Info

Publication number: WO2012080785A1
Application number: PCT/IB2010/055881
Authority: WO
Inventors: Ishac Bertran Trepat
Original assignee: Ishac Bertran Trepat
Priority date: 2010-12-16
Filing date: 2010-12-16
Publication date: 2012-06-21

Abstract

An imaging device comprises a digital camera for capturing a still image, a memory for storing images, a screen for displaying images from the memory and suitable to support at least one physical object to be imaged, and a support arm for positioning the digital camera with respect to the screen in such a way that when at least one physical object is supported by the screen, said physical object is in the field of vision of the digital camera. An imaging method may involve obtaining and displaying sequences of still images using at least two different captured still images of a physical object; each still image may be captured after displaying a reference image on the screen and then placing the physical object on the screen with the guide of said reference image. This reference may be another, previously captured, image of the object.

Description

IMAGING DEVICE AND IMAGING METHOD

The present invention relates to an imaging device and an imaging method that can be usefully employed for example as an educational or entertainment tool.

BACKGROUND ART

Within the present-day wide range of educational kits for children, a certain amount of devices related to capturing images of objects are being developed.

Among those, the systems for constructing an image sequence are relatively new in the field of children's toys. A typical example of such a system may be a group of devices designed by LEGO™, which include a camera aimed to be used by the child, enabling him to capture a series of still images and, by means of a computer program embedded on the own camera, or by connecting it to a PC, the child can reproduce said series of still image in the form of a "stop motion" movie, thus creating the illusion of an action film.

However, during the process of capturing the different still images, the child is left to rely on its own knowledge on the making of stop motion movies, to capture each image, and only when finishing the capturing of all the desired still images, the child can see them in combination, thus being difficult to obtain a fluid action on the final movie.

On the other hand, a further toy widely known is a typical painting board aimed to children, which, by means of a slide-projector, enables the kid to trace an image by projecting a slide to the board, thus using it as a reference. But in this case, although a reference is provided to the child to obtain an image by tracing it, it is only possible to use it on a single image, not relating it to other previous or future images.

SUMMARY OF THE INVENTION

It is an aim of the present invention to provide an improved stop motion animation tool that can be useful for both entertainment and educational purposes. Within this aim, a particular object of the present invention is for example to provide an imaging device and imaging methods that allow a user to build stop motion sequences in a simple and guided way. This aim and object are fulfilled by the provision of an imaging device as claimed in claim 1 and the methods claimed in claims 18, 25 and 31 .

Embodiments of the device and methods according to the invention provide convenient tools for stop motion animation, such as recording an animation in an easy and satisfactory way with any kind of desired object; additionally, they also provide other functions such as for example allowing a child to practice skills such as shape recognition, with a guide showing the position where certain objects have to be placed. Optional and advantageous features of the device and methods are set out in the dependent claims.

Additional objects, advantages and features of embodiments of the invention will become apparent to those skilled in the art upon examination of the description, or may be learned by practice of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

Particular embodiments of the present invention will be described in the following by way of non-limiting examples, with reference to the appended drawings, in which:

FIG. 1 is a graphical representation of an imaging device according to an embodiment of the invention;

FIG. 2 is a graphical representation illustrating adjustment of the position of the digital camera by moving the support arm in an imaging device according to an embodiment of the invention;

FIG. 3 is a graphical representation illustrating calibration of an imaging device according to an embodiment of the invention.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION In the following descriptions, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be understood, however, to one skilled in the art, that the present invention may be practiced without some or all of these specific details. In other instances, well known elements have not been described in detail in order not to unnecessarily obscure the present invention.

FIG. 1 is a graphical representation of an imaging device according to an embodiment of the invention, said imaging device comprising a conventional digital camera 1 1 for capturing a still image, a memory (e.g. RAM, USB memory, cartridges, etc.) for storing images, a screen 12 (e.g. a LCD screen) for displaying images from the memory and suitable to support at least one physical object 1 6 to be imaged, and a support arm 13 for positioning the digital camera 1 1 with respect to the screen 12 in such a way that when at least one physical object 1 6 is supported by the screen 12, said physical object 1 6 is in the field of vision of the digital camera 1 1 .

The imaging device may also comprise interaction means for users of the imaging device interacting with it and a control unit for executing user commands inputted through the interaction means and any kind of command related to different computer programs for operating the imaging device, as for example: educational programs, calibration programs, games, programs for making stop motion movies, etc. Said computer programs may be stored in, for example, cartridges, USB memories, etc., so that changing from one application to another may only be a question of changing, for example, the cartridge or the USB memory.

The interaction means may comprise, for example, at least one of among the following control elements:

Buttons:

- Record: capture a frame

- Prev. / Next: mode Assistant / Free Animation: allows to navigate through frames, mode Browse: allows to navigate through recorded movies.

- Delete / Back: allows to delete a frame (mode Assistant, Free

Animation) or a movie (mode Browse). Back in the menus.

- Play: play the movie - Stop: stop the movie

- Save: save the movie

Toggle switches:

- switch from showing tutorial to showing recorded frames.

- switch from current picture to onion-skinning, showing a tale with different frames in transparency.

- while playing, switch from Loop or Back&Forth

Knob: change between 3 modes:

- Assistant: the display shows a guide showing the position for the elements. It works with the provided elements and cartridges.

- Free Animation: kids can record an animation with the elements they want, even parts of their body.

- Browse: kids can browse movies that have been saved in that platform, or in other schools' platforms.

In preferred embodiments of the invention, as also shown in Figure 1 , the imaging device comprises means 14,15 for adjusting the position of the digital camera 1 1 , as for example a hinge 14 or similar connecting the support arm 13 to the screen 12 and another hinge15 or similar connecting the digital camera 1 1 to the support arm 13.

In some embodiments of the invention, as illustrated in Figure 3, the digital camera 1 1 is adapted for obtaining preview images 36;37, and the imaging device further comprises calibrating means, said means comprising means for displaying, on a first part 34 of the screen, a calibration image 34 stored in the memory and means for displaying on a second part 35;36;37 of the screen preview images 36;37, obtained by the digital camera 1 1 , of the calibration image 34 displayed on the first part 34 of the screen, whereby said calibration image 34 displayed on the first part 34 of the screen and said preview image 36;37 displayed on the second part 35;36;37 of the screen may be visually compared by a user to adjust the position of said digital camera. Then, a user of the imaging device may adjust 38 the position of the camera 1 1 for transitioning from a not aligned preview image 36 to an aligned preview image 37 in relation to the calibration image 34.

In preferred embodiments, the imaging device further comprises means for, in case of a preview image from the digital camera representing at least one physical object being supported by the screen, recognizing said physical object from the preview image.

In preferred embodiments of the invention, the imaging device further comprises means for, in case of the captured still image representing at least one physical object being supported by the screen, recognizing said physical object from the captured still image.

In some embodiments of the invention, the memory is adapted for storing predetermined audio signals, and the imaging device further comprises an audio system for reproducing a predetermined audio signal from the memory depending on the result of the physical object recognition.

Preferably, the imaging device further comprises means for storing in the memory said predetermined audio signal in association with the captured still image.

In a preferred embodiment of the invention, the imaging device further comprises sequencing means for obtaining a sequence of still images by sequencing at least two still images stored in the memory; and the memory is adapted for storing sequences of still images.

In some embodiments, the sequencing means are adapted for sequencing together a sequence stored in the memory and a still image stored in the memory.

In preferred embodiments, the sequencing means are adapted for sequencing together two sequences stored in the memory. In preferred embodiments of the invention, the imaging device further comprises means for displaying on the screen at least a sequence of images stored in the memory.

In some embodiments of the invention, the imaging device further comprises means for continuously repeating displaying on the screen a sequence of images stored in the memory. Preferably, in alternate repetitions of displaying on the screen a sequence of images stored in the memory, the still images of the sequence are displayed in ascending order and in descending order, alternately. In a preferred embodiment of the invention, the screen is substantially horizontally arranged when in use.

In some embodiments, the imaging device further comprises a second screen substantially vertically arranged when in use, for displaying pre-obtained images from the memory.

In preferred embodiments, the imaging device further comprises means for connecting the imaging device to at least one communications network. According to some embodiments, at least two imaging devices are connected, through the connection means comprised in each imaging device, to at least one shared communications network. Said network of imaging devices allows interchanging still images and sequences of still images for making collaborative movies, using connected platforms of imaging devices in, for example, different schools.

According to the present preferred embodiment, a user can interact in multiple ways with the imaging device, depending on the computer programs loaded in the cartridges of the device, which may comprise several different educational and/or entertaining games or interactive programs.

A first type of interactive playing is the one involving the creation of a sequence of still images, which can be viewed as a "stop motion" movie. These interactions are divided in two cases: the ones where the device and its computer program guide the user in the process of obtaining a sequence of still images similar to a one previously stored in the imaging device (thus "recreating" or copying an already existing sequence or "stop motion" movie), and the one where the user creates the sequence of still images, and uses as a reference, for each image to be captured, an image previously captured by himself.

In the following examples, the user has a set of differently shaped pieces which can be displayed on top of the screen, enabling the imaging device to capture an image of them, although it is obvious that any object can be placed on top of the screen to be imaged by the camera of the device. In the case of the obtaining of a sequence similar to a previously stored one, in an example, when starting the obtaining of the sequence, the device displays a first image from a pre-stored still image sequence in its horizontally displayed screen. The image displayed on the screen depicts a photograph of, for example, a square piece from the set of differently shaped pieces which the user has. Then, the user has to place the corresponding square piece on top of the screen in a position where the piece is placed corresponding to the image shown below it.

Afterwards, the user can press a capturing button on the device, which makes the device to remove the image displayed on the screen and used as a reference to the user, thus capturing and storing an image of the object displayed on top of the screen.

Then, the second reference image from the pre-stored still image sequence is displayed on the screen, thus enabling the user to repeat the same he did with the first reference image, i.e. displaying the object on top of the screen in a place corresponding to the second image displayed on the screen below it, and, in an analogous way, upon the pressing of the capturing button, the reference image is removed and a further image is captured and stored.

Therefore, repeating these actions for each image of the pre-stored sequence, the user is able to, using each image of the pre-stored sequence of still images as a guide, obtain a still image sequence similar to the pre-stored one, which can be played as a "stop motion" movie afterwards.

This way, the use of the device by a child enables him to learn, recognize and experiment with different shapes, colours and types of movement, depending on the pre-stored sequence to be reproduced. The guidance enables to teach and enhance visual skills on the child, using different sets of pieces and, for example, presenting mathematics or physics concepts such as the different types of movements, while still being an entertaining tool for a child.

This type of games can be enhanced and expanded by adding a recognition feature on the imaging device. That is, whenever a shape is displayed on top of a reference image, an audio signal corresponding to a correct or incorrect corresponding of the shape with the image displayed below it can be added, indicating the user whenever he has correctly displayed the shape or not on top of the screen. This recognition can be embodied in a simple recognition software using the reference images and the actual image being captured by the camera.

Additionally, the imaging device can comprise a second screen displayed vertically. This enables, guided by the sequence of images displayed in the horizontal screen, to display 3D objects whose bases correspond to the images of the pre-stored sequence shown in the horizontal screen, and, by means of placing the camera directed towards the vertical screen, capturing images of the 3D objects, obtaining a new still image sequence which has been guided by images displaying the base of the objects on the horizontal screen.

In a second case of these interactive games, the user also has the objective of obtaining a sequence of still images to, for example, be reproduced as a "stop motion" movie, using the same setting of the device. However, in this case, after the first captured image, the device displays it on the horizontal screen, thus enabling the user to use it as a reference to a second image (for example, enabling the user to display the shape used in the first image in a place adjacent to the place where it was in the previous image). Then, upon the pressing of a capturing button, the image is removed from the screen and a second image is captured.

After said capturing, the previously captured second image is displayed on the screen and, subsequently, a further image can be captured, using as a reference the second image. Therefore, each still image to be used on the final sequence can be captured using as a reference its previously captured image, thus enabling to foresee the movements of the shapes on the final obtained sequence. Again, when used by a child, the reference of a previously captured images enables him to obtain a sequence according to his wishes, and determining, for example, different types of movement (e.g. placing the shapes separately from each other in between images, which results in a faster movement of the shape in the sequence, when played as a stop motion movie).

Also, in an analogous way as in the first type of games, the imaging device can comprise a second screen displayed vertically, thus enabling to obtain a sequence of 3D objects displayed on top of the horizontal screen and capturing images with the camera directed towards the vertical screen. In this case, background images may be displayed on said vertical screen to improve quality of animations, for example, stop motion movies.

Furthermore, in both previously described types of game, the finally obtained sequences can be stored within a memory block of the device, and/or be sent to other imaging devices, enabling the exchange of different "stop motion" movies between users, for either an educational or entertaining purpose.

Figure 3 shows a process for calibrating the device, that is, of adjusting the position of the digital camera 1 1 such that it is suitably arranged with respect to the screen 12.

In a first step 31 performed when the device is set in calibration mode, a calibration image stored in the memory is displayed on a first part 34 of the screen 12. The camera 1 1 is set in an initial position with respect to the screen, from which a preview of said calibration image displayed on the first part 34 of the screen 12 can be obtained with the camera.

In a second step 32 of the calibration process, the preview image 36 obtained with the camera 1 1 is displayed on a second part 35 of the screen 12. As can be appreciated in figure 3, the preview image 36 will generally be displaced and/or rotated with respect to the screen; the degree of error depends on the position of the camera 1 1 with respect to the screen 12. The user visually compares the calibration image displayed on the first part of the screen 34 with the preview image 36 displayed on the second part 35 of the screen, and in a third step 33 of the calibration process, adjusts the position of the camera, by means of displacements and rotations as shown by arrows 38, until the preview image matches the calibration image on the screen 12, as shown with reference 37 on the figure. At this point, the camera 1 1 is correctly positioned with respect to the screen.

As can be derived from previous descriptions, the practical applications of the imaging device and methods according to the invention are many and varied, especially in the educational field. Embodiments of the device may be an interactive educational tool for school that enables children to learn and experiment with different sets of elements using animation. The device aims to use the physicality and the animated outcome of stop motion animation to bridge the gap between abstract concepts from maths, physics or arts (usually represented by graphs, equations or words) and reality. At the same time, use of the device gives a progressive learning of non-stop motion techniques in order to create better and more realistic animations.

Some of the possibilities of the system using animation are, for example: learn the evolution of weather simulating maps; show lunar phases; show a map and the position of troops of a certain invasion, where the children have to place the troops in different positions on the map, so at the end they have an animation of a piece of history; animate pieces of reality placing an object in different positions following a math formula to draw a graph; show evolution of animate things that evolve slowly, by taking a picture every day, for example a plant growing.

Other applications are possible by the use of camera recognition, such as placing objects that represent different sound to create a tune, or placing objects in a magnetic field and see how they affect the field.

The possibility of network connection in a community allows important advantages, not only related to sharing animations but also to collaborative work using connected platforms in different schools.

Different sets of elements and programs may be designed to teach specific contents and/or for a certain age group; teachers can easily create new animation exercises and share them with the community.

Although only a number of particular embodiments and examples of the invention have been disclosed herein, it will be understood by those skilled in the art that other alternative embodiments and/or uses of the invention and obvious modifications and equivalents thereof are possible. Furthermore, the present invention covers all possible combinations of the particular embodiments described. Reference signs related to drawings and placed in parentheses in a claim, are solely for attempting to increase the intelligibility of the claim, and shall not be construed as limiting the scope of the claim. Thus, the scope of the present invention should not be limited by particular embodiments, but should be determined only by a fair reading of the claims that follow.

Claims

1 . An imaging device, comprising:

a digital camera for capturing a still image;

· a memory for storing images;

a screen for displaying images from the memory and suitable to support at least one physical object to be imaged; and

a support arm for positioning the digital camera with respect to the screen in such a way that when at least one physical object is supported by the screen, said physical object is in the field of vision of the digital camera.

2. The device according to claim 1 , wherein the support arm comprises means for adjusting the position of the digital camera.

3. The device according to any of claims 1 or 2, wherein the digital camera is adapted for obtaining preview images;

and wherein the device further comprises calibrating means, said means comprising:

means for displaying, on a first part of the screen, a calibration image stored in the memory; and

means for displaying on a second part of the screen preview images, obtained by the digital camera, of the calibration image displayed on the first part of the screen,

whereby said calibration image displayed on the first part of the screen and said preview image displayed on the second part of the screen may be visually compared by a user to adjust the position of said digital camera.

4. The device according to claim 3, further comprising means for, in case of a preview image from the digital camera representing at least one physical object being supported by the screen, recognizing said physical object from the preview image.

5. The device according to any of claims 1 to 4, further comprising means for, in case of the captured still image representing at least one physical object being supported by the screen, recognizing said physical object from the captured still image.

6. The device according to any of claims 4 or 5, wherein the memory is adapted for storing predetermined audio signals; and wherein the device further comprises an audio system for reproducing a predetermined audio signal from the memory depending on the result of the physical object recognition.

7. The device according to claim 6, further comprising means for storing in the memory said predetermined audio signal in association with the captured still image.

8. The device according to any of claims 1 to 7, further comprising sequencing means for obtaining a sequence of still images by sequencing at least two still images stored in the memory; and wherein the memory is adapted for storing sequences of still images.

9. The device according to claims 8, wherein the sequencing means are adapted for sequencing together a sequence stored in the memory and a still image stored in the memory.

10. The device according to claim 9, wherein the sequencing means are adapted for sequencing together two sequences stored in the memory.

1 1 . The device according to any of claims 8 to 10, further comprising means for displaying on the screen at least a sequence of images stored in the memory.

12. The device according to any of claims 8 to 1 1 , further comprising means for continuously repeating displaying on the screen a sequence of images stored in the memory.

13. The device according to claim 12, wherein in alternate repetitions, the still images of the sequence are displayed in ascending order and in descending order, alternately.

14. The device according to any of claims 1 to 13, wherein the screen is substantially horizontally arranged when in use.

15. The device according to any of claims 1 to 14, further comprising a second screen substantially vertically arranged when in use, for displaying pre-obtained images from the memory.

1 6. The device according to any of claims 1 to 15, further comprising means for connecting the device to at least one communications network.

17. A network of at least two imaging devices according to claim 1 6, wherein each of said imaging devices is connected, through the connection means comprised in the device, to at least one shared communications network.

18. A method for obtaining a sequence of still images from a pre-obtained sequence of reference images through an imaging device, wherein the pre- obtained sequence of reference images is obtained from a memory of the device, and wherein the method comprises:

for each reference image of the pre-obtained sequence of reference images from the memory:

displaying on a screen the reference image;

when detecting a capturing request related to the displayed reference image:

· capturing a still image through a digital camera which is positioned with respect to the screen displaying the reference image in such a way that if at least one physical object is supported by the screen, said physical object is in the field of vision of the digital camera;

· storing the captured still image into the memory;

obtaining a sequence of still images by sequencing the captured still images.

19. The method according to claim 18, further comprising:

for each preview image from the digital camera before detecting the capturing request related to the displayed reference image:

in case of the preview image representing at least one physical object being supported by the screen:

recognizing said physical object represented by the preview image; · reproducing a predetermined audio signal from the memory according to the result of recognizing said physical object from the preview image.

20. The method according to claim 19, further comprising:

in case of the captured still image representing at least one physical object being supported by the screen:

recognizing said physical object represented by the captured still image;

reproducing a predetermined audio signal from the memory according to the result of recognizing said physical object from the captured still image; storing in the memory said predetermined audio signal in association with the captured still image.

21 . The method according to claim 20, further comprising:

obtaining a pre-obtained sequence of background images, each of said background images being related to at least one reference image of the pre- obtained sequence of reference images;

and wherein displaying on the screen the reference image comprises displaying on the horizontal screen the reference image and displaying on the vertical screen the background image related to the reference image.

22. A computer program product comprising program instructions for causing a computer to perform a method for obtaining a sequence of still images from a pre-obtained sequence of reference images according to any of claims 18 to 21 .

23. A computer program product according to claim 22, embodied on a storage medium.

24. A computer program product according to claim 22, carried on a carrier signal.

25. A method for obtaining a sequence of still images by self-reference through an imaging device, the method comprising:

capturing a first still image through a digital camera which is positioned with respect to a screen in such a way that if at least one physical object is supported by the screen, said physical object is in the field of vision of the digital camera;

storing the first captured still image into a memory;

taking the first captured still image as reference image; displaying on the screen the reference image;

when detecting a capturing request related to the displayed reference image:

capturing a further still image through the digital camera;

storing the further captured still image into the memory;

· taking the further captured still image as the reference image; in case of not detecting an ending request:

transferring the control of the method to displaying on the screen the reference image;

obtaining the sequence of still images by sequencing the first captured still image and the further captured still images.

26. The method according to claim 25, further comprising cancelling displaying on the screen the reference image before capturing the still image.

27. The method according to claim 26, further comprising:

obtaining a pre-obtained background image;

displaying on a second vertical screen the pre-obtained background image.

28. A computer program product comprising program instructions for causing a computer to perform a method for obtaining a sequence of still images by self-reference according to any of claims 25 to 27.

29. A method for calibrating an imaging device according to any of claims 3 to 1 6, the method comprising:

displaying, on the first part of the screen, the pre-obtained calibration image from the memory;

displaying, on the second part of the screen, preview images of the pre-obtained calibration image displayed on the first part of the screen, whereby a user may visually compare the images on the two parts of the screen to adjust the position of said digital camera.

30. A computer program product comprising program instructions for causing a computer to perform a method for calibrating an imaging device according to claim 29.

31 . An imaging method, comprising the steps of: providing a memory for storing images;

providing a screen for displaying images from the memory and suitable to support at least one physical object to be imaged;

placing at least one physical object on the screen;

· positioning a digital camera with respect to the screen such that the physical object is in the field of vision of the camera;

capturing a still image of said object placed on the screen; and storing said captured still image in the memory.

32. An imaging method as claimed in claim 31 , further comprising the step of displaying on the screen a reference image before placing said physical object on the screen.

33. An imaging method as claimed in claim 32, wherein said reference image displayed on the screen before placing said physical object is another still image of the physical object, captured previously by the digital camera, whereby a user may employ said reference image displayed on the screen to suitably position the physical object.

34. An imaging method as claimed in any of claims 31 to 33, further

comprising the steps of:

obtaining a sequence of still images using at least two different captured still images of the physical object;

storing the sequence in the memory; and

· displaying the sequence on the screen.