WO2023087039A1

WO2023087039A1 - Device for operating hardware

Info

Publication number: WO2023087039A1
Application number: PCT/AT2022/060120
Authority: WO
Inventors: Markus Lenger; David Theil; Nikolaus GMOSER
Original assignee: Markus Lenger; David Theil; Gmoser Nikolaus
Priority date: 2021-11-18
Filing date: 2022-04-15
Publication date: 2023-05-25
Also published as: AT525684A1

Abstract

The invention relates to a device (1) comprising a housing (5), wherein the device (1) is intended for use with electronic hardware (2) that has a camera (6) or an NFC interface, wherein the device (1) has a holder or receptacle for the electronic hardware (2) at which the electronic hardware is able to be inserted in or on the housing (5) in a releasable manner, and wherein the device (1) has an activation object holder or activation object receptacle for at least one activation object (3), which activation object (3) comprises at least one feature able to be detected by the electronic hardware (2), in the form of an optical feature (4) or an NFC token, wherein the feature is able to be detected by the electronic hardware (2) when the electronic hardware (2) is located in the holder or receptacle of the housing (5) and the activation object (3) is located in the activation object holder or activation object receptacle of the housing (5).

Description

Device for operating hardware

The invention relates to a housing for accommodating electronic hardware, in particular a smartphone or tablet, the housing enabling a user to operate an application running on the hardware by placing a selectable object on the housing and by the user physically interacting with the housing . By operating the housing, the application running on the hardware triggers an action, such as connecting to a streaming application for playing audio content, starting or inputting audio games, starting or ending phone calls, and the like.

The case allows people to operate the application without direct interaction with the electronic hardware. For example, people who are not able to write and/or children.

State of the art

Devices for playing audio content are well known from the prior art. These can be divided into devices with analogue and those with digital sound carriers. Analogue sound carriers are, for example, records or audio cassettes. Examples of digital sound carriers are CDs or MP3s.

Another distinguishing feature is whether the audio content is available physically, i.e. as a tangible object, on a sound carrier such as a CD, record or cassette, or as digital information in the memory of a device, and is therefore immaterial.

A big advantage of physical sound carriers is that you only have to carry out a few and usually very simple operations in order to play back the desired content.

If the audio content is available digitally in the memory of a device, far more complex operating steps are necessary to play the desired content. In most cases, the user must be able to read and interpret the screen content. People who cannot read therefore hardly have the opportunity to call up this content independently. This type of interaction via writing is referred to below as the written human-machine interface (MMS for short).

Another way of playing audio content that is becoming more common is streaming. This is digital, not physical data. These are not stored permanently on the device, but only downloaded from the Internet when required and stored temporarily on the playback device, usually a computer, smartphone or tablet, for the duration of the playback.

The great advantage of streaming is that you can access a large amount of data without having to make storage space available for it.

One problem with audio streaming, similar to that with MP3 players, is that the menu navigation works via text, which represents an insurmountable hurdle for illiterate people (such as children).

In addition to CD and cassette players, there are also devices in which a sensor detects an object and the detection of this triggers the playback of an audio file stored on the device. The audio file is not stored on the object as is the case with physical sound carriers, but is only activated by it. Such devices are disclosed in EP 3092043 A1 and EP 3594833 A1. Devices are also known with which playful interactions via audio signals are possible, so-called audio games. For example, the device specifies a rhythm or a melody that the user has to imitate by interacting with the device. If the imitation is successful, he reaches the next level with a mostly difficult task.

Interactive radio plays are also known in which the listener is repeatedly asked to intervene in the course of the story through his or her decisions. This type of interactive radio play is mostly played on computers or similar devices such as smartphones or tablets, since these devices can not only send information, but also receive and process it. For this purpose, a screen is usually used for the input.

Interaction with streaming content takes place almost exclusively via screens. However, there is research showing that too much screen time can be detrimental to children's healthy development.

In addition, when their children use streaming services, parents have a much smaller overview of the content consumed by the children.

Special audio playback devices are known for children. There are players for both physical and intangible audio content.

Both players for CDs and for cassettes are known. However, these sound carriers are being used less and less because they no longer correspond to today's media consumption.

Also MP3 players for children are known. In this text, MP3 is used as an umbrella term for all digital audio content. These MP3 players are available with a display and text-based MMS or without a display. MP3 players without written MMS have only a few symbols or buttons for selecting the content and can therefore only store a small amount of content, or the user can only select a small amount of this content. Written MMS devices create a barrier for those who cannot read the written language.

The prior art therefore has the disadvantage that content or interactions take place either by acquiring information from a device or by interacting with special devices without a display, which have their own hardware integrated in the device housing.

The object on which the invention is based is to provide an improved or simplified device for display-free interaction with an application running on hardware.

A device according to claim 1 is proposed for solving the task.

The invention relates to a device comprising a housing, the device being intended for use with electronic hardware which has a camera or an NFC interface, the device having a mount or receptacle for the electronic hardware, on which the electronic hardware is or can be used detachably on the housing and wherein the device has an activation object holder or activation object receptacle for at least one activation object, which activation object comprises at least one feature that can be detected by the electronic hardware, in the form of an optical feature or an NFC token, the feature of the electronic hardware is detectable when the electronic hardware is in the holder or receptacle of the housing and the activation object is in the activation object holder or activation object receptacle of the housing. In a first embodiment variant, the invention relates to a device for accommodating electronic hardware such as a smartphone, tablet or other hardware that has the necessary properties, with at least one activation object being present in addition to the device, which has an optical feature that differs from the electronic hardware and the associated software can be recognized. The electronic hardware is preferably a smart device. A connection to the Internet can be established with the electronic hardware, in particular via mobile Internet or WLAN. The advantage of this is that the device itself does not need to have any hardware for wireless communication, so that the device itself can be produced inexpensively.

An application is installed on the electronic hardware or can be called up via the Internet, which uses the optical feature of the activation object to trigger an action. To do this, the application accesses a camera on the hardware. The advantage of this is that the device itself does not need to have any hardware for detecting the activation object, so that the device itself can be produced inexpensively.

In a second embodiment variant, the invention relates to a device for receiving electronic hardware such as a smartphone, tablet or other hardware that has the necessary properties, wherein in addition to the device there is at least one activation object that has an NFC-based token as a digital feature, which can be recognized by the electronic hardware and associated software. The electronic hardware is preferably a smart device. A connection to the Internet can be established with the electronic hardware, in particular via mobile Internet or WLAN. The advantage of this is that the device itself does not need to have any hardware for wireless communication, so that the device itself can be produced inexpensively.

An application is installed on the electronic hardware or can be called up via the Internet, which application triggers an action based on the digital feature of the activation object. To do this, the application accesses an NFC interface on the hardware. The advantage of this is that the device itself does not need to have any hardware for detecting the activation object, so that the device itself can be produced inexpensively.

The hardware is used as an active NFC reader to read the NFC token in the form of a passive transponder. For this purpose, an antenna of the hardware generates a high-frequency electromagnetic alternating field. If an NFC token, i.e. a passive transponder, enters the vicinity of the high-frequency field, it is briefly supplied with energy. Passive transponders do not generate a return signal themselves; instead, data is transmitted by modulating the interrogation signal.

Due to the additional possibilities described below, which optical detection of an optical feature offers, the first variant is preferred.

The two variants can also be combined.

In a first combination variant, the activation object has at least one visual feature and one NFC token. Activation objects that include both can be used in a device in such a way that the optical feature is aligned with the camera of an electronic hardware used and the NFC token is located in the communication range of the NFC antenna of the hardware.

Activation objects which include both can also be used in different devices, wherein one device can be present according to the first embodiment and the second device according to the second embodiment. Devices can also have a first activation object receptacle and a second activation object receptacle, wherein activation objects with an optical feature are aligned with the camera of the hardware in the first activation object receptacle and activation objects with NFC tokens can be placed in the vicinity of the electronic hardware in the second activation object receptacle.

In both variants, a command is preferably input to the application through physical interaction of a user with the device. For this purpose, the application accesses a sensor system of the hardware, in particular acceleration sensors and/or position detection sensors. The advantage of this is that the device itself does not need to have any sensors, so that the device itself can be produced inexpensively. If the hardware does not have such sensors, these functions are not available.

It is also advantageous that particularly high-quality cameras, acceleration and/or position detection sensors and communication modules are installed in common smart devices available on the market, such as mobile phones or tablets, and these smart devices are already available in almost every household. Many smart devices, such as mobile phones or tablets, also have an NFC interface for reading NFC tokens.

The electronic hardware preferably also includes lighting, in particular a “camera flash” known from smartphones in the form of at least one light-emitting diode.

In the first embodiment variant, the device in question comprises a housing which has a receptacle for the electronic hardware and a receptacle for the activation object, with at least one camera of the electronic hardware being aimed at the activation object when the electronic hardware and the activation object are in the respective recording.

In the second embodiment variant, the subject device comprises a housing which has a receptacle for the electronic hardware and has a receptacle for the activation object, the NFC token of the activation object being in close proximity to the NFC interface of the electronic hardware when the electronic Hardware and the activation object are located in the respective recording. Local proximity means the area in which the modulated response signal of the token can be generated and received by the hardware. This range is usually a few centimeters. The token of the activation object is preferably at a distance of 0 to 10, in particular 0 to 5 cm from the NFC antenna of the electronic hardware when the electronic hardware and the activation object are in the respective receptacle.

The position of the electronic hardware in the device is preferably fixed to such an extent that little or no relative movement between the housing and the hardware is possible. A relative movement of the hardware in the housing within an area in which the camera of the hardware remains aligned with the activation object or, in the case of the second embodiment variant, the NFC token remains in the reception area of the NFC antenna, is to be understood as slight. The relative movement can be dampened or slowed down by a flexible material such as foam or rubber.

Since known smart devices come in many different sizes, the housing can be specially designed for one type of smart device (smartphone or tablet, or small smartphone or large smartphone).

In order to be able to compensate for size differences between groups of devices or within a group of devices, the holder in the housing can be designed to be adjustable, or adapters or selectable inserts can be used which have a size difference between the hardware and that for the hardware space provided in the housing. For example, slidable, pluggable, Velcro or adhesive stops can be provided in a receiving space, which stops are placed according to the hardware used, in particular to secure them in a plane parallel to the bottom of the device against slipping. Another possibility are elastic stops, which press against the hardware used. Alternatively or additionally, adjustable straps or straps may be present. Alternatively, a large-area elastic element such as a foam mat can be present, into which the hardware used sinks or is pressed in when the device is closed.

Since the housing in question is present without electronic hardware, it can be manufactured and offered inexpensively, so that separate housings can be provided for mobile phone models or large mobile phones, similar to what is known for protective covers. Alternatively, adapters specially dimensioned for hand myodelle or mobile phone sizes can be provided, which are present in the form of a frame around the mobile phone and close the gap between the receptacle in the housing and the respective mobile phone. The adapters can be permanently integrated in the housing, for example glued in place, or they can be loose.

The housing can be in the form of a kit, in particular as a plug-in kit, in particular made of cardboard, as is known from small pieces of furniture or cardboard furniture. The advantage is that hardly any storage space is required for the new product and the assembly itself can be an experience for the user, especially a child.

The housing preferably has openings as sound breakthroughs.

The electronic hardware preferably includes a display.

The housing preferably covers the display of the electronic hardware.

The display of the hardware is preferably turned away from the activation object.

It is preferred that the device itself has no camera and no loudspeaker. It is preferred that the device itself has no electronic components, ie no NFC interface either.

It is preferred that the device completely encloses electronic hardware used in it.

It is preferred that the electronic hardware has a plate-like structure and that the two flat sides of the hardware are parallel to the bottom surface of the device.

In one embodiment variant, the receptacle of the housing for the hardware can be locked, for example by including a lock (combination lock or lock with key) or eyelets for attaching a padlock. Suitable implementations for a device made of cardboard are known to those skilled in the art, for example from lockable diaries.

In one embodiment variant, removal of the hardware is recognized by the application running on the hardware, in particular by evaluating camera images and/or sensor data from the hardware. At least one action is preferably stored in the application, which is executed or can be optionally executed when the hardware is removed. An action can be selected from the group of functions including: stop the current audio content; the issuance of a warning tone; sending a notification to another device; Enabling a hardware screen lock.

The invention comprises a method for controlling an application which is executed on electronic hardware, which electronic hardware comprises a camera or an NFC interface and which electronic hardware is inserted into the physical device and wherein on the device a Activation object is placed, which activation object comprises at least one feature detectable by the electronic hardware, in the form of an optical feature or an NFC token, the feature being detected by the electronic hardware, in a first step the application with the camera or the NFC -Interface of the electronic hardware detects the feature of the activation object and in a second step the application executes an action stored for the recognized feature.

A first embodiment variant of a method according to the invention for activating or controlling media content comprises a physical device in which electronic hardware is used, with an application being executed on the electronic hardware, with the application using the camera of the electronic hardware taking a picture in a first step of the activation object and, in a second step, the application executes an action stored for the recognized activation object.

A second embodiment of a method according to the invention for activating or controlling media content comprises a physical device in which electronic hardware is used, with an application running on the electronic hardware, with the application being connected to the NFC interface of the electronic hardware in a first step sends a query signal and, in a second step, the application executes an action stored for the recognized activation object on the basis of a modulated response signal.

In both variants, the application preferably accesses a sensor system of the hardware in a further step during or after the execution of the action, so that changes in position and/or acceleration of the device are recognized by the application, with the movements or positions recognized being associated with stored movements or positions are matched and a further action is triggered if they match.

In the first embodiment variant, the application preferably creates recordings of the activation object with the camera of the hardware continuously, preferably at intervals with intervening pauses, with another action being triggered if no activation object is recognized or the activation object has been replaced by another activation object.

In the second embodiment variant, the application preferably sends query signals to the activation object with the NFC antenna of the hardware continuously, preferably at intervals with intervening pauses, with another action being triggered if no activation object is recognized, or the activation object being replaced by another activation object became.

The case can be sold together with the application by a vendor, preferably the application is made available online via an app store. In another variant, the housing can be provided in the sense of an input device comparable to a computer mouse or a keyboard, with a wide variety of applications being controllable with the device.

In one variant, an activation object is permanently integrated in the housing, so that only one predetermined action can be carried out with the device. In a sub-variant of the first embodiment variant, several activation objects are movably integrated in the housing, with one of the activation objects being able to be placed in front of the camera as desired. The multiple activation objects can be present on a common element or can be inserted into a common element. The common element can be used detachably or permanently in the housing. The common element can be in the form of a disk or a ring, with different activation objects coming in front of the camera by rotating the common element. The common element can be in the form of a strip, with different activation objects coming in front of the camera through translation of the common element.

The invention is illustrated by drawings:

1: shows a first embodiment variant of a device viewed obliquely from the front with the object holder open.

FIG. 2: shows the device of the first embodiment variant in a view at an angle from the front with an open object holder and an exemplary embodiment variant of an activation object.

3 : shows the device of the first embodiment variant in a position tilted on its side in an oblique view from the front, looking at the underside of the device with an open holding device for accommodating electronic hardware with the possibility of fixing or removing the electronic hardware.

Fig. 4: shows a side view of the device of the first embodiment variant with inserted electronic hardware as well as a sectional line A and an associated sectional view A.

5: shows the device of the first embodiment variant in a view at an angle from behind and a possible embodiment of an optional cable connection.

6: shows a second embodiment variant of the device in a view at an angle from behind with a possible embodiment of the holding device for accommodating the electronic hardware in the form of a drawer.

7: shows a third embodiment variant of the device in a view at an angle from behind with a possible embodiment of the holding device for accommodating the electronic hardware in the form of a slide-in unit.

Fig. 8: shows a top view of a device with inserted electronic hardware and an inserted activation object as well as a section line B and an associated sectional view B.

9 illustrates an embodiment variant with an object holder or object receptacle in the form of an insertion opening.

10: illustrates a second embodiment variant with an object holder or object receptacle in the form of an insertion opening.

FIGS. 11 and 12 illustrate a first embodiment variant with an activation object that can be manipulated.

FIGS. 13 and 14 illustrate a second embodiment variant with a manipulable activation object.

FIGS. 15 and 16 illustrate a third embodiment variant with a manipulable activation object. 17 and 18 illustrate an embodiment variant with a manipulable object holder.

19 and 20 illustrate a variant embodiment of the device for activation objects with NFC tokens.

First of all, the subject of the invention is described in general terms with validity for all figures. Different design variants are explained with reference to the respective figure.

Figures 1-20 show variants of a device 1 for accommodating electronic hardware 2 such as a smartphone, tablet or other hardware that has the necessary properties, with at least one activation object 3 being present in addition to the device, which has an optical feature 4 that can be recognized by the electronic hardware 2 and the associated software. In the second embodiment variant, the activation object 3 has an NFC token 21 instead of the optical feature 4 or in addition to an optical feature 4 .

The housing 5 of the device 1 is made of a dimensionally stable material. This can be plastic, wood, metal, a composite material or the like.

In a preferred embodiment, the housing 5 consists of a sturdy cardboard box in order to use as few resources as possible and save weight.

In a preferred variant, the housing 5 is large enough to accommodate the electronic hardware 2 in its interior. This means that the electronic hardware 2 is accommodated entirely in the interior of the housing 5, with the housing 5 preferably completely enclosing the electronic hardware 2 in the closed state. The electronic hardware 2 itself has a closed housing and is an independent electronic device that is independent of the physical device 1 . The electronic hardware 2 is therefore not device hardware of the device 1 in question. In this context, device hardware is to be understood as hardware which is assigned to an individual device and is inserted into its housing and remains there (except for repairs or replacement).

So that the electronic hardware 2 is suitable for use in the device in question, it has at least one camera 6 and/or an NFC interface, a loudspeaker 7, a processor and means for wireless communication. In order to be able to use further functions of the present method, the hardware preferably also has one or more of the following components: a light source 8, which shines in the same direction in which the camera 6 is directed; a battery; Acceleration sensors in at least three spatial directions; a gyroscope to detect their position; a module for mobile Internet; a Bluetooth module; a wireless module; a data store; a microphone.

The components that are present in any case and the optional components are installed in the hardware 2 housing. A smartphone or a tablet is particularly suitable as the hardware 2, since these include the required components. Less preferred due to the high production costs and associated high sales prices, it is also possible to provide dedicated hardware 2 for the physical device 1, which includes the above-mentioned components. Advantageously, this dedicated hardware 2 also has a closed housing and can be removed from the device 1 in order to be able to be placed in different devices 1 . Several different devices 1 can be adapted to the respective application, in particular running a game or a quiz or playing audio content, with the user deciding in which of the devices 1 he will insert the hardware 2 . The recordings for the activation objects 3 of the different devices 1 can differ from one another, with separate activation objects 3 that can only be used specifically being able to be present for each different type of recording. For example, a device 1 for running one or more games can only be equipped with activation objects 3 for this one or more games. For example, a device 1 for playing audio content can only be equipped with activation objects 3 for playing audio content.

The device 1 can be provided with a feature that can be detected by the hardware 2, for example with an optically detectable feature, or a feature that can be detected by near-field communication, in particular in the form of an RFID transponder. For example, a code attached to the outside of the device is read with the hardware 2 before insertion. For example, the feature or code can be read when the hardware 2 is inserted into the device 1 . An optical feature can be present on the housing of the device 1 in the area of the receptacle for the activation object 3, so that this is also recorded by the camera of the hardware 2. An RFID transponder can be present in the area of the mount for the hardware 2 so that it can be read by the hardware 2 used.

The recognizable feature can be present individually for each device 1, so that devices 1 can be distinguished individually and/or can be individually configured by a user. The recognizable feature can be present individually for each type of device 1, so that the type or version of the device 1 can be recognized by the hardware 2 or the application running on the hardware 2.

The housing 5 has a holding device 9 for accommodating the electronic hardware 2 . This holding device 9 for accommodating the electronic hardware is made in such a way that the electronic hardware 2 is fixed on or in the device 1 and is prevented from slipping.

The holding device 9 for accommodating the electronic hardware 2 is designed as a flap in the preferred variant of FIGS. 1-4 and FIG. 8 and in the variant of FIGS. 19 and 20, onto or into which the electronic hardware 2 is inserted. The hardware 2 can be placed in a recess in the flap or placed on the surface of the flap. When closing, the electronic hardware 2 is pressed against an elastic material 10 in the housing 5, which holds it in position (FIG. 3, FIG. 8, FIG. 20). Alternatively, at least one rubber band, which holds the electronic hardware 2 in place, can also be used to fasten the electronic hardware 2 . An elastic fabric band, a band or strap with a Velcro fastener, or other fasteners that are preferably infinitely adjustable, or a combination of the features just mentioned, are suitable for holding the hardware 2. The fastening element can be on the flap or otherwise Part of the housing 5 to which the flap is attached via a hinge. In a preferred embodiment variant, the hinge joint is designed as a fold in the cardboard material, so that the flap is present in one piece with a part, in particular a side wall, of the housing 5 .

In a preferred variant, a hook-and-loop fastener serves as the closure for this flap. However, the closure can also be designed as a push button, as a magnetic closure, as an additional flap that is inserted into a slit, or the like. The closure serves to hold the flap in the closed state on the rest of the housing 5, in particular on a side wall of the housing and/or on the bottom of the housing. A piece of the closure is on the flap and a counterpart to this on the rest of the housing 5.

However, the holding device 9 for receiving the electronic hardware 2 can also be designed as a drawer (FIG. 6), in which the electronic hardware 2 is inserted and subsequently pushed into the housing 5 . The holding device 9 can be present as an insert in the housing 5 (FIG. 7). Preference is given to lying within the compartment or outside of the Mitel slot to secure the hardware. For example, the bottom and/or part of the top surface of the insertion space can be provided with an elastic material. For example, there can be an element (flap, slide, or rotary lock) on the outside of the insertion opening on the housing 5, which element can at least partially close the insertion opening. The options just mentioned can also be used to secure a drawer in the housing 5.

Less preferred and not shown in the figures, the electronic hardware 2 can also be attached to the outside of the housing 5, with the camera 6 of the electronic hardware being directed through an opening in the housing 5 into the interior of the device 1 at least in the first embodiment variant.

For example, the electronic hardware 2 can be placed in a recess on an outside of the housing 5 and held in the recess with a slide, a turntable, an eccentric or a belt, rubber band or belt.

In a preferred variant, however, the electronic hardware 2 is fixed in the interior of the housing 5 and thus enables it to be protected against mechanical loads and other influences that endanger the electronic hardware 2 . In a particularly preferred variant, the side of the holding device 9 facing the interior of the housing for receiving the electronic hardware 2, i.e. the area on which the electronic hardware rests, is provided with a soft material in order to make the display of the electronic hardware 2 as smooth as possible when it is present protection. This soft material can be foam, leather, velvet or a similar material. A rubber-like non-slip material such as silicon, natural rubber, petroleum-based rubber-like materials and the like can also be used.

The housing preferably has a contact surface for the electronic hardware 2, which is present between the electronic hardware 2 and the interior of the housing. The contact surface preferably has the camera opening 13 and the sound opening 15 .

In a preferred variant, the holding device 9 for accommodating the electronic hardware 2 is designed in such a way that a large number of different types of electronic hardware 2 can be accommodated.

The holding device 9 for accommodating the electronic hardware 2 is also designed in such a way that the electronic hardware 2 can be removed quickly and easily at any time and placed back in the device 1 just as quickly and easily.

In a preferred variant, the electronic hardware 2 is located on the underside of the device 1 in order to ensure an optimal stand due to a low center of gravity.

In one embodiment variant, the holding device 9 for accommodating the electronic hardware 2 or the housing 5 can provide a possibility for the electronic hardware 2 to be supplied with power. For this purpose, the mounting device 9 or the housing 5 can have a cable opening 11 through which a cable can be routed, so that the electronic hardware 2 can be inserted directly with the cable charging it (FIG. 3).

A further possibility is that the housing 5 includes a socket for a cable connection 12 (FIG. 5). When it is inserted, the electronic hardware 2 is then connected to a further housing-specific cable connection in the form of a plug and can then be supplied with power from the outside at any time via a cable. It is advantageous that, for example, after using his smartphone in the device 1 in question, a parent gets it back charged.

One embodiment variant of the invention is that a rechargeable battery or a power bank is accommodated in the housing 5, preferably in a removable manner, with the electronic hardware being able to be connected to this rechargeable battery or the power bank via a plug. This allows the device 1 to be used regardless of the charge level of the integrated battery of the electronic hardware 2.

In addition to the socket or opening for charging the electronic hardware 2, there can be a socket or opening for connecting an audio cable, in particular with a jack plug, in order to be able to connect an external box, an amplifier or a stereo system. The audio cable can be directly plugged into the electronic hardware 2 socket. Alternatively, the housing 5 can have a socket, with a cable being provided inside the housing 5 in order to connect this socket to the socket of the electronic hardware 2 . An audio signal can also be transmitted from the hardware 2 to an external loudspeaker via radio, Bluetooth or WLAN.

At least in the first embodiment variant, the electronic hardware 2 is accommodated in the housing 5 in such a way that the camera 6 is directed into the interior of the housing 5 . At the point at which the camera 6 is positioned, the housing 5 has an opening, which is referred to below as the camera opening 13, into the housing interior. This is large enough, if a light source 8 is present, to also allow its light into the interior of the housing.

In a preferred variant, the light does not emerge from the interior of the housing to avoid disturbing the user. This means that that area of the interior in which the camera and the light source are present is closed on all sides, or can be closed on all sides by a movable element and/or an activation object 3 . The underside of this area of the interior is closed by the holding device 9 and/or the electronic hardware 2 .

In a particularly preferred variant, the housing 5 has an intermediate wall 14 in the interior, which divides the interior into two partial areas (FIG. 4, FIG. 8). This partition wall 14 makes it possible for at least one sound space or sound breakthrough 15 to exist from the electronic hardware 2 into the interior of the housing. This sound breakthrough 15 or sound space as part of the interior is attached to the point where the loudspeaker 7 of the electronic hardware 2 is located. The device 1 preferably has at least one sound passage opening 19 from the inside of the housing to the outside. This ensures better exit of the sound from the loudspeaker 7 of the electronic hardware 2 from the housing 5, in particular the sound chamber. The sound chamber preferably extends from an inner wall of the base of the device 1 to the top surface of the housing 5. An alternative or additional sound passage opening 19 can be arranged in the area of a front side of the electronic hardware 2, i.e. in the lower area of one of the side surfaces of the housing 5. This is advantageous when the loudspeaker 7 is on one of the end faces of the electronic hardware 2 .

The intermediate wall 14 mentioned at the beginning of the previous paragraph prevents the light for illuminating the activation object 3 from exiting through a sound passage opening 19 .

In the second embodiment variant, it is not necessary to separate the interior into partial areas, as illustrated in FIG. However, an intermediate wall 14 can also be present here, for example in order to increase the stability of the device 1 . Furthermore, the housing 5 has at least one further receptacle or holding device for at least one activation object 3 described above. This is called the object holder 16 in the following text.

This object holder 16 is preferably also designed in such a way that the at least one activation object 3 is prevented from slipping. Alternatively, the object holder 16 can be present as a guide for the activation object 3 in order to specify one or more directions of movement for the insertion, in particular the insertion along an axis, of an activation object 3 . The object holder 16 can also define degrees of freedom of an activated object that has been inserted, in particular release exactly one rotational degree of freedom and/or exactly one or exactly two translatory degrees of freedom. In the first embodiment variant, with an activation object inserted, 3 nm movements of the activation object 3 in the object plane, ie a two-dimensional plane in which the optical feature 4 of the activation object 3 is present, are preferably possible. Alternatively, the activation object 3 has no degrees of freedom when it is inserted in the object holder 16 .

In a preferred variant, the object holder 16 is designed as a flap (FIGS. 1-8, 19-20). In this variant, the housing 5 preferably has a recess 17 for receiving the activation object 3 under the flap. The indentation 17 is somewhat larger, but at least as large as the area of the activation object 3 which rests on the housing 5 . Alternatively or additionally, a depression for the activation object 3 can be provided in the flap.

The object holder 16 can also be designed as a drawer, a slot, an opening, a strap or the like. The object holder 16 can also be designed magnetically, in that there are magnets or a magnet and a magnetizable material on the housing 5 and on the activation object 3 . Another possibility is a Velcro connection between the housing 5 and the activation object 3. Another possibility is a suction cup connection, with the housing 5 or the activation object 3 having a smooth surface for a suction cup. Another possibility is a press fit of the activation object 3 in a recess of the housing 5 or on a projection of the housing 5. Other options are snap, bayonet or screw connections.

The object holder 16 for the activation object 3 has an activation object opening 18 to the interior of the housing 5 at least in the first embodiment variant. This is at a point that enables the camera 6 of the electronic hardware 2 to recognize the optical feature 4 on the activation object 3 . In a preferred variant, the activation object opening 18 and thus the optical feature 4 of the activation object 3 is arranged opposite the camera opening 13 . In this preferred variant, the image plane of the camera 6 and the plane of the activation object opening 18 are parallel to one another. Less preferably, the activation object can be at an angle to the image plane. In a less preferred embodiment variant, there is at least one mirror inside the housing 5 , which is located in the beam path from the activation object 3 to the camera 6 . The mirror can be provided with a manipulation element, which is accessible from the outside of the housing 5, so that the alignment of the mirror can be specified by a user. For example, several activation objects 3 or activation objects 3 with several optical features 4 can be placed on the housing 2, different optical features 4 of the camera 6 being able to be presented by manipulating the mirror.

The activation object opening 18 is preferably designed in such a way that the activation object 3 cannot fall into the interior of the housing 5 . The activation object opening 18 thus has smaller external dimensions than Activation object 3 on. This also applies to the second embodiment variant, in which case the activation object opening 18 can also be omitted, as illustrated in FIG. 20 .

In the first embodiment variant, the object holder 16 together with the activation object opening 18 ensures the correct distance from the camera. The distance between the camera 6 or the camera opening 13 and the activation object opening 18 is preferably at least 3 cm, particularly preferably at least 4 cm, in particular at least 5 cm. The distance between the object holder 16 and the holding device 9 is preferably rigidly specified by the housing 5 in that both holders are stationary and rigid on the housing 5 . In another embodiment variant, at least one of the two holders can be displaced along an axis of the housing 5 or rotated in a plane of the housing in order to create an additional input option for the user by changing the position of the hardware 2 in relation to the optical feature 4 of the activation object 3. For example, the distance between the hardware 2 and the optical feature 4 can be changed by moving one of the mounts in the housing 5 towards the other mount in order to change its normal distance. As a result, the optical feature 4 appears larger or smaller in the image of the camera 6, which can be recognized by the application.

The activation object opening 18 can be open into the interior of the housing or can be closed with an at least partially transparent film, a plastic glass, a glass or another transparent medium.

At least in the first embodiment variant, the at least one activation object 3 has an optical feature 4 on at least one side, which can be recognized by the camera 6 of the electronic hardware 2 and the associated software, i.e. an application running on the hardware 2 . The at least one activation object 3 is designed such that the at least one side bearing the optical feature 4 is formed of a rigid material to prevent the optical feature 4 from bending or crumpling for the camera 6 and associated software becomes unrecognizable. In a preferred variant, the at least one activation object 3 is flat and made from stable cardboard in order to save resources and weight. The activation object is preferably a two-dimensional object in the form of a small plate (FIG. 2), a strip or a disc, with at least one optical feature 4 being present on at least one of the two flat sides.

In another embodiment, the activation object 3 is a three-dimensional object. The three-dimensional object preferably has at least one flat surface on which an optical feature 4 is present. The three-dimensional object can be present, for example, as a skittle or as a play figure with a flat base. However, the three-dimensional object can also have a plurality of optical features 4, which are present in different planes from one another, preferably on a flat surface of the activation object 3 can have an optical feature 4 on all flat surfaces. However, the activation object 3 can also be composed of flat and curved surfaces and be present, for example, as a cylinder, sphere with flattened areas or as an hourglass. Less preferably, an activation object 3 can also have at least one optical feature on at least one curved surface, although this can make detection by the software more difficult.

For receiving three-dimensional activation objects 3 , the housing 5 preferably has a depression into which the activation object 3 can be inserted with a precise fit, with an optical feature of the activation object 3 being aligned in the direction of the camera 6 . Alternatively, the three-dimensional Activation object 3 with one of the options mentioned above (e.g. flap, drawer, slot, magnetic, Velcro, screw, suction, bayonet, clamp or belt mount) of an object mount 16 on the housing 5 are held.

Loosely placing a two- or three-dimensional activation object 3 on a flat surface of the housing 5 or loosely inserting it into a depression in the housing 5 is also less preferred, particularly in applications in which a one-time or short-term presentation of an optical feature is provided.

The optical feature 4 on the activation object 3 can be an image, a color, a pattern or the like. In a preferred variant, the optical feature 4 is a code, in particular a QR code.

Software is installed on the electronic hardware 2 or is run as a cloud or browser application over the Internet. When this software is activated and the electronic hardware 2 is fixed in the housing 5, the user can give commands to the software by inserting (or placing) activation objects 3 in the device 1.

For this purpose, the optical feature 4 on the activation object 3 is filmed or photographed by the camera 6 and recognized by the software application and translated into control commands.

In a preferred variant, the software recognizes the lighting conditions inside the device 1. If these are insufficient, the light source 8 is activated in order to illuminate the optical feature 4 on the activation object 3. In a particularly preferred variant, the light source 8 pulses at a specific interval in order to save power. In order to let light into the device, a partial area or a side surface of the housing 5 can be designed to be translucent. Alternatively, the housing 5 can consist entirely of non-translucent, ie opaque, material. Alternatively, the housing 5 can have slots, a perforation or other narrow or small-area openings.

The following paragraphs apply to both variants.

An action is assigned to the at least one activation object 3 in advance using software. This action can be playing an audio file. This audio file can be accessed via a streaming provider. But this action can also be starting an audio game or calling a specific contact. Other applications that are not explicitly listed here are also conceivable.

As a rule, the user has several different activation objects 3 for different applications. Due to the invention, the user is able to activate and operate the software on the electronic hardware 2 without complicated menu navigation. If several activation objects 3 are present, these preferably have distinctive distinguishing features. These distinguishing features can be, for example, different images, different shapes or surfaces. For example, it is possible for children to activate the different applications via the distinguishing feature. Visually impaired people can also be given access to various applications via different haptic distinguishing features, such as Braille writing/groove patterns. The distinguishing feature can also be the optical feature 4 of the first embodiment. Alternatively, the distinguishing feature is present in addition to the optical feature 4 . In one embodiment, the distinguishing feature is on the opposite side of the activation object from the optical feature 4, in particular when the optical feature 4 as an optical Code (especially one-dimensional or two-dimensional optical code, such as barcode or QR code) is present. The distinguishing feature can also be present as a three-dimensional object.

In the second embodiment variant, the distinguishing feature is in any case present in addition to the digital feature of the NFC token 21 .

In the first embodiment variant, the invention also includes the possibility that the software outputs an optical feature 4 specific to this command for each command, which the user can then produce himself. For example, he can print out activation objects 3 on a conventional printer. Alternatively, the user can assign a function to an existing visual feature 4 or a digital feature of an NFC token 21, for example by the user defining which audio content, link, phone call, etc. is executed upon detection of a visual feature 4 or digital feature. For example, the device 1 provides the user with a number of activation objects 3, in which case an action can already be assigned to them and/or an action can only be assigned to them by the user. Functions already assigned to an optical feature 4 or digital feature at the time of purchase can be changed by the user depending on the implementation, or they can be present in an unchangeable manner.

If an action is now carried out with the software, the user preferably has the option of influencing the action via specific interactions with the device 1 . These interactions are called gestures in the following text.

These gestures can be, for example, tilting along the longitudinal, transverse or other axes of the device 1, tapping on the different sides of the device 1, shaking, circular movements or the like.

In an exemplary variant, when playing audio content, the user can jump forward a certain temporal sequence of the content by tapping on one side, and jump a certain temporal sequence of the audio content backwards by tapping on the opposite side.

The device 1 is designed in such a way that it offers the user enough attack surface to be able to knock on the device 1 from all three spatial directions. The width of the device 1 is preferably at least 5 cm. The length of the device 1 is preferably at least 10 cm. The height of the device 1 is preferably at least 5 cm.

The hardware 2 is preferably aligned with its longitudinal direction in the longitudinal direction of the device 1 and with its broad side along the width of the device 1. The length and width of the device 1 are preferably greater than the length and width of an insertable or inserted hardware 2.

It is also possible by means of the invention to influence an interactive radio play or an audio play or to answer or end a call using such gestures.

Another exemplary gesture is that when you tilt about one of the axes, you play the audio content louder, and when you tilt about the same axis in the opposite direction, the audio content becomes quieter. Alternatively, the volume can also be changed by knocking.

For example, when flipping over another axis, the content can be fast-forwarded or rewound.

In a further variant it is provided that the playback of a content can be paused and/or started by a gesture such as tapping on the housing 5 or a movement of the housing 5 . In a further variant it is provided that a pulsing of the light source 8 can be paused and/or started by a gesture such as knocking on the housing 5 or a movement of the housing 5 . In one embodiment variant, the pulsing of the light source 8 is also automatically paused when the content is paused. In one embodiment variant, the pulsing of the light source 8 is automatically paused if no activation object 3 is inserted.

Another preferred gesture that is used to control the application or software is multiple taps on the housing 5, in particular in the form of a double tap. In an embodiment variant, control can also take place by tapping a rhythm. As already described, the knocking can be detected by a sensor system (in particular acceleration sensors) of the electronic hardware 2 . As an alternative or in addition, the knocking can be detected by a microphone in the hardware 2 . The microphone of the hardware can also be used by the application for speech input and/or sound recognition in order to provide additional, in particular optional, control options. The microphone can also be used, for example, to automatically adjust the volume of audio content to the ambient noise level.

FIG. 9 illustrates that the object holder 16 can be designed as an opening in the housing 5 into which the activation object 3 is inserted.

Variants are shown in FIGS. 10 to 16 in which control commands can be issued to the software by manipulating the activation object 3 .

As illustrated in FIG. 10 , multiple optical features 4 can be present on an activation object 3 . By moving them along an axis, which is preferably defined by the housing 5, they can optionally be moved in front of the camera. This can be used in particular for yes-no inputs for a quiz, a role-playing game, a game story or to control other content. The object holder 16 can be accessible from both sides, as shown, so that activation objects 3 can be pushed in from two sides, or, as shown, an activated object 3 that has been inserted can be accessed from both sides. The activation object 3 is preferably designed to be longer than its guide in the housing 5, so that it protrudes beyond the housing 5 at least on one or both sides. Binary (in the case of two discrete optical features 4) or gradual input (in the case of more than two optical features 4 or an optical feature 4 with a pattern or scale in the direction of the guide) is possible by pushing the activation object 3 from one side of the housing 5 along of the guide to the other side of the housing. A binary input is also possible with only one optical feature 4, with the binary input taking place in that the optical feature 4 is either in the field of view of the camera 6 or not.

11 and 12 illustrate a control (e.g. volume) by detecting the movement or position of the optical feature 4 by using the hardware 2. This is done, for example, by the activation object 3 being present in the object holder 16 in a rotatable manner. The activation object 3 preferably has an attachment point which is accessible on the outside of the housing 5 when the activation object 3 is inserted. The point of attack can be on the activation object 3, or the entire object holder 16 can be rotatable. In the example shown, the activation object 3 has exactly only one (rotatory) degree of freedom in the object plane.

FIGS. 13 and 14 illustrate a further variant for controlling the software or using the hardware

2 by position and/or motion detection of the optical feature 4 and manipulation of the activation object 3 at least one point of attack on the outside of the housing 5. For example, a first action, such as switching further, can take place with a one-time brief manipulation, in particular displacement, of the activation object 3 in the object holder 16. A second action, such as fast-forwarding, can take place if the manipulation of the activation object 3 in the object holder 16 continues. The point of attack can be on the activation object 3, or the entire object holder 16 can be displaceable. As shown, the movement can take place along at least one axis or around a pivot point against a spring or another elastically deformable element (foam, plate spring, rubber...), so that the activation object 3 returns to a starting position after the manipulation has ended. This facilitates the input by a user and expands the input options since the extent and/or the duration of the manipulation can also be determined. In this embodiment variant, the activation object has at least one degree of freedom in the object holder 16, with a movement along the degree of freedom taking place in at least one direction against the restoring force of an element, preferably an elastic element. The movement can also take place in both directions of the degree of freedom against the restoring force of one or more elements. An elastic element can be subjected to tensile and compressive loads when the activation object is connected to the elastic element, for example temporarily, for example by a positive connection when the activation object 3 is inserted, as for the translational degree of freedom in FIGS. 15 and 16 is illustrated. Alternatively, resetting can only take place in one direction. Alternatively, elastic elements can be present in both directions of movement of the activation object 3 or its manipulation area, as illustrated for the rotational degree of freedom in FIGS. 13 and 14.

FIGS. 17 and 18 show that the activation object 3 can be inserted into an object holder 16 held movably in the housing. The object holder 16 can have at least one degree of freedom in the housing 5 as described above for the activation object 3 . In one embodiment variant, the object holder 16 moves along a degree of freedom in at least one direction against the restoring force of an element, preferably an elastic element. In an embodiment variant, the object holder 16 moves along a degree of freedom in both directions against the restoring force of one element or several elements. As illustrated, the elements for exerting a restoring force can be protected between two layers of the housing 5, the outer layer 20 being illustrated as dotted (transparent) in FIG. 17 and solid in FIG. The opening and/or indentation in the object holder 16 can be designed as shown in FIGS. In addition, as shown in FIGS. 1 and 2, a flap can be present, with this flap having a recess for the manipulation element of the object holder 16 at its free end.

Within the scope of the first embodiment variant, it is possible for the activation object 3 to also have an NFC token 21 in addition to one or more optical features 4 . In order to be able to recognize both features at the same time with the electronic hardware 2, it is advantageous if the camera 6 of an electronic hardware 2 used in or on the housing 5 is aligned with the optical feature 4 of an activation object 3 placed in the activation object holder or activation object receptacle and the NFC token 21 of the activation object 3 is in the communication range of the NFC interface of the electronic hardware 2.

19 and 20 show an exemplary device of the second embodiment variant, which can be used exclusively with activation objects 3 comprising an NFC token 21 . However, by additionally providing an activation object opening 18 and a camera opening 13, the device 1 of FIGS. 19 and 20 can also be used for the first embodiment variant. The essential feature of FIGS. 19 and 20 is that the depression 17, into which the activation object 3 can be inserted, is more pronounced than in FIGS. 1-6. This ensures that the NFC token 21 of the activation object 3 is close to the electronic hardware 2 and the housing 5 is large enough to be easily operated by a user with the gestures mentioned above. The distance 24 between the electronic hardware 2 or the inner bottom wall of the housing 5 and the bottom of the depression 17 is less than 5 cm, for example.

If the activation object 3 is in the form of a small plate, it is preferable for the flap of the housing 5 to have a hold-down device 23 which, when the flap is closed, presses the activation object 3 against the bottom of the depression 17 (FIG. 20). If three-dimensional activation objects 3 are used, the hold-down device 23 cannot be present or can act against a base of the activation object 3 .

In order to make it easier to remove the activation object 3 from the depression 17 , the housing 5 can have an opening 22 which extends from the upper side of the housing 5 to the bottom of the depression 17 or to below the bottom of the depression 17 . The flap can cover the opening 22 in the closed state.

Claims

patent claims

1. Device (1) comprising a housing (5), wherein the device (1) for use with an electronic hardware (2) is intended, which has a camera (6) or an NFC interface, characterized in that the device (1) has a holder or holder for the electronic hardware (2), on which the electronic hardware can be detachably inserted in or on the housing (5), and the device (1) has an activation object holder or activation object holder for at least one activation object (3). , Which activation object (3) comprises at least one of the electronic hardware (2) detectable feature in the form of an optical feature (4) or an NFC token, wherein the feature of the electronic hardware (2) is detectable when the electronic Hardware (2) is in the holder or receptacle of the housing (5) and the activation object (3) is in the activation object holder or activation object receptacle of the housing

(5) located.

2. Device (1) according to claim 1, characterized in that the electronic hardware (2) has its own housing and is a separate and independent device from the device (1), in particular a smartphone or a tablet.

3. Device (1) according to one of claims 1 to 2, characterized in that the housing (5) in a region in which a loudspeaker of the electronic hardware (2) can be present, has a sound opening (15) into the interior of the housing and/or has at least one sound passage opening (19) from the inside of the housing to the outside.

4. Device (1) according to any one of claims 1 to 3, characterized in that the holder or receptacle for the electronic hardware (2) comprises a recess, in which recess the electronic hardware (2) can be inserted, the recess in a Outer surface of the housing (5) or in a drawer that can be pushed into the housing (5) or in a flap that is hinged to the housing (5).

5. Device (1) according to one of claims 1 to 4, characterized in that the holder or receptacle for the electronic hardware (2) comprises means for detachable attachment selected from the group of means comprising: a housing (5) articulated flap , the free end of which can be fastened to the housing (5); at least one elastic band, elastic member, or strap that pushes or pulls the electronic hardware (2) against the case (5), drawer, or flap; a rotatable or displaceable element which is movable on the housing (5) and which blocks a removal path for the electronic hardware (2) from the housing (5) in a first position and releases the removal path for the electronic hardware (2) in a second position .

6. Device (1) according to any one of claims 1 to 5, characterized in that it is not a camera itself

(6), no NFC interface and no speaker (7).

7. Device (1) according to any one of claims 1 to 6, characterized in that the device (1) completely encloses hardware (2) inserted into it.

8. Device (1) according to one of claims 1 to 7, characterized in that the electronic hardware (2) has a plate-shaped structure and the two flat sides of the hardware (2) are parallel to the bottom surface of the device (1). Device (1) according to one of Claims 1 to 8, characterized in that the electronic hardware (2) has a display, the device (1) containing the display of the electronic hardware (2 ) completely covered. Device according to one of Claims 1 to 9, characterized in that the camera (6) of electronic hardware (2) used in or on the housing (5) looks at the optical feature (4) of an activation object (3 ) is aligned. Device (1) according to Claim 10, characterized in that the housing (5) has an activation object opening (18) to the interior of the housing (5) in the area of the activation object holder or activation object receptacle and the housing (5) in the area of the camera (6) of the electronic hardware (2) has a camera breakthrough (13) to the interior of the housing (5). Device (1) according to Claim 11, characterized in that the activation object opening (18) is opposite the camera aperture (13) or at least one mirror is present within the housing (5) which is in the beam path from the activation object (3) to the camera (6). located. Device (1) according to one of Claims 11 or 12 in conjunction with Claim 3, characterized in that there is a partition wall (14) inside the housing, which separates that area in which the activation object opening (18) and the camera opening (13) are present from a Sound space of the housing (5) is separated, into which sound space at least one sound opening (15) leads from the mount or receptacle for the electronic hardware (2). Device (1) according to one of claims 1 to 13, characterized in that the electronic hardware (2) has an NFC interface and the activation object (3) comprises an NFC token, the NFC token being one in or on the housing (5) placed activation object (3) in the communication area of the NFC interface in or on the housing (5) used electronic hardware (2). Method for controlling an application which is executed on electronic hardware (2), which electronic hardware (2) comprises a camera (6) or an NFC interface and which electronic hardware (2) is used in a device (1), which device (1) is designed according to one of claims 1 to 14 and wherein an activation object (3) is placed on the device (1), which activation object (3) has at least one feature detectable by the electronic hardware (2), in the form of a optical feature (4) or an NFC token, wherein the feature is detected by the electronic hardware (2), wherein in a first step the application with the camera (6) or the NFC interface of the electronic hardware (2) the Characteristic of the activation object (3) is detected and in a second step the application executes an action stored for the recognized characteristic. Method according to Claim 15, characterized in that the electronic hardware (2) comprises a loudspeaker (7) and that the stored action of the application triggers the playing of a tone, a melody or audio content via this loudspeaker (7). Method according to Claim 15 or 16, characterized in that the electronic hardware (2) comprises sensors in the form of acceleration sensors and/or position sensors, the application being accessible by access movements or positions of the device (1) are detected on these sensors and, in the event of a match with a stored movement or position, an action stored for this stored movement or position is carried out. Method according to one of Claims 15 to 17, characterized in that the position and/or orientation of the activation object (3) placed on the device (1) can be manipulated, the application from the data of the camera (6) determining a position or orientation change of the activation object (3) and, in the event of a match with a stored position or orientation change, executes an action stored for this stored position or orientation change. Method according to one of Claims 15 to 18, characterized in that the electronic hardware (2) comprises an NFC interface and the activation object (3) comprises an NFC token which is in the communication range of the NFC interface of the electronic hardware (2). , wherein in said first step the application with the NFC interface of the electronic hardware (2) sends a query signal and receives a modulated response signal of the NFC token of the activation object (3) and in said second step the application stores an action for the recognized modulated response signal executes Method according to one of Claims 15 to 19, characterized in that the electronic hardware (2) comprises a camera (6) and the activation object (3) comprises at least one optical feature (4), the camera ( 6) of the electronic hardware (2), wherein in said first step the application with the camera (6) of the electronic hardware (2) creates a recording of the optical feature (4) of the activation object (3) and in said second step the Application executes an action stored for the detected optical feature (4).