WO2018206652A1

WO2018206652A1 - Method for adjusting a virtual object

Info

Publication number: WO2018206652A1
Application number: PCT/EP2018/062015
Authority: WO
Inventors: David Frick; Andreas KÜHNE
Original assignee: Homag Gmbh
Priority date: 2017-05-11
Filing date: 2018-05-09
Publication date: 2018-11-15
Also published as: EP3622467A1; DE102017207995A1

Abstract

Disclosed is a method for adjusting a virtual object using a mobile device (10) which includes a display, said method involving the steps of: ascertaining dimensions (21a, 21b) in a space (20); having the mobile device (10) display the object on the basis of the dimensions against the backdrop of the space (20); and adjusting the displayed object.

Description

METHOD FOR ADJUSTING A VIRTUAL OBJECT

Technical area

The present invention relates to a method for adapting a virtual object, such as a piece of furniture, an industrial plant, a

Processing machine or similar.

State of the art

The preparatory design based on virtual objects such as the design of a piece of furniture or the planning of an industrial plant (factory planning) require in addition to a precise approach increased imagination for the planner, for example, to assess existing, spatial limitations or circumstances and to incorporate into the design ,

In the field of furniture design, platforms are already known in which a user can configure pieces of furniture in a web-based surface. Such is especially offered in more expensive products that mean a significant investment for a buyer. For example, so-called kitchen planners are familiar with whom by selecting certain predetermined modules, a kitchen can be planned so that it fits into the appropriate space. In order to work with such a kitchen designer, the user must first record the room dimensions and enter them manually in the planning program. Subsequently, the user can assemble the kitchen from a selection of specific modules.

After assembling the modules, it is possible to virtually "commit" the planned kitchen in order to gain an impression of the planned overall structure and the effect of certain modules or components, such as handles, on the overall concept in a virtual environment.

Also known are furniture planning programs, with which, for example, cabinets or shelves can be individually designed to measure. After planning the piece of furniture, the user can transmit the created data set to the provider who produces the piece of furniture according to the individual data record.

Also in this case, the user is asked at the beginning of the planning phase to record the appropriate dimensions and to incorporate them into the planning program. On the basis of the ceiling height or possible sloping ceilings, a piece of furniture can be fitted to the appropriate place of installation.

The inclusion of measured data by laymen, however, always carries the risk that the piece of furniture to be created is incorrectly dimensioned and thus, for example, made too large. Depending on the measuring method used, deviations from actual dimensions may be considerable. It is also possible that further details are disregarded during planning, such as the light conditions at the place of installation or the appearance of neighboring objects, such as adjacent furniture, curtains, floor, wall color or structure, etc. Ultimately, the result of the planning will be assessed by the user when the furniture has been delivered and set up.

Subject of the invention

The aim of the present invention is to further individual design options and

Planning errors to avoid.

The present invention provides a method according to claim 1 for this purpose. Further preferred embodiments are listed in the dependent claims.

The invention relates to a method for adapting a virtual object using a mobile device, the mobile device comprising a sensor unit and a display, comprising the steps of: determining dimensions in a space by means of the sensor unit of the mobile device; Displaying the object by the mobile device based on the dimensions against the background of the space; Customize the displayed object.

The said object may be a piece of furniture such as a table, a cabinet, a shelf, a chair or the like, or a combination thereof. Generally considered as pieces of furniture within the scope of the invention

Furnishings that are used to furnish a room. Examples are tables, cabinets, shelves, kitchen modules, garden furniture, sofas, armchairs, tables, seating groups and the like. Alternatively, the object may be a processing machine, in particular a woodworking machine, and / or a peripheral device thereof. A peripheral device is for example one

Compressed air line, an exhaust duct, a control cabinet, a protective fence, step mats for a safety device.

It is preferred that the mobile device is a smart goggles / data goggles, wherein the display for displaying is preferably a head-mounted display. "Smart glasses" refers to spectacles that can display additional information to the user in addition to the field of view, especially in an augmented reality.

Smart glasses have the advantage that they can always be carried by the user, but hands are freely available. The display can be displayed in an augmented reality, thus optimally linking the real environment and the virtual object to be displayed.

The fitting of the object may comprise at least one step selected from: moving and / or rotating the object, changing the height, width and / or depth of the object, changing or selecting the surface color and / or structure, attaching or changing fittings, inserting a recess or bore, and / or changing or selecting a material for portions of the object.

The adaptation of the object can be done by means of gesture control. This type of object manipulation can be used particularly advantageously in combination with smart glasses / data glasses. The adaptation of the object may include, for example, removing a portion of the object and fitting the portion. In the case of a piece of furniture, for example, a drawer can be removed and its coating material can be changed. If the method is used within the framework of factory planning, then it is possible, for example, to remove a processing device of a processing machine and to change its external dimensions.

It is preferred that, when determining dimensions, upon reaching a threshold of a particular

Accuracy of a visually or acoustically perceptible release is transmitted. Thus, the user can be informed about the current status of the measurement process. After approval, the user can turn to new activities.

According to a preferred embodiment, provision is made for accessing a database, in particular a cloud server, for displaying an object. Thus, the stored data is available device-independent, possibly for several people at the same time.

Furthermore, it can be provided that the dimensions are an area and height of an installation location, and / or a roof slope, projections, adjacent objects,

Changes in the soil surface, such as steps or slopes, include.

After the object has been adapted, the work result can be stored, in particular in a local memory of the mobile device or on a cloud server.

Furthermore, a use of a smart glasses for fitting a virtual object is provided, in particular a piece of furniture or a processing machine, wherein the object is displayed by means of smart glasses against the background of real space and the displayed object is adjusted.

When using smart glasses, the aforementioned aspects can be used individually or in combination. The same applies to the system listed in claim 14.

Brief description of the drawings

Figure 1 shows the use of smart glasses in the planning of a piece of furniture as an embodiment.

FIG. 2 shows a method sequence according to FIG

preferred embodiment of the invention.

Detailed Description of the Preferred Embodiments

Hereinafter, a preferred embodiment of the following invention will be described with reference to the accompanying drawings. The preferred embodiment is merely illustrative of the present invention. Other modifications of certain features of the described embodiment mentioned in this connection can each be combined with each other to form further embodiments.

The embodiment described in detail below relates to the use of smart glasses for planning or adaptation of a piece of furniture. Another example of application of the present invention is factory planning or planning of an industrial plant, in the context of which a machine, production line, peripherals, etc. are attached Place a given location in a factory floor and change or change its configuration.

One aspect of the present embodiment is the use of so-called smart glasses 10 as a preferred example of a mobile device with which it is possible to associate the real environment with a virtual world (so-called "mixed reality" or "augmented reality"). In this case, the user is a virtual object, as in the present embodiment, a piece of furniture in the field of view, and thus in the real environment, displayed. The smart glasses 10 has this for an HMD display (head mounted display).

While in the present embodiment, smart glasses 10 will be described as a mobile device. In other embodiments, alternatively or additionally, a smartphone, a laptop or a tablet can be used.

The smart glasses 10 is additionally equipped with sensors. In particular, a sensor unit is provided with which the concretely observed environment can be measured. In addition, smart glasses 10 in other embodiments are equipped with a position sensor, one or more acceleration sensors and / or one or more gyro sensors.

With the position sensor (triangulation method via WLAN or Bluetooth), the position of the user can be detected. The determined data can be used for position tracking. Based on the data obtained from the acceleration sensors and gyro sensors (6 degrees of freedom), the alignment of the smart glasses 10, and thus the orientation of the user's head, can be determined. For smart communication, smart glasses 10 preferably have a radio interface, for example a WLAN module, so that the determined information can be transmitted to a database. Alternatively, a Bluetooth connection or a mobile connection according to UMTS or LTE standard can be used.

The user first has the opportunity to use smart glasses 10 to measure the spatial environment in which a particular piece of furniture is to be integrated (step S1). For this purpose, for example, laser distance sensors are integrated in the smart glasses, with which limiting surfaces, such as walls or roof slopes, can be detected. Based on the determined data, a virtual image of the real space 20 is created, which is dimensioned true to scale. For this purpose, various dimensions 21a, 21b are included, which are indicated in Fig. 1 only by way of example.

Alternatively, it is possible to use an external measuring system (for example a laser measuring system) which is connected to or can be connected to a data interface of the smart glasses. The values determined by the external measuring system can thus be transmitted to the smart goggles and used accordingly.

In addition, there is the possibility, especially in a new building, that already existing CAD data of the corresponding room are known. This data can also be used to determine the dimensions.

It is possible to make a preselection in a configurator, for example, with regard to a specific piece of furniture, a group of pieces of furniture or partial profiles of a piece of furniture (step S2). A corresponding piece of furniture is for example for the concrete space conditions a suitable variant that the user can select from a list. The preselection of the underlying data pieces of furniture such as dimensions, colors, material structures, etc., may be stored locally in a memory of smart glasses 10 or on a server in the local network. Alternatively, a database, for example deposited on a cloud server, is used.

This data could previously be queried via a standardized interface from a particular manufacturer or user-defined group of manufacturers. Instead of a standardized interface, the 3D data of the objects could be provided standardized by the manufacturers. Alternatively, it would be necessary to have a conversion module that converts the various data models into a single model when objects or pieces of furniture from different manufacturers in the database are to be updated in an updated manner.

The selected piece of furniture is subsequently displayed against the background of the real space (step S3). Thus, the piece of furniture is virtual, but the room is real. In other words, the representation takes place in augmented reality.

The exact positioning or adaptation of the dimensions subsequently takes place interactively in conjunction with the real environment (step S4). In this case, changes such as an adjustment of the dimensions and / or a repositioning of the piece of furniture by pushing or pulling with gesture control.

The interaction takes place in combination with the real environment. For example, the piece of furniture can only be pushed up to a certain wall or increased in the direction of a sloping roof or the like. For example, it is possible to remove an item of the pre-planned piece of furniture in the virtual environment in order to be able to better view it.

A concrete example is to choose from a piece of furniture, such as a wall cabinet, the upper deck panel and remove virtually. Subsequently, an opening can be created in an area of the cover panel, which will later serve as a pipe passage. Alternatively, the data glasses could also detect and measure a wall passage for the exhaust air of the hood in the kitchen and automatically place and dimension a corresponding opening in the cover panel. After performing the adjustment of the piece of furniture this can be integrated again by gesture control in the modified version in the piece of furniture.

Thus, it is possible for the user to design the product and subsequently experience it. As virtual reality is superimposed on the real world, boundary conditions can also be taken into account when planning the piece of furniture, for example the concrete colors and structures of the floor, the wall and the ceiling at the installation site, or the light from an adjacently arranged window or window Space available lighting. Thus, the user can iteratively improve the desired product and adapt it to the concretely present conditions, wherein the detection by means of the sensors offers a high degree of planning security and thus supports the optimal purchase decision.

Furthermore, a user can interact with the virtual space and, for example, test the ergonomic design of doors, drawers, etc. Thus, it can be ruled out that movable elements, such as drawers or doors, collide with other objects in the room, walls, roof slopes, or the like. Also, the correct positioning of certain elements of the furniture such as shelves, floors, etc. are checked.

The guided surveying of the room with the smart glasses 10 measurement errors can be avoided. For example, the user is shown that the planning accuracy has been achieved in the measured zone. To visualize this to the user, dimension lines or another display can be displayed in green. If the accuracy was not achieved, and if the user has to repeat the measurement if necessary, a visualization in red appears. As an alternative to a visual display, the smart glasses 10 can output an acoustic release signal via an integrated loudspeaker.

By means of the integrated loudspeaker, it is also possible to read an assembly instruction to the user or to contact a consultant by telephone. In addition, it is possible to visually display an assembly instruction. The visual indication may optionally be in addition to the acoustic message via the loudspeaker.

After the user has adapted the piece of furniture accordingly, the work result can be stored in a local memory of smart glasses 10 or in a globally available cloud server (step S5). Interim results can also be saved accordingly.

Furthermore, it is possible to simultaneously check the production possibilities by the manufacturer in different stages. This can be done by querying a manufacturer's database. Alternatively, it is possible to specify restrictions which the

Restrict manipulation possibilities. Subsequently, it is possible either by means of smart glasses or another, preferably mobile, electronic device to transmit data to the manufacturer (step S6), for example, trigger an ordering process at the manufacturer. This could also be done via an interface, so that the use of smart glasses is manufacturer-independent.

Based on this, machining operations such as drilling, cutting, fitting, etc. may be performed on parts of the planned furniture after data of the finished furniture has been sent to the manufacturer. For this purpose, the data, in particular CAD / CAM data, are sent to the manufacturer of the piece of furniture.

Through the sensor unit of smart glasses, it is also possible to scan existing furniture and determine their dimensions. In this way it can be ensured that a newly configured piece of furniture has at least the same capacity or the same footprint.

Furthermore, by means of smart glasses in a wall to be mounted holes can be displayed, which can mark the user directly on the wall accordingly. Thus, preparatory measures can be initiated even before the furniture is manufactured and delivered.

During the ordering process (step S6), the processing time of the order and the planned delivery can be displayed to the user. Furthermore, a calculation and an invoice creation in the context of step S6 is feasible.

The present invention is not limited to use in a space bounded by walls or the like. Rather, it is possible to configure a piece of furniture in a relatively open environment or fit. For example, garden furniture can be virtually arranged and adapted on a terrace as an example. In this case, certain corner points of the field of view, so for example, the limitation of the terrace due to the floor covering, used to specify the planning location.

Another example of application of the present invention is factory planning or planning of an industrial plant in which a machine, production line, peripherals, etc. are placed in a predetermined location in a factory floor and their configuration must be adjusted or changed. Here, it is possible to select a processing machine and display it in an augmented reality in the factory building, where protective devices such as protective fences, safety mats or the like can be placed and adapted according to the physical conditions , as conveyor belts, to connect with each other and to design the guide paths of the workpieces accordingly, so that a target-actual comparison is immediately possible.

Claims

claims

A method of customizing a virtual object using a mobile device (10), the mobile device having a display comprising

Steps :

Determining dimensions (21a, 21b) in a space (20);

Displaying the object by the mobile device (10) based on the dimensions against the background of the space (20);

Customize the displayed object.

2. The method according to claim 1, characterized in that the mobile device is a smart glasses, wherein the display for displaying is preferably a head-mounted display (10a).

3. Method according to one of the preceding claims,

characterized in that the space (20) is an interior of a building, in particular a room or a

Factory building, or an outdoor space is.

4. Method according to one of the preceding claims,

characterized in that the object is selected from a piece of furniture such as a table, a cupboard, a shelf, a kitchen module, a garden furniture, a sofa, an armchair, a seat group or the like, or

a processing machine, in particular a

Woodworking machine, or industrial

Investment .

5. The method according to any one of the preceding claims, characterized in that the determining the

Dimensions (21a, 21b) takes place by means of a sensor unit of the mobile device, or which, in particular via a measuring system, preferably laser measuring system, determined dimensions (21a, 21b) of the mobile device (10) are provided via an interface.

6. Method according to one of the preceding claims, characterized in that the adaptation of the object comprises at least one step selected from:

Moving and / or rotating the object, changing the height, width and / or depth of the object, changing or selecting the surface color and / or texture, attaching or changing fittings, inserting a recess or bore, and / or changing or selecting one Material for sections of the object.

7. The method according to any one of the preceding claims, characterized in that the adaptation of the object takes place by means of gesture control.

8. The method according to claim 1, wherein adjusting the object comprises removing a section of the object and adjusting the section.

9. The method according to any one of the preceding claims, characterized in that when determining

Dimensions (21a, 21b), upon achievement of a

Threshold of a given measurement accuracy a visually or acoustically perceptible release is transmitted.

10. The method according to any one of the preceding claims, characterized in that for displaying an object on a database, in particular a cloud server, is accessed.

11. The method according to any one of the preceding claims, characterized in that the dimensions of an area and height of a site, and / or a sloping roof, projections, adjacent objects, changes in the ground surface, such as steps or slopes, comprises.

12. The method according to any one of the preceding claims, characterized in that after adjusting the object, the work result is stored,

especially in a local memory of the mobile

Device or on a cloud server.

Use of a smart glasses (10) for fitting a virtual object, in particular a piece of furniture, a processing machine, or parts thereof, wherein the object by means of smart glasses (10) in front of the

Background of the real room is displayed and the displayed object is adjusted.

14. A system using a mobile device (10), the mobile device having a display for displaying a virtual object, wherein:

the system has a sensor unit of the mobile device (10) or a measuring system which can be connected to the mobile device (10) in order to determine dimensions (21a, 21b) in a space (20),

- the display is set up, the object before

Display background of the room (20), and - The mobile device is provided for an adaptation of the object.