CN113906480A - Method and apparatus for providing information about gas racks - Google Patents
Method and apparatus for providing information about gas racks Download PDFInfo
- Publication number
- CN113906480A CN113906480A CN202080039820.5A CN202080039820A CN113906480A CN 113906480 A CN113906480 A CN 113906480A CN 202080039820 A CN202080039820 A CN 202080039820A CN 113906480 A CN113906480 A CN 113906480A
- Authority
- CN
- China
- Prior art keywords
- gas
- image
- fixture
- information
- control unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- F24C3/00—Stoves or ranges for gaseous fuels
- F24C3/12—Arrangement or mounting of control or safety devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G06T15/205—Image-based rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/0092—Nutrition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Abstract
A user device (120) is described, which comprises a camera (123), a display (124) and a control unit (121). The control unit (121) is configured to capture image data of the gas fixture (110) and/or a cookware (220) used in conjunction with the gas fixture (110) using the camera (123). Still further, the control unit (121) is configured to determine enhanced information about the operation of the gas fixture (110). Further, the control unit (121) is configured to render the mixed reality image on a display (124). The mixed reality image includes a base image (210, 230) of the gas fixture (110) and/or cookware (220) and an augmented image (211, 212, 213, 231) superimposed with the base image (210, 230), wherein the augmented image (211, 212, 213, 231) indicates augmentation information.
Description
This document relates to gas grills that can be used for cooking. In particular, this document relates to the provision of information about gas fixtures.
Gas racks require access to a gas supply in order to provide a flame for heating a cooking vessel or fryer. Gas supplies may not always be available, particularly in points of sale for gas racks. If the gas racks are operated by personnel who do not have the skills required to dispose of the gas racks, disposal of the gas racks may be dangerous even if a supply of gas is available.
This document solves the following technical problem: so that the user of the gas rack can become accustomed to the operation and/or features of the gas rack in a comfortable and safe manner. The technical problem is solved by each of the independent claims. Preferred examples are described in the dependent claims.
According to one aspect, a (handheld) user device, such as a smartphone or tablet PC, is described. The user equipment comprises a camera, a display and a control unit. The user device may be presented with a housing (e.g. having the shape of a cube). During use, a user may hold the user device such that a front side of the user device faces the user and an opposite back side of the user device is turned away from the user. A display of the user device (e.g. implemented as a touch screen) may be located at a front side of the user device and/or a camera may be located at a back side of the user device.
A control unit (e.g., a microprocessor) of the user device may be configured to capture image data of the gas fixture and/or a cooker (such as a fryer pot or vessel) used in conjunction with the gas fixture. The image data may be captured using a camera of the device. To capture image data, a user of the user device may hold the user device in front of the gas rack and/or cookware such that the gas rack and/or cookware falls within a sensing area of the camera.
Still further, the control unit may be configured to determine enhanced information regarding operation of the gas fixture. The enhancement information may be determined directly based on the image data (e.g., by performing image processing). Alternatively or additionally, the augmentation information may be determined based on (received and/or stored) data about the gas rack, such as the type or model of the gas rack and/or such as the status of the gas rack and/or such as technical data about the gas rack.
Further, the control unit may be configured to render the mixed reality image on the display. The mixed reality image may include a base image of the gas fixture and/or cookware, where the base image typically corresponds to the captured image data. In particular, the base image may be a copy of image data captured by a camera of the user device.
The mixed reality image further includes an augmented image overlaid with the base image, wherein the augmented image is indicative of augmented information. In other words, the enhanced image may represent enhanced information about the operation of the gas fixture (even though the gas fixture may not be operating using gas). Thus, the user can virtually operate the gas rack in a safe and comfortable manner (without actually providing gas to the gas rack).
The gas fixture typically includes at least one burner, and the primary image and/or image data may show or may indicate the burner of the gas fixture. In particular, the gas fixture may include a plurality of burners (e.g., two or more, four or more, or six or more burners). The base image and/or the image data may show or may indicate at least one of the burners of the gas rack. The enhancement information may include information about the flame (especially the size of the flame) generated by the burner when operating the gas fixture using gas. The information about the flame may be determined based on: the type or model of the gas fixture and/or the status (i.e., position) of the valve knob of the gas fixture and/or technical data regarding the gas fixture.
The enhanced image may show a (virtual) flame rendered in superimposition with a burner of a gas rack shown within the base image. The enhanced image may be such that, for viewing of the display, the burner of the gas fixture appears to be operating using gas (even if no gas is supplied to the burner). Alternatively or additionally, the enhanced image may be such that the burner of the gas fixture appears to generate a flame to a viewer of the display, even though in reality the burner is not generating a flame. Alternatively or additionally, the enhanced image may be such that to a viewer of the display, the burner of the gas fixture appears to generate a flame according to a size corresponding to a particular position of the valve knob of the gas fixture. Thus, a user of the user device may be provided with a detailed impression of how the gas fixture is operating without actually igniting a flame and/or without actually providing gas to the gas fixture.
The control unit of the user device may be configured to determine status information regarding a position of a valve knob of the gas fixture. During operation of the gas fixture in the presence of gas, the valve knob is configured to modify an amount of gas supplied to a burner of the gas fixture. Thus, in the event that the burner is supplied with gas, the position of the valve knob may indicate how much gas will flow through the burner. The amount of gas flowing through the burner corresponds to the size of the flame generated by the burner (when operating with gas).
The enhanced image and/or the enhancement information may be determined depending on the state information. In particular, the size of the (virtual) flame shown within the enhanced image may be determined depending on the status information. By taking into account the state information, the enhanced image can be generated in a precise manner.
The control unit may be configured to adapt the size of the flames shown within the enhanced image in dependence on the status information. In particular, if the status information indicates that the position of the valve knob has been changed such that the amount of gas supplied to the burner of the gas fixture will increase during operation of the gas fixture with gas, the size of the flame shown within the enhanced image may be increased. Alternatively or additionally, the size of the flame shown within the enhanced image may be reduced if the status information indicates that the position of the valve knob has been changed such that the amount of gas supplied to the burner of the gas fixture will be reduced during operation of the gas fixture with gas.
In other words, the enhanced image may be adapted depending on the changing state information, in particular depending on the changing position of the valve knob. As a result, the user experience in simulating the operation of the gas rack can be increased.
The captured image data may be indicative of a valve knob. The control unit may be configured to determine the state information by performing image processing of the image data. As a result of which the user equipment can be operated in an efficient and autonomous manner.
Alternatively or additionally, the control unit may be configured to determine status data regarding the status information, wherein the status data has been transmitted over the gas rack via the (wireless) communication network. In other words, the user device may be configured to communicate with the gas racks (directly or via a back-end server) to obtain status data from the gas racks. The status information (in particular the position of the valve knob) can then be determined in an accurate manner on the basis of the (received) status data.
Alternatively or in addition, the user device may comprise input means (such as a touch screen) which enable a user to provide user input to the user device. By way of example, a virtual valve knob may be displayed on the touch-sensitive display and a user may select a position of the virtual valve knob on the touch-sensitive display as a user input. The control unit may be configured to determine the state information based on user input of a user of the user device, thereby enabling comfortable and autonomous virtual operation of the gas fixture.
If the gas rack is operated using gas with the position of the valve knob indicated by the status information, the control unit may be configured to determine the power and/or gas consumption that the gas rack will exhibit. Still further, the control unit may be configured to render an enhanced image (e.g. as text and/or as graphics shown on the display) indicative of the power and/or gas consumption. By providing additional information about the power and/or gas consumption, the user experience may be further improved (especially in the case of a point of sale).
If the gas rack is operated using gas with the position of the valve knob indicated by the status information, the control unit may be configured to determine the temperature of the flame that the gas rack will present. The enhanced image may indicate the temperature of the flame (e.g., as text and/or as graphics shown on a display). By providing additional information about the flame temperature, the user experience (especially in the preparation of the cooking process) may be further improved.
The control unit may be configured to determine type information about the type or model of the gas fixture. The enhancement information and/or the enhanced image may be determined in an accurate manner based on the type information. The type information may be determined, for example, by performing image processing of the captured image data. Image processing may be performed for identifying a label within the image data having a type or model of gas fixture to which the label is affixed. Still further, image processing may be used to identify the geometry and/or shape of the gas fixture. In other words, geometric data describing the geometry and/or shape of the gas fixture may be determined by image processing using the image data. The geometric data may be used to identify a particular type or model of gas fixture within a database, where the database includes geometric data for a plurality of different types or models of gas fixtures. By doing so, the type information can be determined in a robust and flexible manner. Alternatively or additionally, the type information may be determined based on user input.
The control unit may be configured to determine technical data for the gas rack, in particular for a specific type or model of gas rack. The technical data may be indicative of a functional relationship between a position of the valve knob and a flame generated by and/or an amount of gas provided to the burner of the gas rack. Alternatively or additionally, the technical data may be indicative of energy consumption and/or flame temperature of the gas rack as a function of the position of the valve knob. Alternatively or additionally, if gas is used to operate the gas rack, the technical data may indicate a relationship between a position of a valve knob of the gas rack and one or more characteristics of a flame generated by a burner of the gas rack (e.g., size, energy consumption, volumetric flow rate of the gas, and/or temperature).
The technical data may be stored on a storage unit of the user device. Alternatively or additionally, technical data may be downloaded by the user device from an external server and/or directly from the gas rack. The technical data may be identified using type information of the gas fixture. The control unit may be configured to determine the enhancement information and/or the enhancement image based on the technical data, thereby enabling a user experience that is particularly close to the real operation of the gas fixture.
The control unit may be configured to determine, based on the image data, operation information regarding how the gas rack should operate in conjunction with the cookware represented within the image data. In particular, the image data may be analyzed in order to identify the type of cookware (e.g. the size and/or shape of a fryer pot or vessel). The control unit may then determine how the cookware should operate on the gas rack (e.g. based on data stored on the user device and/or downloaded from an external server). In particular, the operational information may indicate a valve knob position that should be used in conjunction with the identified cookware (e.g., to ensure that a relatively high portion of the energy provided by the flame of the gas rack is used to heat the identified cookware). The control unit may then render an enhanced image (e.g., as text and/or as graphics on a display) indicative of the operation information. As a result, the comfort of using the gas rack can be further increased.
The operation information may be determined depending on a recipe to be prepared using the gas rack. In particular, the control unit may be configured to determine a recipe (e.g. based on user input) for a dish to be prepared using the gas rack. Still further, the control unit may be configured to determine a valve knob position that should be used during the execution of the recipe (e.g., to ensure that the correct flame temperature is set for the execution of the recipe). By taking account of recipe data for recipes to be prepared, enhanced information can be provided, which further increases the comfort of use of the gas rack.
The control unit may be configured to update the base image and/or the enhanced image at an image rate of more than 10 images/second or 20 images/second. In other words, the base image may be a portion of the base video, and the enhanced image may be a portion of the enhanced video that overlaps the base video. The enhanced video may indicate a (moving) flame. By providing mixed reality video data, the user experience in conjunction with gas racks can be further increased.
According to a further aspect, a method for enabling a user of a gas rack to at least virtually operate the gas rack is described. The methods may be implemented and/or performed on a computing device, such as a user device. In particular, the method may be provided and/or implemented as software (e.g., as an app) executing on a computing device.
The method includes capturing image data of a gas fixture and/or cookware used in conjunction with the gas fixture. Still further, the method includes determining enhanced information regarding operation of the gas fixture. Further, the method includes rendering the mixed reality image on a display. The mixed reality image includes a base image of gas fixtures and/or cookware and an augmented image overlaid with the base image, wherein the augmented image is indicative of augmented information.
According to a further aspect, a software program is described. The software program may be adapted for execution on a processor and for performing the method steps outlined in the present document when carried out on the processor.
According to another aspect, a storage medium is described. The storage medium may comprise a software program adapted for execution on a processor and for performing the method steps outlined in the present document when executed on the processor.
According to a further aspect, a computer program product is described. The computer program may comprise executable instructions for performing the method steps outlined in the present document when executed on a computer.
It should be noted that the methods and systems including the preferred embodiments thereof as outlined in this document may be used alone or in combination with other methods and systems disclosed in this document. Furthermore, the features outlined in the context of a system may also be applicable to the corresponding method. Still further, all aspects of the methods and systems outlined in this document may be combined arbitrarily. In particular, the features of the claims can be combined with one another in any manner.
The invention is explained in an exemplary manner below with reference to the attached drawing, in which
FIG. 1 illustrates an example system for enabling a user of a gas rack to become accustomed to the gas rack;
FIG. 2a shows an example mixed reality image of a gas fixture;
FIG. 2b shows an example mixed reality image of a cookware used in conjunction with a gas fixture; and
FIG. 3 shows a flow diagram of an example method for enabling a user to use a gas fixture.
As outlined above, the present document is directed to enabling a user to use a gas rack in a safe and comfortable way, in particular in case the gas rack is not connected to a gas supply. In this scenario, fig. 1 shows a block diagram of an example system 100 for enabling a user to use a gas fixture 110. The system 100 includes a gas stand 110, the gas stand 110 including at least one burner 114 configured to provide a flame 115 for heating a cookware, such as a fryer pot or vessel. Further, the gas fixture 110 includes a control panel having one or more valve knobs 113 for one or more burners 114. The user may turn the valve knob 113 to open a corresponding valve (not shown) to provide gas from a gas supply (not shown) to the burner 114. The amount of gas supplied to the burner 114 may be set by changing the position of the knob 113. The gas may be ignited (e.g., using electrical ignition) to provide a flame 115.
Still further, the gas rack 110 can optionally include a control unit 111 configured to determine status information about the gas rack 110 and provide the status information as status data 116 to a recipient external to the gas rack 110 via the communication unit 112 of the gas rack 110. The status information may, for example, indicate a position of the valve knob 113 of the gas fixture 110. The communication unit 112 may be configured to transmit the status data 116 via a (wireless) communication network 102, such as WLAN, bluetooth, etc. The status data 116 may be sent directly to the user device 120 and/or via the backend server 101.
The system 100 further includes a user device 120 (such as a smartphone or tablet PC). The user device 120 includes a camera 123 configured to capture image data. Still further, the user device 120 comprises a display 124 configured to display a base image corresponding to image data that has been captured using the camera 123. The camera 123 may be configured to capture image data about a surrounding area of the back side of the user device 120, wherein the display 124 may be positioned on the front side of the user device 120. Thus, image data about the surrounding area of the back side of the user device 120 may be rendered (with any significant delay) on the display 124 of the user device 120. In other words, a base image or base video showing the surrounding area of the back side of the user device 120 may be rendered on the display 124 of the user device 120.
Still further, the user equipment 120 comprises input means 125 enabling a user to provide user input to the user equipment 120. The input device 125 may be implemented using a touch sensitive display 124. Furthermore, the user equipment 120 may comprise a control unit 121 for controlling the operation of the user equipment 120 and/or a communication unit 122 configured to receive and/or transmit data over the communication network 102.
The user may position the user device 120 such that image data captured by the camera 123 of the user device 120 is indicative of the gas fixture 110. The control unit 121 of the user device 120 may be configured to use the image data for rendering a base image 210 (see fig. 2a) indicative of the gas fixture 110 on the display 124 of the device 120. Still further, the control unit 121 may be configured to determine status information regarding the status of the gas rack 110. The status information may indicate a position 201 of the valve knob 113 of the gas fixture 110. The status information may be received as status data 116 over the communication network 102. Alternatively or additionally, the status information may be determined based on captured image data. By way of example, the control unit 121 may be configured to detect the position 201 of the valve knob 113 by performing image processing on captured image data.
The control unit 121 may be configured to determine enhancement information about the gas fixture 110 based on the captured image data and/or based on the status information. The enhancement information may include:
information on how much gas typically flows to the burner 114 when the valve knob 113 is positioned according to the status information;
information on how large the flame 115 of the burner 114 is when the valve knob 113 is positioned according to the status information;
information on how much energy the gas rack 110 consumes when positioning the valve knob 113 according to the status information; and/or
Information on the temperature of the flame 115 of the burner 114 when the valve knob 113 is positioned according to the status information.
The control unit 121 may be configured to determine type information about the type and/or model of the gas fixture 110. The type information may be received directly from the gas fixtures 110 via the communication network 102 or via the back end server 101. Alternatively or additionally, the type information may be determined based on captured image data (e.g., based on model number 202 displayed on gas fixture 110). The type information may be considered in determining the enhancement information, thereby increasing the accuracy of the enhancement information.
Still further, the control unit 121 may be configured to determine the enhanced image 211, 212, 213 based on the enhancement information. One or more enhanced images 211, 212, 213 may be rendered on the display 124 of the user device 120 in superimposition with the base image 210. In particular, the base image 210 may be enhanced or enhanced with one or more additional enhanced images 211, 212, 213 representing enhancement information.
Fig. 2a shows different example enhanced images 211, 213, 214. In particular, FIG. 2a shows an enhanced image 211 representing a virtual flame. The virtual flames may be rendered such that the virtual flames overlap the burners 114 shown within the base image 210. As such, an enhanced image 211 may be rendered as follows: which gives the viewer of the display 124 the impression that the burner 114 of the gas fixture 110 is lit and presenting a flame 115. The size of the virtual flame may depend on the position 201 of the valve knob 113. In particular, the size of the virtual flame may be repeatedly adapted (e.g., at a picture rate of 20 images/second or greater, or a picture rate of 30 images/second or greater) depending on the modification of the position 201 of the knob 113. Thus, a user may be enabled to use the user device 120 to visualize and/or test the operation of the gas rack 110 even if the gas rack 110 is not coupled with a gas supply.
Alternatively or additionally, the enhanced image 212 may include enhanced information regarding: the energy consumption of the gas fixture 110 and/or the volumetric flow rate of the gas (depending on the position 201 of the valve knob 113) and/or the temperature that the flame 115 of the burner 114 will assume (depending on the position 201 of the valve knob 113). The enhanced image 212 may, for example, include text and/or graphics that overlay the base image 210 and may be displayed in a partially transparent manner. Alternatively or additionally, an enhanced image 213 indicative of the position 201 of the valve knob 113 may be rendered on the display 124 (e.g., to provide a virtual valve knob as the input device 125).
The control unit 121 may be configured to detect the cooker 220 used in conjunction with the gas rack 110 based on the captured image data. Still further, the control unit 121 may be configured to determine enhanced information about the detected cookware 220 and/or about the use of the detected cookware 220 in combination with the gas rack 110. The enhanced information may include information about the position 201 of the valve knob 113 and/or about the power setting that should be used in conjunction with the detected cookware 220. As shown in fig. 2b, a base image 230 indicative of cookware 220 may be displayed in combination and/or superimposed with an enhanced image 231 indicative of enhanced information.
Thus, user device 120 may be enabled (e.g., using a software application that may be downloaded from an application store) to provide a user of gas rack 110 with an operational experience of gas rack 110 that simulates and/or mimics the actual operation of gas rack 110 (however, without requiring gas to be provided to gas rack 110). The user device 120 can determine the knob position 201 of the gas fixture 110. Alternatively or additionally, the user may be enabled to virtually set the knob position 201 of the gas fixture 110 on the user device 120 (via the input device 125 of the user device 120). The enhanced image 211 may be superimposed with the base image 210, thereby giving the viewer of the display 124 the impression of: the burner 114 of the gas fixture 110 presents a flame 115 having a size corresponding to the knob position 201. Alternatively or in addition, enhanced information about the energy consumption and/or the flame temperature and/or the volumetric flow of the gas may be displayed.
By doing so, a user can experience the operation of the gas fixture 110 (e.g., at a point of sale) by mimicking the actual use of the appliance. This can be accomplished without the need to provide gas to the gas rack 110, thereby providing safe operation of the gas rack 110.
The user may point at the gas fixture 120 with the camera 123 of the user device 120 and at the same time the base image 210 of the gas fixture 110 may be rendered on the display 124 of the user device 120. The base image 210 may be enhanced by rendering one or more additional enhanced images 211, 212, 213 with additional information (e.g., combustion flame, energy consumption, power level, cooking step, etc.).
Virtual flames corresponding to different possible knob positions 201 (which correspond to different power levels) may be rendered as an enhanced image 211. The knob position 201 may be detected based on image data captured by the camera 123 of the device 120. Alternatively or additionally, the knob position 201 may be communicated to the user device 120 via the communication network 102. Alternatively or additionally, the knob position 201 may be selected by the user directly on the user device 120 (e.g., by pressing a virtual button on the screen or display 124 of the user device 120). The point of sale may be specifically provided with the option of communicating the knob position 201 to the user device 120 via the communication network 102 (by adding the communication unit 112 to the gas fixture 110).
As indicated above, the size of the flames displayed as the enhanced image 211 may vary depending on the position 201 of the knob 113. In other words, flames may be provided as an augmented reality on the screen 124 of the user device 120 on top of the base image 210 of the gas fixture 110.
Fig. 3 shows a flow chart of an example method 300 for enabling a user of a gas rack 110 to at least virtually operate the gas rack 110. The method 300 may be performed on a user device 120, such as a smartphone or tablet PC. The gas fixture 110 can be decoupled from the gas supply (such that no gas is provided to the gas fixture 110). The method 300 may be used to give an impression to a user of the gas rack 110 as to how the gas rack 110 would behave if the gas rack 110 were operated with gas.
The method 300 includes capturing 301 image data of the gas fixture 110 and/or the cookware 220 used in conjunction with the gas fixture 110. The image data may be captured using a camera 123 of the user device 120, where the camera 123 may be located at a back side of the user device 120 (which is oriented away from a user using the user device 120).
Still further, the method 300 includes determining 302 enhanced information regarding the operation of the gas fixture 110. Enhancement information may be determined based on the image data. Alternatively or additionally, the augmentation information may be determined based on status information regarding the status, in particular, the position 201 of the valve knob 113 of the gas fixture 110. The enhancement information may indicate a size that the flame 115 of the burner 114 of the gas fixture 110 will have if the gas fixture 110 is operated using gas and/or if the gas fixture 110 is coupled to a gas supply.
The method 300 further includes rendering 303 the mixed reality image on a display 124 (of the user device 120). The mixed reality image includes base images 210, 230 of the gas fixture 110 and/or cookware 220. The base images 210, 230 may correspond to image data captured by the camera 123 (of the user device 120). Further, the mixed reality image comprises an augmented image 211, 212, 213, 231 superimposed with the base image 210, 230, wherein the augmented image 211, 212, 213, 231 indicates augmentation information. In particular, the enhanced image 211 may represent the (virtual) flames 115 at the burners 114 of the gas fixture 110 shown within the base image 210. The size of the (virtual) flame 115 may correspond to the size of the (real) flame 115 at the burner 114 if the gas fixture 110 is operated with gas.
Thus, a user of the gas rack 110 is enabled to become accustomed to the functions of the gas rack 110 in a safe and comfortable manner without actually operating the gas rack 110 with gas.
It should be noted that the description and drawings merely illustrate the principles of the proposed method and system. Those skilled in the art will be able to implement various arrangements that, although not explicitly described or shown herein, embody the principles of the invention and are included within its spirit and scope. Furthermore, all examples and embodiments summarized in this document are expressly intended primarily for explanatory purposes only to aid the reader in understanding the principles of the proposed method and system. Furthermore, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass equivalents thereof.
Claims (15)
1. A user equipment (120) comprising a camera (123), a display (124) and a control unit (121); wherein the control unit (121) is configured to:
-capturing image data of the gas fixture (110) and/or cookware (220) used in conjunction with the gas fixture (110) using the camera (123);
-determining enhanced information about the operation of the gas fixture (110); and
-rendering a mixed reality image on a display (124); wherein the mixed reality image comprises a base image (210, 230) of the gas fixture (110) and/or cookware (220) and an augmented image (211, 212, 213, 231) superimposed with the base image (210, 230); wherein the enhanced image (211, 212, 213, 231) indicates enhancement information.
2. The user equipment (120) according to claim 1, wherein
-the gas rack (110) comprises at least one burner (114);
-the base image (210) shows a burner (114) of the gas fixture (110);
-the enhancement information comprises information about a flame (115) generated by the burner (114) when the gas fixture (110) is operated using gas; and
-the enhanced image (211) shows flames rendered in a manner overlapping with burners (114) of the gas fixture (110) shown within the base image (210).
3. The user equipment (120) according to claim 2, wherein
-enhancing the image (211) such that the burner (114) of the gas fixture (110) appears to be operated with gas to a viewer of the display (124); and/or
-enhancing the image (211) such that the burner (114) of the gas fixture (110) appears to generate a flame (115) to a viewer of the display (124), even if in reality the burner (114) does not generate a flame (115); and/or
-enhancing the image (211) such that, for a viewer of the display (124), the burner (114) of the gas fixture (110) appears to generate a flame (115) according to a size corresponding to a position (201) of a valve knob (113) of the gas fixture (110).
4. The user equipment (120) according to any one of the preceding claims, wherein the control unit (121) is configured to:
-determining status information regarding a position (201) of a valve knob (113) of a gas fixture (110); wherein during operation of the gas fixture (110) with gas, the valve knob (113) is configured to modify an amount of gas supplied to a burner (114) of the gas fixture (110); and
-determining an enhanced image (211) depending on the state information.
5. The user equipment (120) according to claim 4, the control unit (121) being configured to:
-adapting a size of a flame shown within the enhanced image (211) in dependence on the status information; and/or
-increasing the size of the flames shown within the enhanced image (211) if the status information indicates that the position (201) of the valve knob (113) has been changed such that the amount of gas supplied to the burner (114) of the gas fixture (110) will increase during operation of the gas fixture (110) with gas; and/or
-reducing the size of the flames shown within the enhanced image (211) if the status information indicates that the position (201) of the valve knob (113) has been changed such that the amount of gas supplied to the burner (114) of the gas fixture (110) will be reduced during operation of the gas fixture (110) with gas.
6. The user equipment (120) according to any of claims 4-5, wherein
-the image data is indicative of a valve knob (113); and
-the control unit (121) is configured to determine the state information by performing image processing of the image data.
7. The user equipment (120) according to any of claims 4-6, wherein the control unit (121) is configured to:
-determining status data (116) about the status information; wherein the status data (116) has been sent by the gas rack (110) over the communication network (102); and
-determining status information based on the status data (116).
8. The user equipment (120) according to any of claims 4-7, wherein
-the user device (120) comprises input means (125) enabling a user to provide user input to the user device (120); and
-the control unit (121) is configured to determine the status information based on a user input of a user of the user device (120).
9. The user equipment (120) according to any of claims 4-8, wherein the control unit (121) is configured to:
-determining the power and/or gas consumption that the gas fixture (110) will present if the gas fixture (110) is operated with gas in case of the position (201) of the valve knob (113) indicated by the status information; and
-rendering an enhanced image (212) indicative of power and/or gas consumption.
10. The user equipment (120) according to any of claims 4-9, wherein the control unit (121) is configured to:
-determining a temperature of a flame (115) that the gas fixture (110) is to present if the gas fixture (110) is operated using gas with the position (201) of the valve knob (113) indicated by the status information; and
-rendering an enhanced image (212) indicative of the temperature of the flame (115).
11. The user equipment (120) according to any one of the preceding claims, wherein the control unit (121) is configured to:
-determining type information about the type or model of the gas fixture (110); and
-determining enhancement information and/or an enhanced image (211, 212, 213, 231) based on the type information.
12. The user equipment (120) according to any one of the preceding claims, wherein the control unit (121) is configured to:
-determining technical data about the gas rack (110); the technical data are as follows:
-indicating a relation between a position (201) of a valve knob (113) of the gas rack (110) and an amount of gas provided to a burner (114) of the gas rack (110) if the gas rack (110) is operated using gas; and/or
-indicating a relationship between a position (201) of a valve knob (113) of the gas fixture (110) and one or more characteristics of a flame (115) generated by a burner (114) of the gas fixture (110) if the gas fixture (110) is operated using gas; and
-determining enhancement information and/or an enhanced image (211, 212, 213, 231) based on the technical data.
13. The user equipment (120) according to any one of the preceding claims, wherein the control unit (121) is configured to:
-determining, based on the image data, operational information on how the gas rack (110) should be operated in conjunction with the cookware (220) represented within the image data; and
-rendering an enhanced image (231) indicative of the operation information.
14. The user equipment (120) according to any of the preceding claims, wherein
-the control unit (121) is configured to update the base image (210, 230) and/or the enhancement image (211, 212, 213, 231) at an image rate of more than 10 images/sec or 20 images/sec; and/or
-the base image (210, 230) is part of a base video, and
-the enhanced image (211, 212, 213, 231) is a part of the enhanced video that is superimposed with the base video.
15. A method (300) for enabling a user of a gas rack (110) to at least virtually operate the gas rack (110), wherein the method (300) comprises:
-capturing (301) image data of the gas fixture (110) and/or of a cookware (220) used in conjunction with the gas fixture (110);
-determining (302) enhanced information about the operation of the gas fixture (110); and
-rendering (303) the mixed reality image on a display (124); wherein the mixed reality image comprises a base image (210, 230) of the gas fixture (110) and/or cookware (220) and an augmented image (211, 212, 213, 231) superimposed with the base image (210, 230); wherein the enhanced image (211, 212, 213, 231) indicates enhancement information.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP19382441.4 | 2019-05-31 | ||
| EP19382441 | 2019-05-31 | ||
| PCT/EP2020/064692 WO2020239832A1 (en) | 2019-05-31 | 2020-05-27 | Method and device for providing information regarding a gas hob |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113906480A true CN113906480A (en) | 2022-01-07 |
Family
ID=66752027
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080039820.5A Pending CN113906480A (en) | 2019-05-31 | 2020-05-27 | Method and apparatus for providing information about gas racks |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP3977017A1 (en) |
| CN (1) | CN113906480A (en) |
| WO (1) | WO2020239832A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116697414B (en) * | 2023-05-17 | 2023-11-24 | 中关村科学城城市大脑股份有限公司 | Intelligent security control method, intelligent security control device, electronic equipment and computer readable medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9886162B2 (en) * | 2014-06-02 | 2018-02-06 | Qualcomm Incorporated | Device-provided tracking data for augmented reality |
| US10007413B2 (en) * | 2015-04-27 | 2018-06-26 | Microsoft Technology Licensing, Llc | Mixed environment display of attached control elements |
| WO2017143224A1 (en) * | 2016-02-18 | 2017-08-24 | Meyer Intellectual Properties Limited | Auxiliary button for a cooking system |
| US9791936B1 (en) * | 2016-05-03 | 2017-10-17 | Aram Kavach | Audio and motion-based control of a personalized smart appliance, media, and methods of use |
-
2020
- 2020-05-27 CN CN202080039820.5A patent/CN113906480A/en active Pending
- 2020-05-27 WO PCT/EP2020/064692 patent/WO2020239832A1/en unknown
- 2020-05-27 EP EP20727332.7A patent/EP3977017A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020239832A1 (en) | 2020-12-03 |
| EP3977017A1 (en) | 2022-04-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI654958B (en) | Wirelessly controlled cooking system | |
| US10504384B1 (en) | Augmented reality user engagement system | |
| US9518744B2 (en) | Method and apparatus for cooking using coded information associated with food packaging | |
| JP6168790B2 (en) | Cooking system and application program for cooking system | |
| US20180224127A1 (en) | Cook top assembly having a monitoring system and method of monitoring a cooking process | |
| JP6053562B2 (en) | Cooking system and application program for cooking system | |
| JP6296685B2 (en) | Cooking system and application program for cooking system | |
| US20090078696A1 (en) | Method of controlling cooker | |
| KR20190043830A (en) | System and method for creating recipe based on cooking machine | |
| CN107357487B (en) | Application control method, electronic equipment and computer storage media | |
| CN113906480A (en) | Method and apparatus for providing information about gas racks | |
| WO2021065169A1 (en) | Cooking assistance device, cooking assistance system, cooking assistance method, and cooking assistance program | |
| JP6605935B2 (en) | Cooker related information providing system and cooker related information providing program | |
| JP2014163540A (en) | Heat cooking system and application program for heat cooking system | |
| US20210035463A1 (en) | Methods of remote user engagement and instructional cooking demonstrations | |
| Petford et al. | A comparison of notification techniques for out-of-view objects in full-coverage displays | |
| CN105939466B (en) | Optical projection device | |
| CN105676656B (en) | Processing method and electronic equipment | |
| JP5829253B2 (en) | Gas stove | |
| US11002450B2 (en) | Cooktop appliance and engagement system | |
| JP4870474B2 (en) | Parts catalog display system and control method thereof | |
| JP6895830B2 (en) | Cooking support device | |
| Chang | Augmented reality interfaces for the internet of things | |
| JP2018096606A (en) | Heating apparatus | |
| JP5829254B2 (en) | Gas stove |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |