TWI326847B - Information overlay system - Google Patents

Description

1326847 IX. Description of the Invention: [Technical Field 3 of the Invention] BACKGROUND OF THE INVENTION The present invention relates to a technique for presenting information to a user. The ability to efficiently process, access, and present information is becoming increasingly important. C SUMMARY OF THE INVENTION 3 SUMMARY OF THE INVENTION

It is an object of the present invention to enable effective presentation of information to a user. This purpose is solved by a separate item of the scope of the patent application. Further examples of the scope of the patent application are shown.

According to an exemplary embodiment of the present invention, an apparatus for processing data is provided. The apparatus includes a detecting unit, configured to detect main data indicating an environment of a user, and an identification unit is applicable. And analyzing the primary data detected to identify the secondary data assigned to the primary data, and a presentation unit adapted to present the secondary data to the user, such that the secondary material The designation to the primary material is perceivable to the user. The phrase "perceivable" may have the following meanings of technical features, such as a verbal command resulting from a residual eight, or a visual component, such as an arrow that produces an information item from one item to another on a display unit, The rendering unit implements a link to present a manner in which such correlations can be noticed by one of the information items. According to another example of the present invention, a method of processing data is provided, the method comprising: detecting a primary resource 5 representing an environment of a user to identify that the designated material is assigned to the analysis of the detected material. The primary data, a user, is secondary information that is perceptible to the material, and the secondary data is presented to one of the secondary data to the designated user of the primary data

The computer program is adapted to control or perform the above methods when the device is executed. In accordance with another example of the present invention, a program component of a processing material is provided that, when executed by a processor, is adapted to control or perform the above method. Embodiments of the invention may be included or supported in part or in whole by one or more suitable software programs, which may be stored on any type of data carrier or may be provided by any type of data carrier, and the like may be in any Executed in the data processing unit of s or executed by any suitable data processing unit. The software program or routine can be preferably applied in the case of asking for a data 以及 and in the case of automatic pattern recognition. A data processing scheme according to an embodiment of the present invention may be executed or assisted by a computer program or software, or by using one or more specific electronic optimization circuits, that is, being bound or assisted in hardware, or The hybrid form is performed or assisted by means of software components and hardware components. An environment such as a field of view or the like of a user may be automatically detected or may be designated by the user in accordance with the exemplary embodiment. This measured or specified result (which can be performed in a visual, visible 'tactile olfactory manner or using any other sensory detection) can be used as a recipe 1326847

The equation is analyzed to identify the characteristics and characteristics of the environment. It may include an identification of one or more objects currently in the environment. For example, using an image recognition method, the object can be visually detected or analyzed, such that the object has a shape, a color, a noise, an odor, a surface structure, an electrical 5 or magnetic property, or any other characteristic. Can be used as a basis for obtaining additional information about this object. It is also possible that the auditory information is detected and the primary data is obtained from this audio detection, for example using a voice recognition system to identify the person from whom the voice originated. Alternatively, olfactory information can be obtained, for example, by identifying a scent by a gas sensor to identify a person, a scent of a particular animal, a special event such as a unique scent of a fire, a special A unique taste of food or drink, or a similar taste. The main information of this "abstract" can be automatically obtained from the detected data. Such identification may use known methods of automated signal processing or artificial intelligence systems (e.g., neural networks) that can derive abstract information from the sensed information. 15 then abstract information, such as the identity of a person, a detected event, or the identification of a portion of an electrical device (especially an electronic component) or the like can be used in a database that stores a plurality of secondary data. In the middle search, the plural item is assigned to the corresponding item of the main information. For example, a person's habits, a resume or the like can be stored in a database, so the identification of the abstract primary 20 information "personal identity" can be used to find such secondary information associated with the primary information. . If the detected object is a device, information about the device can be provided in the database as a primary information, such as a command manual for assisting a user to operate the device, a functional description, Travel information or similar. 7 The secondary information can then be automatically presented to the user along with the primary information, so that a user can intuitively understand the correlation between the primary material and the secondary material. For example, the system can output "Mr. Miller is a teacher, or can output "in order to stop the microwave, press the red button,,. If the primary object is a circuit, the presentation may include information "the pins 32 and 47 of the circuit are used to provide a test result signal, for example, such presentation may be visually overlayed or audibly overlapped, such that It is perceptible to the user. In particular, a correlation between the primary data and the secondary data is clear to the user. The detection unit can recognize human and non-human senses. Any one or any combination. A "feel" can be expressed as a physiological perception of any person that responds to a particular type of physiological energy and corresponds to a defined area in the brain that the signals are received and interpreted. Or a group of regions. Information associated with human perception (which can be detected by embodiments of the invention) is especially visual, auditory, gustatory, olfactory, tactile, thermoception, nociception, balance ( Equilibioception) and proprioception. Vision or vision describes the ability to detect light. Hearing and hearing are the perceptions of sound perception. The taste or sensation is about The tongue of a person with a receptor to detect taste, such as sweet, salty, sour and bitter. The smell or smell is the receiving nerve about the sense of smell. The sense of touch is the perception of pressure 'generally on the skin. The heat is hot and Cold perception is also through the skin. Pain is pain perception. Balance is balance perception. Proprioception is the perception of human perception. One or more people's feelings in any combination can be used as input information of the system. From these sensations, the system can obtain information and can make a "reasonable, determined" decision to determine which secondary information is appropriate and can be overlaid on the primary information. For each sense of discussion, a technical solution is available to detect individual perceptions. A "feel" also refers to any non-human perception of a sensor device, such as electrical, magnetic, radioactive, computer input, or the like.

According to an exemplary embodiment, an overlay information system is provided in which information detected in a field of view of a human is overlaid with secondary information. In other words, information that a person perceives from her or his environment can be combined with information that helps the user better understand the environment. For example, 10 during an error diagnosis operation, an operator or technician has to analyze a complex device (eg, a circuit including a plurality of interconnected electrical components). In such a scenario, an exemplary embodiment of the present invention may Assisting the operator in repairing the device by providing secondary information related to or related to the circuit. For example, the operator can analyze the function of a damaged resistor, 15 and can indicate that the system wants Additional information about this particular resistor. This specification can be performed by simply looking at the direction of this particular resistor or by taking a probe into contact with this resistor. This can trigger the system to provide information about this resistor. Further information on functions and features is given to the operator, such as "The resistor should have a value of 120 ohms and have a function to limit the maximum current of 1.5 amps to 1.5 amps in the circuit." For example, a user can carry one with a head mounted display of a camera coupled to the head mounted display when a user views a particular direction (eg, by twisting Or by taking a specific body posture, such as the direction of one of the circuits to be repaired, the camera detects the corresponding image of the portion of the environment. The circuit image can be displayed at On the display unit of the head mounted display, the image captured by the analysis can be (10) obtained by the information 1 to (4) view the direction and according to the direction of the viewing, it is desired to provide the background information about the object to be _: use =Γ In the scene, a case identification system can be _ the user's W circuit's "" specific electrical components, such as a fixed resistor. This information can be used to search for the resistor (4) in the -linked database. When such information is found, it can be displayed simultaneously by an arrow and/or a secondary information indicator about the voice of the resistor 1 §. The image of the resistor is simultaneously displayed. It can be just a view-specific direction and the system can identify the area monitored by the user and can analyze one or more pieces of the area. It is also possible that the user can make a certain inquiry, such as "I need (4) More of resistor 102 "Multiple information" or one or more items of available information for the menu provided by the system. Thus, a communication system can be provided that automatically combines the identified information and information about a particular environment of a user. The library (the design information item is stored therein). Then, the automatically recognized result can be mapped to such design data included in the database. According to the exemplary embodiment, a Detector in the environment The measurement can be performed, and the detection can be simulated. This can include an analysis-user's viewing direction, such as by a pupil viewing detector that tracks the movement of the human pupil to obtain information about the person being viewed - Note the information in the area. These insurgent information, such as some "fingerprints" of events in the user's environment, can be set to be associated with design data stored in a database, automatically After deciding a structure of the monitored area. This information is mapped to the stored design data to obtain secondary information from the primary information. The secondary information is then overlaid into the primary information so that it is simultaneously perceptible to the 5 users. The pattern recognition or abstraction information automatically obtained from the detected information can be assistive by implementing neural networks or specialized rules. An adaptive system can be provided that can learn user habits and improve user specificity between the perceived material 10 and the desired additional data when a user has used the system for a longer period of time. Correlation. According to an exemplary embodiment, any complexity information can be mirrored into a user's field of view. An exemplary field of application of embodiments of the present invention is to assist in repairing devices, particularly electronic devices, that are maintained and inserted into the operation of the technical device, such as in 15 home, government applications such as hunt or military applications.

Embodiments of the invention may be implemented in combination with any circuit. Design information can be overlaid onto a physical object. In other words, virtual information can be presented along with actual information, so that a person can better understand an object in her or his senses. This may include the identification of an object (including, for example, distance and/or angle information) within a user's field of view. The pattern recognition can then be performed as a benchmark that defines which design material will be retrieved from a database. This design material can then overlap with the physical object. The overlay information can be displayed 11 1326847 using a monitor or a head mounted display. This detection can be performed by any camera such as a CCD camera. The detection may also include the identification of a spatial orientation and the identification of the object. It is also possible to provide an actual interaction, caused by the user, and between the probe and the object, which provides a message about the attention area to the system. 5 at least a portion of a system in accordance with an exemplary embodiment of the present invention

It can be delivered in the form of a software product, so the software can be used in combination with a device to present information relating to a device purchased by the user. For example, when a consumer purchases a microwave oven, a CD can be provided to the consumer as some type of smart manual. The CD may contain a collection of 10 items of secondary information that may be of interest to the consumer operating the microwave oven. In accordance with an exemplary embodiment of the present invention, such a CD can be used with a hardware system. According to an exemplary embodiment, an overlay information system is provided. In order to repair a complicated machine, a lot of information is needed. By convention, this will make the repair of this time a lot of time. According to an exemplary embodiment, when an operator detects a device to be repaired, such required information can be displayed as being directly connected to the device to be repaired. The displayed information may include reference materials, interconnection materials, schemas, etc. of an object to be inspected (e.g., a circuit). For this purpose, the repair information can be overlaid by a head mounted display. Before overlaying such information, the object may be first photographed by a camera, the object may be analyzed by an automated analysis system, and the identified particular portion may be mapped to the object design by a pattern recognition algorithm. data. This information can then be displayed on the device. It is also possible that the information is selected or specified by a probe (e.g., a 12 1326847 pen-type component having a conductive tip) and an OCR software can recognize the probe. This is advantageous because the shape, color, and logo of the probe can be pre-stored in the system, so the pattern recognition can be greatly simplified. It is also possible that the probe is connected to an observer, such as an oscilloscope, and the output can be displayed by the five head mounted display.

A specific area of application is guided repair. The system can indicate multiple information to a service technician' to verify an electrical PCB board. It is also possible to provide information about a product using such a system to a consumer. The system can then help the consumer understand a recently purchased product. Example 10 For example, when it comes to familiarizing himself with a new microwave oven, the system can help a user understand how to operate the microwave oven. For example, information such as "opening the door of the microwave oven by gently pressing the open button can be displayed. A further exemplary field of application of the first embodiment of the present invention is an information system of a police officer. Used by a police officer to identify a person or object 15 such as a vehicle license plate. For example, when a police car carrying a police officer carrying a head mounted display having a system of an embodiment of the present invention follows a vehicle, The system will automatically detect the license plate information of the car and compare the information with the database information. If the corresponding license plate of the car is reported as stolen, the system can automatically display information such as "alarm - this The car has been stolen! Drivers and drivers may be dangerous! To the police officer. Further exemplary embodiments of the present invention will be described. Further exemplary embodiments of the apparatus for processing data will be described hereinafter. However, these embodiments are also applied. Method for processing data, program components and computer readable media 13 1326847 The detection unit can be used to detect at least one part of the user's field of view

The primary information indicated by the branch. For this purpose, a user's viewing direction can be automatically detected using position, speed, angle sensor or the like. With these sensors, a head movement of the user can be detected automatically 5. A movement of the same eye or part of the eye (such as the pupil) can be detected automatically. However, the function of the detection unit is not limited to visual information. Additionally or alternatively, any other information detectable from the environment and information used to characterize the environment may be estimated. The detecting unit can include a camera for detecting an image in the environment of the user. Such a camera can be a CCD camera or any other type of camera. The identification unit can be used to identify the secondary material assigned to the primary material by pattern recognition. Pattern recognition can represent an area within the field of machine learning. It can also represent the actions of analyzing the original data and an action taken according to the 15 categories of the data. Therefore, pattern recognition can include a collection of methods to supervise learning. Pattern recognition is directed to categorizing data patterns based on a prior knowledge or statistical information extracted from the patterns. The patterns to be classified may be measurement data sets or observation data sets, defining the appropriate multidimensional space 2 . A pattern recognition system may include a sensor for obtaining the observations of the class or description, a special observation mechanism, using the it to observe the digital or symbolic information of the data, and - classifying the drop eighta /, used to actualize or describe the observations based on the characteristics captured. An exemplary field of pattern recognition is Automated Language 5, which classifies the text into multiple categories, automatically identifies the 14 1326847 handwritten postal code number on the postal envelope, or automatically recognizes the face image. The identification unit can be used to map the secondary data into the primary material. The phrase "mapping" may be specifically expressed as an instruction used by an electronic data processing conversion system to convert primary material to secondary material. This can include selecting and 5 specifying information and establishing meaningful links between items of the information. The rendering unit is operative to present the secondary information to the user via at least one of a group consisting of a visual presentation, an audible presentation, and an audiovisual presentation. More generally, the presentation unit can present the secondary information in any manner that a user can perceive. 10 For example, the presentation unit can include a display unit. Such a display unit can display the image in such a manner that the user can perceive it. Such a display unit can include an LCD device, a plasma display or the like. The rendering unit may further comprise a head mounted display (HMD) or 15 which may be part of an HMD. A head mounted display can be represented as a display system that is developed or worn as an eye shield to give an illusion of a floating monitor in front of a user's face. Such a head mounted display, also shown as a heads up display, can be represented as an electrically generated display of any visual information. 20 The presentation unit can be further used to overlay the secondary material and the primary material to the user. Thus, an impression or phantom (the actual primary material being simultaneously perceived with the virtual secondary material) is given to the user. The presentation unit can be further adapted to visually and/or audibly overlay the secondary material and the primary material to the user. Therefore, in a similar multi-media media, image and/or sound information can be presented to the user. The rendering unit can be used to fund the physical material as a secondary material

Objects are presented as additional information. Good early 兀 to store the secondary information and such a database can be a storage

Can be understood by the identification unit. The information about different objects can be stored in it. This kind of information can be an "encyclopedia" that can be adjusted to a specific field. For example, in a repair assistance system, the database may contain information about the device to be repaired, such as knowledge about electronic engineering knowledge. The apparatus further includes a user interface unit that enables a user to provide the placement with instructions regarding the primary material to be analyzed. In particular, the user interface unit enables a user to provide instructions to the device by at least one of the following groups, the group consisting of: voice, viewing a specific location, inputting a command via a menu, and via A button inputs the command. This user interface can be a graphical user interface (GUI). The graphical user interface includes a display device (e.g., a cathode ray tube, a liquid crystal display, an electrical display device, or the like) for displaying information (e.g., information related to the environment) to an operator. In addition, the graphical user interface can include an input device to allow the user to enter data (e.g., specify information for the desired information) or to provide control commands to the system. Such an input device can include a keyboard, a joystick, a trackball or even a microphone of a speech recognition system 1326847. The GUI allows a user to communicate with the system in a two-way communication. The secondary material may be any material related to an area of interest based on a user selection. In particular, the secondary material may be at least one of a group consisting of: helping the user maintain or repair information about the device associated with the primary material, and relating to the primary material Information on an electronic product, safety related information, and police related information.

The apparatus further includes a probe unit for actually interacting with an object in the environment of the user. Such probe units, such as some type 10 pencils, may even be used by the user to specify a portion of a very small device, with additional information about the device being desired. It greatly simplifies pattern recognition because the shape of the probe can be pre-stored for easy identification. A label (e.g., an optical marker) can be provided to the probe unit to allow for easy identification of the location on an image being captured and indicating the orientation of the probe unit. In addition, the probe unit can include an oscilloscope or can be coupled to an oscilloscope. When processing an electronic device, the measurement of the oscilloscope can be performed, and a probe unit can be electrically coupled to the oscilloscope and a circuit, and can be further used to identify a part of the circuit (more information about it is desired) need). BRIEF DESCRIPTION OF THE DRAWINGS Other objects and many of the attendant advantages of the embodiments of the present invention will be readily understood and become apparent. Features that are substantially or functionally equal or similar can be referred to by the same reference symbols. Figure 1 shows a device 1 1326847 for processing data in an exemplary embodiment of the invention. Figure 2 shows a portion of a device for processing data in an exemplary embodiment of the invention. Figure 3 shows a device for processing data in an exemplary embodiment of the invention. Figure 4 is a diagram showing an information overlay function of a device for processing data in an exemplary embodiment of the present invention.

Figure 5 is a diagram showing an information overlay function of a device for processing data in an exemplary embodiment of the present invention. 10 Figure 6 is a block diagram showing an apparatus for processing data in an exemplary embodiment of the present invention. Figure 7 is a block diagram showing an apparatus for processing data in an exemplary embodiment of the present invention. The illustration in the drawings is illustrative. [Embodiment] Detailed Description Hereinafter, referring to Fig. 1, an apparatus 100 for processing data according to an exemplary embodiment of the present invention will be described. The device 100 includes a head mounted display (HMD) 110, and a camera 20 101 is disposed on the head mounted display 110 for detecting image data relating to a circuit 102, which is worn by a user wearing the headset In the context of the display 110, and in an operational state in which the user wearing the head mounted display 110 is looking in the direction of the circuit. When the user looks in the direction of the circuit 102, especially toward a direction of 18 1326847 resistor R1 107 (which may be faulty), the camera 1 〇 1 can detect a representative of this An image of a region of interest is provided, and corresponding image data can be provided to the interface computer 103. Further, a user interface 106 is provided laterally on the head mounted display 5 110 and allows a user to specify her or the head mounted display 110

The information he wants. For example, the user interface 106 can include a microphone via which a user can indicate more information, such as "I need more information about the resistor R1." Additionally or alternatively, the device 1-6 may be a touch screen presenting a menu from which a user may select a desired function. The image data captured by the camera 101 and/or the input defined by the user via the user interface 106 can be provided to the interface computer 103, which can be a laptop. Additionally, the functionality of the interface computer 103 can also be integrated into the HMD 110. 15 Detachable Ground A probe 112 can be connected to the interface computer 103 via an optional adapter unit lu. Via the probe 112, a user can display a note area within her or his field of view, such as by holding the probe 112 on her or his hand and pointing to the resistor R1 107, The user needs additional information about the resistor Rl 107. In addition, information about the region of the fish 20 can be provided, for example, via the adapter unit 111, the information is provided from the probe 112 to the interface computer 1〇3. In other words, the interface computer 1〇3 can receive information about the environment 1〇2 from the detection units 101, 106 and 112. A microprocessor (CPU) of the interface computer 103 can then process the sensor information from the receiver 19 1326847 to obtain abstract information from the detected results. For example, the interface computer 103 can recognize that the user 101 desires more information about the resistance R1 107 of the circuit 102.

This information can be provided from the interface computer 103 to an optional central 5 server computer 113. The central server computer 113 can be connected to a database 105 in which a large number of items of design material are stored. The server 113 and/or the interface computer 1〇3 can search in the database 1〇5 to find additional data in the database 105, which further indicates the resistor R1 that has been identified by the interface computer 103. 1〇7 is an element of interest to the user. 10 When this information is found, this information is provided from the central server computer 113 to the interface computer 103. The interface computer 103 can reconstruct this material for output by one of the presentation units 104 of the device 100. The presentation unit 104 can have a visual section and an audible section. The audible portion of the rendering unit 1-4 can output a sound wave indicative of the functional details of the resistor R1 107, 15 which is represented in Figure 1 as a white 114. In addition to this audible information indicating the function of the resistor R1 107, more information can be visually displayed on a display of the head mounted display 110, such as the value of the resistor R1 on the head mounted display 110. It was pointed out as 1〇〇Ohm. Next, referring to Fig. 2, a portion 200 of a device for processing data in accordance with an exemplary embodiment of the present invention will be described. A central processing unit (CPU) 103 of the system can receive various detection information about an environment in which one of the users of the system operates. A visual detection block 201 can detect an image of the environment. A 3D position sensor block 202 can obtain the 3D position and/or speed and/or acceleration of the object to be inspected. A voice or voice recognition sensor block 203 can obtain sound waves from the environment such that information about the environment is obtained. An olfactory sensor block 204 can be a gas sensor to detect odors in the environment. The results from the sensors 201 through 204 are provided to the CPU 5 103, which can obtain more abstract information about the environment. Via a two-way communication path 205, the CPU 103 can send a request and can receive a response in the form of secondary information about the environment based on the results of the detection blocks 201-204.

Such secondary information received via the communication path 20 5 (accessible via the Internet or any other network 10) may be displayed by a display/image projection output block 206 via a The loudspeaker unit 207 is emitted in the form of sound waves and/or is output as an artificial gas composition using an olfactory sensor generator 208. Next, referring to Fig. 3, a device 300 for processing data according to another exemplary embodiment of the present invention will be described. A two-dimensional object 3〇1 is detected to utilize an image acquisition device 302 and a three-dimensional orientation detection device 3 0 3 (to obtain image and spatial orientation information about the three-dimensional object 301). The devices 302 and 303 are disposed on a head mounted display 11A. The data picked up by the camera 3〇2 is supplied to an image recognition unit 3〇4. The data detected by the three-dimensional position sensor 310 is supplied to a three-dimensional model generator unit 305. The units 304, 305 further obtain abstract information about the position and orientation of the three-dimensional object 3.1 and provide the result to a CPU 103. 21 1326847 The CPU 103 can query a database 105 to obtain secondary information about the three-dimensional object 301, and then the secondary information is presented to the user by the presentation component 306 disposed on the head mounted display 110. Next, referring to Fig. 4, an information overlay function of the apparatus 400 according to one of the exemplary embodiments of the present invention will be explained. Figure 4 shows an image of a circuit 1〇2 that will be repaired by an operator. For this purpose, the user carries a head mounted display 11 , an image associated with one of the images captured by the camera 101 is displayed on the display u 'and thus displayed on the head mounted display 110 This information corresponds to an image that can be seen if the user views the same direction without the head mounted display 110. In particular, the user looks at a particular resistor with the eye, which is represented in Figure 4 as the resistor R1〇3. For this resistor, the user wants more information. The corresponding portion of the circuit 1〇2 is photographed by the camera 103. The camera 101 provides not only the captured image data to the head mounted display 110 for display, but also the captured image data to a pattern recognition unit 103. The ingested portion is mapped by the pattern recognition software to the design material stored in a database 105. The repair information about the resistor r 1 〇3 (stored in the database i 〇 5 20) can then be overlaid onto the head mounted display 110 so that the image in the circuit 丨〇 2 is in the block The corresponding information displayed in 4〇1 is presented to the operator. Next, referring to FIG. 5, an information overlay function of a device 500 for processing data according to another embodiment of the present invention will be described. β 22 1326847 The data processing system 500 is different from the data processing unit 400. A data processing system 500 is used as a pattern recognition system that is coupled between the camera 101 and the design system 105.

In addition, a probe 503 is provided via which the operator can refer to a particular portion of the circuit (e.g., the resistor r1〇3). Additional information via an observer 502' can then be displayed as information 401 that will be overlaid to the user. In other words, the probe 503 is coupled to the observer 502 such that the output can be displayed by the head mounted display 11A. Figure 6 shows a block diagram 600 of a device for processing data in an exemplary embodiment of the invention. A camera 101 and a probe 112 can be used to define a region of interest of an object 1〇2. The data acquired by the probe 112 can be provided to the observer 111 or 502. The output of the observer ill can be provided to the interface computer 103, and the output of the camera 101 can be further provided to the interface 103. The interface computer 1〇3 performs bidirectional communication with the server 1〇5 for 3D design to obtain information about the object 1〇2. Information obtained from the 3D server 105 is provided to the head mounted display 110 to display the display of the object 102 to the user along with the overlay information. The block diagram 700 of the data processing apparatus shown in FIG. 7 is different from the block 20, FIG. 6A in that the camera 101 is replaced by a position sensor 701 that receives a transmission from a reference point. Machine 7〇2 information. The word "comprising" does not exclude other elements or features, and "a" or "an" does not exclude the plural. In addition, elements described in accordance with various embodiments may be combined. Yes, the reference number in the patent application no. 23 1326847 should not be construed as limiting the scope of the patent application. [Circular Simple Description 3 FIG. 1 shows a device for processing data in an exemplary embodiment of the present invention. Figure 2 shows a portion of a device for processing data in an exemplary embodiment of the invention.

Figure 3 shows a device for processing data in an exemplary embodiment of the invention. 10 Figure 4 shows an information overlay function of a device for processing data in an exemplary embodiment of the invention. Figure 5 is a diagram showing an information overlay function of a device for processing data in an exemplary embodiment of the present invention. Figure 6 is a block diagram showing an apparatus for processing data in an exemplary embodiment of the present invention.

Figure 7 is a block diagram showing an apparatus for processing data in an exemplary embodiment of the present invention. [Description of main component symbols] 100...Device 101...Camera, detection unit 102··· Circuit, object 103·Interface computer 104... Presentation unit 105···Database, design system, server 106...user interface Detection unit 107···Resistor 110... Head-mounted display m···Adapter unit, observer 112... Detection unit, probe 113···Central server computer 24 1326847

114··· voice mouth white 305... three-dimensional model generator unit 200···a part of device 306...presentation elements 201~204...sensor, detection block 400...device, data processing unit 205...communication path 401...information 206···Display/Image Projection Output Block 500...Data Processing System 207···Amplifier Unit 501—OCR System 208·. Olfactory Sensing Generator 502... Observer 300...Device 503...Probe 301··· Three-dimensional object 600...device for processing data...image acquisition device 700...device for processing data 303...three-dimensional orientation detection device 701...position sensor 304...image recognition unit 702...reference point transmitter

25

Claims (1)

96103186 ΐ It t # ^10, the scope of application for patents: 99.04.30. - A device for processing data, the device comprises: a detection unit, suitable for detecting main data indicating an environment of a user ; Rhyme 7L 'is applicable to the analysis of the main data measured by the debt to identify the secondary data assigned to the primary data; the presentation unit, which is suitable for presenting the secondary information to the user' The secondary _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2. The device of claim 2, wherein the detecting unit is adapted to detect primary data indicative of at least a portion of the user's field of view. 3. The device as claimed in claim 4, wherein the detecting unit comprises: a camera </ RTI> for detecting the image in the environment of the user as the main data. 4. In the case of the device described in the item pursuant to sub-item, the towel-identification unit is adapted to identify the secondary material assigned to the primary material via pattern recognition. The apparatus of claim 1, wherein the identification unit is adapted to map the secondary material to the primary material. The device according to the scope of the patent application, wherein the presentation unit is adapted to present the second to the use of the group consisting of a visual representation, an auditory and a rhyme presentation. 6. The device of claim 1, wherein the presentation unit comprises a display unit. 8. The apparatus of claim 3, wherein the presentation unit package s-displays or is part of the job display. If the content is _1st rhyme (4), the current unit of the county is suitable for overlaying the secondary information and the main items, and the (4) secondary information and the 5 Hai main materials are presented to the user together. 10. The device of claim i, wherein the presentation unit is adapted to visually and/or audibly overlay the secondary material and the primary data for use in the secondary data and The main data is presented to the user. The device of claim 9, wherein the secondary material represents information about the object, and wherein the primary material represents the object. Taking the device as described in claim 9 of the patent application, wherein the secondary data generation The table pertains to information about a physical object, and wherein the primary material represents the physical object. 13. The device as described in the scope of claim 2 includes a database for storing data including the secondary material and is accessible by the identification unit. The device as set forth in claim </ RTI> includes a user interface unit adapted to cause a user to provide instructions for specifying the primary data to be analyzed to the device. The device of claim 14, wherein the user interface unit is adapted to enable a user to pass at least one of a group of 27 1326847 Instructions are provided to the device, the group consisting of: voice, viewing at a particular location, viewing in a particular direction, entering the commands via a select column, entering the commands via a joystick, via a track The track inputs the commands, inputs the commands via a keyboard, and inputs the commands via a button. 16. The device of claim 1, wherein the secondary material is at least one of the group consisting of: assisting the user in maintaining or repairing a device associated with the primary material Information, information about an electronic product related to the primary information, safety related information, and police related information. 17. The device of claim 1, comprising a probe unit adapted to physically interact with an object in the environment of the user. 18 as recited in claim 17 The device wherein the probe unit is functionally coupled to the identification unit such that the object is a note area in the environment of the user. 19. The device of claim 17, wherein the probe unit specifies the primary material by referring to at least a portion of the object. 20. The device of claim 17, wherein the probe unit comprises an oscilloscope. 21. A method for processing data, the method comprising the steps of: detecting primary data indicative of an environment of a user; analyzing the primary data detected to identify that the primary data is assigned to the primary data Secondary information; 28 22. .r^ The control assigns the secondary material to the use and the designation of the secondary material to the primary material is perceptible to the user. : Computer-readable media, the computer program for processing data is stored in ^, when executed by the processor, the computer program is applicable or implemented - the method includes the following steps: · Detection indicates a primary material of an environment of a user; analyzing the primary data to be identified to identify secondary information assigned to the primary data; presenting the secondary information to the user, such that the secondary information This designation of the primary material is perceptible to the user. 23. A program component for processing data, when executed by a processor, the program component is adapted to control or implement a method, the method comprising the steps of: detecting a primary data representing an environment of a user; The primary data detected to identify the secondary data assigned to the primary data; presenting the secondary information to the user, such that the primary information to the primary data is specified to the user It is perceptible.