KR102477067B1 - Augmented reality implementing system using wearable sound device - Google Patents

Abstract

The present invention relates to an augmented reality implementation system, and more particularly, augmentation using a wearable sound device that is electrically connected to a wearable sound device worn on the neck or shoulder to supply power and provides a health management function by acquiring a plurality of data. It is about a real-world implementation system.
An augmented reality implementation system using a wearable sound device according to the present invention includes an augmented reality implementation device that is worn on a user's face and has a display unit in which at least a portion facing the user's eyes is transparent so that the display unit performs an augmented reality display, and the user's neck or neck. It is composed of a wearable sound device that is seated on the shoulder and performs a sound reproduction function, and a connection line electrically connecting the augmented reality device and the wearable sound device. The wearable sound device supplies power to the augmented reality device through the connection line. It is desirable to do

Description

Augmented reality implementation system using wearable sound device {AUGMENTED REALITY IMPLEMENTING SYSTEM USING WEARABLE SOUND DEVICE}

The present invention relates to an augmented reality implementation system, and more particularly, augmentation using a wearable sound device that is electrically connected to a wearable sound device worn on the neck or shoulder to supply power and provides a health management function by acquiring a plurality of data. It is about a real-world implementation system.

Augmented reality is a technology that superimposes virtual objects on the real world that the user sees. It is also called mixed reality (MR) because it combines the real world with the virtual world with additional information in real time and shows it as a single image. It is a hybrid VR system that fuses real and virtual environments. Since the late 1990s, research and development have been conducted mainly in the United States.

Currently, head-mounted devices that implement augmented reality have a form that is worn by being seated on a user's head, ears, nose, etc., such as glasses or goggles. Since such a conventional head-mounted device is worn on the user's head, its weight must be limited, and due to this limited weight, the battery capacity is also limited, resulting in a relatively short actual use time.

Korean Patent Publication No. 10-2016-0026557 'Head mounted display device'

The present invention is electrically connected to a wearable sound device to supply power and acquire a plurality of data (eg, image, body temperature, electrocardiogram, etc.), thereby enabling augmented reality with improved realism and various health management functions. An object of the present invention is to provide an augmented reality implementation system using a wearable sound device provided.

An augmented reality implementation system using a wearable sound device according to the present invention includes an augmented reality implementation device that is worn on a user's face and has a display unit in which at least a portion facing the user's eyes is transparent so that the display unit performs an augmented reality display, and the user's neck or neck. It is composed of a wearable sound device that is seated on the shoulder and performs a sound reproduction function, and a connection line electrically connecting the augmented reality device and the wearable sound device. The wearable sound device supplies power to the augmented reality device through the connection line. It is desirable to do

Also, the augmented reality implementation device preferably displays road guidance information on a display unit.

In addition, the augmented reality implementation device includes a camera and a communication unit, transmits image data by the camera to the wearable sound device through the communication unit, and the wearable sound device uses the communication unit and an artificial intelligence function to perform object recognition. It has a module, receives image data from the augmented reality implementation device through the communication unit, recognizes an object for the received image data through the object recognition module, generates object recognition information, transmits it to the augmented reality implementation device, and transmits the augmented reality device. It is preferable that the implementation device receives the object recognition information and displays the received object recognition information through the display unit.

Also, the augmented reality implementation device preferably includes a communication unit and a temperature sensing unit that contacts or approaches the user's skin, and the wearable sound device preferably includes at least one of a gas sensor, a radar sensor, and a temperature sensing unit and a communication unit.

In addition, the wearable sound device determines the quality of outdoor air and the user's exhalation using a detected value from a gas sensor, calculates a heart rate using a reflected signal from a radar sensor, or receives an external temperature from a temperature sensor, and stores at least one of exhalation quality, heart rate, or external temperature as health data for a health management function, the wearable sound device transmits the health data to an augmented reality device through a communication unit, and the augmented reality implementation device uses a communication unit It is preferable to receive the health data through the display unit and display the received health data through the display unit.

In addition, the augmented reality implementation device includes a communication unit and a camera, and includes a camera and a communication unit, and transmits image data of a plant by the camera to a wearable sound device through the communication unit, and the wearable sound device has a communication unit and an artificial intelligence function Equipped with an object recognition module for performing object recognition using a gas sensor, receiving image data from an augmented reality implementation device through a communication unit, recognizing an object of the received image data through the object recognition module, and recognizing an object. Generate information, determine the phytochemical component of the plant using the object recognition information and the flow rate of the plant from the gas sensor, transmit the determined phytochemical component to the augmented reality implementation device through the communication unit, augmented reality The implementation device preferably receives the phytochemical component through the communication unit and displays the received phytochemical component through the display unit.

In addition, the wearable sound device calculates the intake amount for each phytochemical component using the determined phytochemical component and object recognition information, compares the calculated intake amount with the recommended intake amount, calculates the phytochemical component to be supplemented and the supplemental intake amount, It is preferable that the chemical information is included in the chemical information and transmitted to the augmented reality implementation device through the communication unit, the augmented reality implementation device receives the phytochemical information through the communication unit, and displays the received phytochemical information through the display unit.

In addition, it is preferable that the connection line is detachable from each of the augmented reality implementation device and the wearable sound device.

The present invention is electrically connected to the wearable sound device and continuously supplied with power, thereby increasing the operation time of the augmented reality device and acquiring a plurality of data (e.g., image, body temperature, electrocardiogram, etc.) By doing so, there is an effect of providing augmented reality with improved realism and various health management functions.

1 is a simplified perspective view of an augmented reality implementation system using a wearable sound device according to the present invention.
FIG. 2 is a control block diagram of an augmented reality implementation system using the wearable sound device of FIG. 1 .

Hereinafter, the present invention will be described in detail through examples and drawings. However, it should be understood that this is not intended to limit the present invention to the specific embodiments, and includes various modifications, equivalents, and/or alternatives of the embodiments of the present invention. In connection with the description of the drawings, like reference numerals may be used for like elements.

In this document, expressions such as "has", "may have", "includes", or "may include" refer to the presence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

In this document, expressions such as "A or B", "at least one of A and/and B", or "one or more of A or/and B" may include all possible combinations of the items listed together. . For example, "A or B", "at least one of A and B", or "at least one of A or B" includes (1) at least one A, (2) at least one B, Or (3) may refer to all cases including at least one A and at least one B.

Expressions such as "first", "second", "first", or "second" as used herein may modify various elements, in any order and/or importance, and may refer to one element as another. It is used to distinguish from components, but does not limit the components. For example, a first user device and a second user device may represent different user devices regardless of order or importance. For example, without departing from the scope of rights described in this document, a first element may be called a second element, and similarly, the second element may also be renamed to the first element.

A component (e.g., a first component) is "(operatively or communicatively) coupled with/to" another component (e.g., a second component); When referred to as "connected to", it should be understood that the certain component may be directly connected to the other component or connected through another component (eg, a third component). On the other hand, when an element (eg, a first element) is referred to as being “directly connected” or “directly connected” to another element (eg, a second element), the element and the above It may be understood that other components (eg, a third component) do not exist between the other components.

As used in this document, the expression "configured to" means "suitable for", "having the capacity to", depending on the situation. ", "designed to", "adapted to", "made to", or "capable of" can be used interchangeably. The term "configured (or set) to" may not necessarily mean only "specifically designed to" hardware. Instead, in some contexts, the phrase "device configured to" may mean that the device is "capable of" in conjunction with other devices or components. For example, the phrase "a processor configured (or set) to perform A, B, and C" may include a dedicated processor (eg, an embedded processor) to perform those operations, or one or more software programs stored in a memory device that executes By doing so, it may mean a general-purpose processor (eg, CPU or application processor) capable of performing corresponding operations.

Terms used in this document are only used to describe a specific embodiment, and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by a person of ordinary skill in the technical field described in this document. Among the terms used in this document, the terms defined in general dictionaries may be interpreted as having the same or similar meaning to the meaning in the context of the related art, and unless explicitly defined in this document, in an ideal or excessively formal meaning. not interpreted In some cases, even terms defined in this document cannot be interpreted to exclude the embodiments of this document.

1 is a simplified perspective view of an augmented reality implementation system using a wearable sound device according to the present invention.

The augmented reality implementation system is electrically detached from the augmented reality implementation device 100 worn on the user's face in the form of glasses, seated on the user's neck or shoulder, and through the augmented reality implementation device 100 and connection lines 310 and 320. The wearable sound device 200, the augmented reality device 100, and the wearable sound device 200 are configured to include a connection line 300 composed of first and second connection lines 310 and 320 electrically connecting the wearable sound device 200 and the like. do.

The augmented reality implementation device 100 includes a display unit 110 composed of first and second display units 110a and 110b, at least partially transparent, facing the user's eyes, and enclosing at least a portion of the display unit 110 to allow the user to A side frame 130 composed of a front frame 120 in contact with the nose of the user and first and second leg parts 130a and 130b connected to both ends of the support part 120 and in contact with the user's ear or facial skin. It is configured and worn on the user's head or face.

The front frame 120 and the side frame 130 (first and second leg parts 130a and 130b) are hinged so that the side frame 130 can be folded to the rear surface of the front frame 120.

The front frame 120 is equipped with first and second cameras 156a and 156b for photographing the front of the user (the front of the front frame 120).

The temperature sensor 150 is mounted on the inner surface of the side frame 130 (that is, the surface facing the user's head or facial skin).

The wearable sound device 200 includes a main body 210 seated around a user's neck or shoulder. As shown in the figure, the main body part 210 may be a neckband type having an opening through which the user's body (eg, neck, etc.) can pass through, or a strap shape to be seated on the user's neck or shoulder. can At least a portion of the body portion 210 may have elasticity. A plurality of sound emission holes 211 for sound emission to the outside are provided on the outer surface of the body part 210 . An opening 256a for contact with air is formed on the upper surface of the main body 210 . In addition, first and second cameras 264a and 264b are mounted on the body portion 210 facing forward, and a third camera 264c is mounted on the body portion 210 facing backward.

The body portion 210 includes first and second accommodating portions 212a and 212b, which are both ends of the main body portion 210 that form an opening, and each of the first and second accommodating portions 212a and 212b is Each of the first and second earphone units 220a and 220b has first and second grooves 214a and 214b in which the first and second earphones 220a and 220b are accommodated or seated.

Each of the first and second earphone parts 220a and 220b, which can be inserted and accommodated (mounted) or separated (unmounted) in the first and second accommodating parts 212a and 212b, respectively, is connected to the body part 210 (or data It is connected to the main body 210 through first and second connection lines 230a and 230b for electrical and physical connection with the processor 270, respectively.

In addition, a winding device (not shown) for unwinding and winding the first and second connection wires 230a and 230b is provided in the main body 210 . The winding device may perform unwinding and winding operations automatically or by an external force. Each of the first and second connection lines 230a and 230b is wound or unwound by a winding device through a through hole (not shown) formed in the first and second grooves 214a and 214b, and the first and second earphone units ( 220 and 220b) are electrically connected to the data processor 270 through first and second connection lines 230a and 230b.

A state in which the winding device performs a winding operation and the first and second earphone units 220a and 220b are accommodated and seated in the first and second grooves 214a and 214b (mounted state) is shown in FIG. 1, The first and second connection lines 230a and 230b are accommodated in the main body 210 by the winding device. On the other hand, the winding device performs an unwinding operation, and the first and second earphone units 220a and 220b are separated from the first and second grooves 214a and 214b, respectively (unmounted state), and the first and the second connection lines 230a and 230b are exposed and extended to the outside of the main body 210 .

The connection line 300 includes first and second connection lines 310 and 320 having one end connected to the augmented reality device 100 and the other end connected to the wearable sound device 200, respectively. However, the connection line 300 may also consist of a single line. The connection line 300 at least supplies power from the wearable sound device 200 to the augmented reality device 100, and may additionally provide an electrical connection for data communication. The connection between the connection line 300, the augmented reality implementation device 100, and the wearable sound device 200 may be implemented with, for example, a USB port, and the connection line 300 connects the augmented reality implementation device 100 and the wearable sound device (200) each and detachable.

FIG. 2 is a control block diagram of an augmented reality implementation system using the wearable sound device of FIG. 1 .

The augmented reality implementation system is electrically connected/disconnected from the augmented reality implementation device 100 that displays augmented reality through the display unit 110 when worn on the user's face, and the augmented reality implementation device 100, and implements augmented reality. A wearable acoustic device 200 that communicates with each of the device 100 and the electronic communication device 400, and electronic communication that communicates with the wearable acoustic device 200 and communicates with an information providing server (not shown) It is configured to include the device 400 and the like.

The control configuration of the augmented reality implementation device 100 includes an input unit 152 that obtains an input (eg, power on/off, etc.) from a user and applies it to the data processor 170, and controls the data processor 170. The display driver 154 performing the augmented reality display operation on the display unit 110 by the display unit 110, and the first and second images for photographing the front of the front frame 120 and transmitting image data to the data processor 170, respectively. A camera 156 including cameras 156a and 156b, and a location sensor 158 that applies the location (eg, GPS detection value, etc.) of the augmented reality device 100 to the data processor 170, , a temperature sensor 160 that detects body temperature in contact with or close to the user's skin and applies the body temperature to the data processor 170, the wearable sound device 200 and the electronic communication device 400 or an information providing server (not shown) Power supplied from the wearable sound device 200 through the communication unit 162 and the connection unit 166 that perform wireless or wired communication with the like), receive image data, object recognition data, and the like, and apply the received data to the data processor 170 or the power supply unit 164 that supplies the power of the built-in battery to components requiring power (eg, data processor 170, display driver 154, camera 156, etc.), electrically to the connection line 300 It is configured to include a detachable connector 166 (eg, a USB port, etc.) and a data processor 170 that controls the above-described components to perform augmented reality display functions and health management functions. However, the input unit 152, the position sensor 158, the temperature sensor 160, the communication unit 162, the power supply unit 164, the connection unit 166, etc. are common in the art to which the present invention belongs. Corresponds to a technology that is naturally recognized by technicians, and a detailed description thereof is omitted.

The control component of the augmented reality device 100 is mounted on the inside or side of the side frame 130 or the front frame 120 .

The display driver 154 is configured to include an optical engine or the like that visually displays the augmented reality data from the data processor 170 on the display unit 110 as augmented reality. In this embodiment, the display unit 110 is implemented as a transparent holographic wave-guide, and the display driver 154 causes a light source corresponding to augmented reality data to be incident on the display unit 110, and the incident As the light source is reflected within the display unit 110, it is possible to implement augmented reality integrated with the user's vision.

The camera 156 includes a Time Of Flight (TOF) sensor for capturing an image and measuring a distance between an object and the augmented reality device 100 and applies the image data and the distance data to the data processor 170 . In this embodiment, image data and distance data may be referred to as photographing data.

The data processor 170 is a processor (eg, CPU, MCU, etc.) that performs an augmented reality display function and a health management function, an augmented reality implementation algorithm, image data, distance data, augmented reality data, body temperature, and route guidance. It is configured to include a storage space (eg, a memory, etc.) for storing geographic information and the like. Functions performed by data processor 170 are described in detail below.

Next, the wearable sound device 200 uses the earphone unit 220 including the first and second earphone units 220a and 220b, and input from the user (eg, object recognition operation, health management function operation). etc.) obtained and applied to the data processor 270, and a display unit that displays functions or modes (eg, sound expression mode, phone call mode, object recognition function, health management function, etc.) in operation. 244, a microphone 246 that acquires external sound and applies it to the data processor 270, a speaker 248 that emits sound through the sound emission hole 211, and an augmented reality implementation device 100 ) and the electronic communication device 400, and the communication unit 250 that performs wireless or wired communication, transmits a signal to the outside, receives a reflected signal of the transmitted signal, and applies the received reflected signal to the data processor 270 A radar sensor 252 and an object recognition module 254 for recognizing an object in image data using an artificial intelligence (AI) function and applying the recognized object recognition information to the data processor 270; A gas sensor 256 (e.g., a VOC sensor etc.), a temperature sensor 258 that senses the external temperature and applies the detected external temperature to the data processor 270, and power supply and connection lines 300 to the components of the wearable sound device 200 A power supply unit 260 that supplies power to the augmented reality implementation device 100 through a power supply unit 260, a connection unit 262 electrically detachable from the connection line 300 (eg, a USB port, etc.), and a wearable sound device 200 A camera 264 including first to third cameras 264a to 264c for taking pictures of the front and rear of the camera 264 and the above-described components to control a sound reproduction function, a phone call function, as well as an augmented reality implementation device ( 100) and a data processor 270 that performs a function of supplying power and transmitting data (image data, object recognition information, etc.), and a health management function. However, the earphone unit 220, the input unit 242, the display unit 244, the microphone 246, the speaker 248, the communication unit 250, the radar sensor 252, the object recognition module ( 254), the gas sensor 256, the temperature sensor 258, the connector 262, the camera 264, etc. correspond to technologies naturally recognized by those skilled in the art to which the present invention belongs, Detailed descriptions are omitted.

When the connection line 300 is electrically connected to the connection unit 262, the power supply unit 260 supplies power to the augmented reality implementation device 100 through the connection unit 262 independently of the data processor 270 or the data processor 270. Power is supplied to the augmented reality implementation device 100 through the connection unit 262 under the control of step 270 .

The data processor 270 is a processor that performs not only a sound reproduction function and a phone call function, but also a power supply to the augmented reality implementation device 100 and a transmission function of data (image data, object recognition information, etc.) and a health management function ( For example, CPU, MCU, etc.), image data, shooting data (image data and distance data), object recognition information, data for health management functions (external temperature, body temperature, heart rate, outdoor air quality, exhalation quality, scent It is configured to include a storage space (eg, memory, etc.) for storing content, phytochemical components, intake amount for each component, etc.). Functions performed by data processor 270 are described in detail below.

The electronic communication device 400 is, for example, an information communication device such as a smart phone or a tablet, and includes an input unit 442 that obtains an input from a user and applies it to the data processor 470, and an operating mode or other information. A display unit 444 that displays a , a communication unit 460 that communicates with the wearable sound device 200 or the augmented reality device 100 and the information providing server, and controls the above-described components to perform a health management function It is configured to include a data processor 470 and the like. However, since the power supply unit (not shown), the input unit 442, the display unit 444, and the communication unit 460 are naturally recognized by those skilled in the art, detailed descriptions thereof are omitted. .

The data processor 470 is a processor (eg, CPU, MCU, etc.) performing an object recognition function or health management function and data for health management function (external temperature, body temperature, heart rate, outdoor air quality, exhalation quality, fragrance It is configured to include a storage space (eg, memory, etc.) for storing content, intake by phytochemical component, etc.) (or health data). Functions performed by data processor 470 are described in detail below.

First, an augmented reality display function to which an object recognition function is applied will be described.

The data processor 170 transmits photographing data (image data and/or distance data) from the camera 156 to the wearable sound device 200 through the communication unit 162 .

The data processor 270 transmits the image data received through the communication unit 250 and/or the image data and/or distance data generated by the camera 264 to the object recognition module 254, and the object recognition module 254 ) recognizes an object in the image data using an artificial intelligence function, generates object recognition information, and applies the object recognition information to the data processor 270 . Alternatively, the data processor 270 transmits image data and/or distance data to the electronic communication device 400 through the communication unit 250, and the data processor 470 receives the image data through the communication unit 460, The object recognition information may be transmitted to an information providing server (for example, Google Assistant) performing an object recognition function, and object recognition information may be received from the information providing server.

The data processor 270 transmits the applied or received object recognition information to the augmented reality implementation device 100 through the communication unit 250 .

The data processor 170 receives object recognition information through the communication unit 162, converts the received object recognition information into real data displayed on the display unit 110, and applies it to the display driver 154 to perform an augmented reality display function. carry out The augmented reality data may additionally include, for example, route information of map data and health management function data so that the data processor 170 may perform a road guidance function. The data processor 170 displays a road guidance display on the display unit 110 using location information from the location sensor 158 and route information of map data.

Next, the health management function is explained. The health management function includes a process of calculating or determining environmental information (eg, external temperature, body temperature, heart rate, external air quality, exhaled air quality, fragrance content, intake of phytochemicals, etc.).

In the case of the external temperature, the data processor 270 stores the temperature received from the temperature sensor 258 as an external temperature and transmits it to the augmented reality implementation device 100 through the communication unit 250 . The data processor 170 includes the received external temperature in augmented reality data and applies the data to the display driver 154 to display the data on the display 110 so that the user can check the external temperature.

In the case of body temperature, the data processor 170 receives the body temperature from the temperature sensor 160, includes the received body temperature in augmented reality data, applies it to the display driver 154, displays it on the display unit 110, and displays it on the display unit 110. to check the user's body temperature. In addition, the data processor 170 transmits the body temperature to the wearable sound device 200 through the communication unit 162, and the data processor 270 receives the body temperature through the communication unit 250 and stores it as data for health management functions. can

In the case of heart rate, the data processor 270 digitally converts the reflected signal (analog signal) from the radar sensor 252, analyzes the digitally converted reflected signal, calculates and stores the user's heart rate. The data processor 270 transmits the stored heart rate to the augmented reality implementation device 100 through the communication unit 250 . The data processor 170 includes the received heart rate in augmented reality data, applies the data to the display driving unit 154, and displays it on the display unit 110 so that the user can check the heart rate.

In the case of outdoor air quality, the data processor 270 receives a sensing value from the gas sensor 256 and compares the received sensing value with quality reference data to determine outdoor air quality. The quality reference data corresponds to data capable of determining air quality according to detected values. The data processor 270 transmits the determined outdoor air quality to the augmented reality implementation device 100 through the communication unit 250 . The data processor 170 includes the received outdoor air quality in the augmented reality data and applies the data to the display driver 154 to display the data on the display unit 110 so that the user can check the outdoor air quality.

In the case of exhalation quality, the data processor 270 determines or obtains an exhalation mode input for determining the user's exhalation (exhalation) through the input unit 242, and sends an opening 256a to the user through the speaker 248. directs the exhalation toward the The data processor 270 determines the quality of the detected value received from the gas sensor 256 for a certain period of time after the above guidance, and stores the determined quality as the breath quality. The exhalation quality may include, for example, diagnosis of diabetes according to the amount of acetone, amount of fat consumed by the user, alcohol concentration, and the like. The data processor 270 transmits the determined exhalation quality to the augmented reality implementation device 100 through the communication unit 250 . The data processor 170 includes the received exhaled breath quality in augmented reality data and applies the result to the display driver 154 to display the exhalation quality on the display unit 110 so that the user can check the exhalation quality. In particular, since the gas sensor 256 is mounted on the body part 211, when the user slightly lowers his or her head or places the body part 211 (gas sensor 256) close to the mouth and exhales, the gas sensor ( 256) can easily contact the exhaled air.

Next, health care functions using phytochemicals will be described.

The data processor 270 uses the color of the plant corresponding to the phytochemical component and the content of the scent of the plant to determine phytochemical information (intake amount, etc.) of the plant consumed by the user. In order to use the color of the plant, the data processor 270 transmits the image data received from the augmented reality device 100 and/or the image data from the camera 264 to the object recognition module 254, and object recognition. The module 254 applies object recognition information (eg, name, color, volume, etc.) of an object in the image data to the data processor 270, and the data processor 270 stores the object recognition information. In addition, in order to use the content rate of plant fragrance, the data processor 270 obtains and stores the detected value from the gas sensor 256.

The data processor 270 determines the phytochemical component corresponding to the color and fragrance content of the plant body. The phytochemical component may include, for example, at least one of lycopene, beta-carotene, chlorophyll, anthocyanin, allicin, and chlorogenic acid. For example, if grapes are included in the image data, the object recognition information includes the name (grape) and color (purple), and the data processor 270 determines that the phytochemical component of the plant is anthocyanin. The data processor 270 transmits object recognition information and names of phytochemical components to the augmented reality implementation device 100 through the communication unit 250 . The data processor 170 receives the object recognition information and the name of the phytochemical component through the communication unit 162, converts it into augmented reality data, and applies it to the display driver 154 to display the object recognition information and the phytochemical component to the display unit 110. The name of the chemical component should be indicated.

Since the data processor 270 has to determine the above phytochemical components when the user ingests the plant, the above determination process is performed only when the input unit 242 obtains the health management function operation input using the phytochemical. carry out

In addition, the data processor 270 calculates and stores the intake amount for each phytochemical component consumed by the user during a predetermined unit period (eg, daily, etc.). Based on the volume and name included in the object recognition information, the data processor 270 may estimate the amount of the plant and store the estimated amount as an intake amount. The data processor 270 transmits the intake amount for each phytochemical component (ie, phytochemical information) to the augmented reality implementation device 100 through the communication unit 250, and the data processor 170 transmits the current intake amount for each phytochemical component ( That is, phytochemical information) is received through the communication unit 162, converted into augmented reality data, applied to the display driver 154, and displayed on the display unit 110.

In addition, the data processor 270 stores recommended intake amount information for each phytochemical component, compares the recommended intake amount with the current intake amount for each phytochemical component, calculates the phytochemical component to be supplemented and its supplemented intake amount, and calculates the phytochemical information. It is included and transmitted to the augmented reality implementation device 100 through the communication unit 250, and the data processor 170 receives the phytochemical information through the communication unit 162, converts it into augmented reality data, and applies it to the display driver 154. So that it is displayed on the display unit 110.

In addition, the data processor 270 transmits the above-described health data to the electronic communication device 400 through the communication unit 250, and the data processor 470 receives and stores the health data through the communication unit 460, and displays the health data. It can also be displayed through (444).

At least a part of a device (eg, a processor or functions thereof) or a method (eg, operations) according to various embodiments may be stored in a computer-readable storage medium in the form of a program module. Can be implemented as stored instructions. When the command is executed by a processor, the one or more processors may perform a function corresponding to the command. A computer-readable storage medium may be, for example, a memory.

Computer-readable recording media include hard disks, floppy disks, magnetic media (eg magnetic tape), optical media (eg CD-ROM, DVD (Digital Versatile Disc), magnetic- It may include optical media (e.g., a floptical disk), hardware devices (e.g., ROM, RAM, or flash memory, etc.), etc. In addition, the program instructions may include the same as generated by a compiler. It may include not only machine code but also high-level language code that can be executed by a computer using an interpreter, etc. The above-described hardware device may be configured to operate as one or more software modules to perform operations of various embodiments, The reverse is the same.

Processors or functions by processors according to various embodiments may include at least one or more of the aforementioned elements, some may be omitted, or additional elements may be further included. Operations performed by modules, program modules, or other components according to various embodiments may be executed in a sequential, parallel, repetitive, or heuristic manner. Also, some actions may be performed in a different order, omitted, or other actions may be added.

As described above, the present invention is not limited to the specific preferred embodiments described above, and anyone having ordinary knowledge in the technical field to which the present invention pertains can do various things without departing from the gist of the present invention claimed in the claims. Of course, variations are possible, and such variations are within the scope of the claims.

100: augmented reality implementation device 200: wearable sound device
300: connection line 400: electronic communication device

Claims (8)

an augmented reality implementation device that is worn on a user's face and includes a display unit in which at least a portion facing the user's eyes is transparent so that the display unit performs an augmented reality display;
a wearable sound device seated on a user's neck or shoulder and performing a sound reproducing function;
It is configured to include a connection line electrically connecting the augmented reality implementation device and the wearable sound device,
The wearable sound device supplies power to the augmented reality implementation device through a connection line,
The augmented reality implementation device includes a communication unit and a camera, and includes a camera and a communication unit, transmits image data of a plant by the camera to a wearable sound device through the communication unit,
The wearable sound device includes a communication unit, an object recognition module that performs object recognition using an artificial intelligence function, and a gas sensor, receives image data from an augmented reality device through the communication unit, and receives image data through the object recognition module. Recognizing objects in image data to generate object recognition information;
The phytochemical components of the plant are determined using the object recognition information and the flow rate of the scent of the plant from the gas sensor, and the determined phytochemical components are transmitted to the augmented reality implementation device through the communication unit,
An augmented reality implementation system using a wearable sound device, characterized in that the augmented reality implementation device receives a phytochemical component through a communication unit and displays the received phytochemical component through a display unit. According to claim 1,
An augmented reality implementation system using a wearable sound device, characterized in that the augmented reality implementation device displays road guidance information on a display unit. According to claim 1 or 2,
The wearable sound device transmits the generated object recognition information to the augmented reality implementation device,
An augmented reality implementation system using a wearable sound device, characterized in that the augmented reality implementation device receives object recognition information and displays the received object recognition information through a display unit. According to claim 1,
The augmented reality implementation device includes a temperature sensing unit in contact with or close to the user's skin,
An augmented reality implementation system using a wearable sound device, characterized in that the wearable sound device includes a radar sensor. According to claim 4,
The wearable sound device determines the quality of outdoor air and the user's exhalation by using the detected value from the gas sensor, calculates the heart rate using the reflected signal from the radar sensor, or receives the external temperature from the temperature sensor, and At least one of quality or heart rate or external temperature is stored as health data for a health management function;
The wearable sound device transmits health data to an augmented reality device through a communication unit,
An augmented reality implementation system using a wearable sound device, characterized in that the augmented reality implementation device receives health data through a communication unit and displays the received health data through a display unit. delete According to claim 1,
The wearable sound device calculates the intake amount for each phytochemical component using the determined phytochemical component and object recognition information,
Comparing the calculated intake with the recommended intake, calculating the phytochemical component to be supplemented and its supplement intake, including it in the phytochemical information, and transmitting it to the augmented reality implementation device through the communication unit,
An augmented reality implementation system using a wearable sound device, characterized in that the augmented reality implementation device receives phytochemical information through a communication unit and displays the received phytochemical information through a display unit. According to claim 1,
An augmented reality implementation system using a wearable sound device, characterized in that the connection line is detachable from each of the augmented reality implementation device and the wearable sound device.

Images