KR20200058261A - Hologram service device using human body detection - Google Patents

Abstract

The present invention relates to a hologram service device using a human body detection, and more specifically, to provide a hologram service device using a human body detection which checks a direction of a person′s movement and outputs hologram images and voices related to greetings and guidance based on the direction of the person′s movement. The hologram service device includes: a human body detection unit (100) for sensing a person; a hologram unit (200) for outputting hologram images and sound; and an artificial intelligence unit (900) which checks a direction of the person′s movement based on the information detected from the human body detection unit (100), and controls the output of the hologram unit (200) related to greetings and guidance based on the direction of the person′s movement.

Description

Hologram service device using human body detection {HOLOGRAM SERVICE DEVICE USING HUMAN BODY DETECTION}

The present invention relates to a hologram service device using human body detection, and more specifically, to a hologram service device using human body detection that checks a person's movement direction and outputs hologram images and voices related to greetings and guidance based on this. will be.

Personnel etiquette and advertising play an important role in attracting customers.

In general, advertising devices are installed in public places, roadsides, or rooftops of buildings where many people move, to attract people's attention, or by providing information on specific products, to stimulate the desire to purchase products, and to purchase specific products It was made to induce.

Therefore, such an advertising device stimulates the desire to purchase a product in order to obtain a high advertisement effect desired by an advertiser, or stimulates curiosity to induce information about the advertisement product to enter the store.

However, such an advertising device has a problem in that it takes up a large portion of space.

In our society, companies are well aware that the amount and quality of emotional services expressed to customers is closely related to 'sales'. For this reason, companies have expressed rules and sentiments of customer sentiment and customer interaction manuals to express emotions and norms in industrial places where service is important.

In fact, the early capitalist system was concerned only with physical labor performed in the post- and post-service process.

For this reason, the work spaces of major service industries such as banks, department stores, airlines, hotels, hospitals, restaurants, and cafes also employ traditional workshop systems (Taylor Work Organizations).

As a result, the labor process in the service industry also began to change in a similar fashion to the manufacturing industry.

On the other hand, in the modern society, companies are actively using technology (materiality) to create visible changes that make people buy and sell things by intervening in the interaction process between consumers and emotional workers.

The materiality of service work is combined with intangible emotional work to finally produce a product called service, which is the source of business profit creation.

In fact, some companies are controlling the customer to have an eye contact as the basic, kneeling and providing services (PuppyDog Service).

As such, the capitalist system has commercialized human labor by drawing individual workers' personal feelings into the labor market.

The problem is that, unlike the manufacturing industry, despite the fact that the labor process must be autonomous and creative due to the nature of service labor, the social engineering of the emotional labor is standardized.

As reflected in this, companies make emotional workers seem to love their jobs through the instrumentation of emotions such as 'bright smiles'.

This suppresses other emotions that an individual can feel in order to show the emotions required by the company and prevents them from showing other emotions other than those required in the work.

Personnel etiquette is an important marketing strategy in industries where service is important.

Personnel etiquette is a structure that compels emotional labor while conducting group or personal education and seminars for service workers.

Emotional labor refers to trying to express the emotional responses that organizations and seniors require or expect regardless of their actual mood.

It usually suppresses negative emotions such as irritation, anger, sadness, discomfort, and reveals positive emotions through smiles, compliant speeches, and gestures of consent.

'Expression management', which is often required in organizational life, and also 'expression performance' itself are emotional labor.

There is considerable emotional and mental exhaustion in the emotional work of making a false expression and avoiding false tee.

It is another 'shadow work' that is not only given the cost but also the work that must be handled in addition to the job in charge.

Experts point out that the behavior of emotional labor, in which workers control their own psychology and express emotions according to the organization's expression standards, is also referred to as 'commodification of human emotions'.

In many studies at home and abroad, it was found that excessive emotional work promoted emotional exhaustion by reducing stress and reduced job enthusiasm, immersion, and satisfaction.

Korean Patent Publication [10-2007-0093523] discloses an automatic advertisement device using a hologram.

Korean Patent Publication [10-2007-0093523] (Publication date: September 19, 2007)

Therefore, the present invention has been devised to solve the problems as described above, and the object of the present invention is to check the direction of movement of a person and to output hologram images and voices related to personnel and guidance based on this, to service workers. By supporting the role, it is to provide a hologram service device using human body detection that relieves emotional labor of service workers.

The objects of the embodiments of the present invention are not limited to the above-mentioned objects, and other objects not mentioned will be clearly understood by those skilled in the art from the following description. .

A hologram service device using human body detection according to an embodiment of the present invention for achieving the above object, the human body detection unit 100 for detecting a person; A hologram unit 200 for outputting hologram images and audio; And an artificial intelligence unit (900) that checks a person's movement direction based on information detected from the human body detection unit (100), and controls the output of the hologram unit (200) related to greetings and guidance based on the information. It is characterized by including.

In addition, the human body detection unit 100 is characterized in that it utilizes any one or a plurality of infrared sensors, ultrasonic sensors, radar sensors, biosensors and image sensors.

In addition, the human body detection unit 100 is characterized by including a plurality of human body sensor (PIR, Passive Infrated Sensor).

In addition, the artificial intelligence unit 900 controls the output of the hologram unit 200 based on the detection information of the human body sensor that detects a person, but detects the human body after the output of the hologram unit 200 Transitioning the sensor to the idle state, the waiting state is characterized in that it is possible to detect the human body again after a certain period of time, thereby controlling the frequency of the service.

In addition, the hologram unit 200 is characterized in that it outputs a hologram image in a real (real) hologram method or a pseudo (floating hologram) hologram method.

In addition, the artificial intelligence unit 900 is characterized by implementing artificial intelligence based on raspberry pi.

In addition, the hologram service device using the human body detection includes a voice input unit 300 that receives a voice question, and the artificial intelligence unit 900 converts the voice question into text to answer information and answers about the voice question. It is characterized in that information is stored in a database, and a customized response to a customer's question is characterized by the information stored in the database.

In addition, the artificial intelligence unit 900 is characterized in that to record a voice question through the voice input unit 300 and send it to the voice recognition cloud to convert the voice question to text.

In addition, the artificial intelligence unit 900 analyzes the voice question input from the voice input unit 300 to control the hologram unit 200 so that the content corresponding to the answer (question response) to the voice question is output. It is characterized by.

In addition, the artificial intelligence unit 900 checks whether the voice question converted to text is a pre-defined question, and if there is no information for a predefined answer, utilizes general-purpose cloud voice service information to reproduce it through a speaker. It is characterized by.

According to the hologram service device using the human body detection according to an embodiment of the present invention, by confirming the direction of movement of a person, and outputting hologram images and voices related to personnel and guidance based on this, assist the role of service workers, It has the effect of reducing emotional labor of service workers.

In addition, the specific gravity of the space is small, there is an effect that can focus attention using a hologram.

In addition, by confirming the movement direction of the person by using a plurality of human body sensor, there is an effect that can minimize the cost invested in the sensor required to confirm the movement direction of the person.

In addition, by shifting the human body sensor to the standby state after the output of the hologram unit, there is an effect that can limit the generation of movement information of the wrong customer.

In addition, by implementing a Raspberry Pi-based artificial intelligence, there is an effect of minimizing the cost required to implement artificial intelligence and securing compatibility.

In addition, information about voice questions and answers is stored in a database, and based on this, customized responses to customer questions are provided, thereby providing services for basic customer interaction, thereby reducing emotional labor of service workers. Giving effect.

In addition, by recording through the voice input unit and sending it to the voice recognition cloud to convert the voice question to text, there is an effect that can reduce the cost by omitting the function necessary to convert the voice to text.

In addition, by analyzing the voice question and controlling the hologram so that the content corresponding to the answer to the voice question (question and answer) is output, the hologram image and voice are synchronized to produce a more natural situation.

In addition, if there is no information on a predefined answer, it is possible to use a general-purpose cloud voice service information to play it through a speaker, thereby enabling a more flexible response even in a situation where there is no information on a predefined answer.

1 is a conceptual diagram of a hologram service device using human body detection according to an embodiment of the present invention.
Figure 2 is an exemplary diagram of a state diagram for confirming the direction of movement of the customer using two human sensor.

The present invention can be applied to various changes and can have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

When an element is said to be "connected" or "connected" to another component, it is understood that other components may be directly connected to or connected to the other component, but there may be other components in between. It should be.

On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

The terms used in this specification are only used to describe specific embodiments and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, terms such as “include” or “have” are intended to indicate the presence of features, numbers, processes, operations, components, parts, or combinations thereof described in the specification, but one or more other features. It should be understood that the existence or addition possibilities of fields or numbers, processes, operations, components, parts or combinations thereof are not excluded in advance.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person skilled in the art to which the present invention pertains. Terms such as those defined in a commonly used dictionary should be interpreted as having meanings consistent with meanings in the context of related technologies, and should not be interpreted as ideal or excessively formal meanings unless explicitly defined in the present application. Does not.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings. Prior to this, the terms or words used in the present specification and claims should not be interpreted as being limited to ordinary or dictionary meanings, and the inventor appropriately explains the concept of terms in order to explain his or her invention in the best way. Based on the principle of being able to be defined, it should be interpreted as meaning and concept consistent with the technical idea of the present invention. In addition, unless there are other definitions in the technical terms and scientific terms used, those skilled in the art to which the present invention pertains have the meanings commonly understood, and the subject matter of the present invention in the following description and the accompanying drawings. Descriptions of well-known functions and configurations that may be obscured are omitted. The drawings introduced below are provided as examples in order to sufficiently convey the spirit of the present invention to those skilled in the art. Accordingly, the present invention is not limited to the drawings presented below and may be embodied in other forms. In addition, the same reference numbers throughout the specification indicate the same components. It should be noted that the same components in the drawings are indicated by the same reference numerals wherever possible.

1 is a conceptual diagram of a hologram service device using human body detection according to an embodiment of the present invention, and FIG. 2 is an exemplary diagram of a state diagram for confirming a moving direction of a customer using two human body detection sensors.

As shown in FIG. 1, the hologram service apparatus using human body detection according to an embodiment of the present invention includes a human body detection unit 100, a hologram unit 200, and an artificial intelligence unit 900.

The communication between the human body detection unit 100, the hologram unit 200, and the artificial intelligence unit 900 may be implemented by wired or wireless communication.

The human body detection unit 100 detects a person.

The human body detection unit 100 detects a person using a sensor, and may use a sensor that directly detects a person based on an image, but uses a sensor capable of indirectly detecting a person, such as a pressure sensor and a doorway sensor. Of course, it is possible.

The hologram unit 200 outputs a hologram image and audio.

The hologram unit 200 may output only a hologram image, output only a voice, or simultaneously output a hologram image and audio.

Holographic images can be implemented in various ways, such as projectors, 3D LEDs, pyramids, and stereos, depending on the installation location or space.

The artificial intelligence unit 900 checks the movement direction of the person based on the information detected from the human body detection unit 100, and controls the output of the hologram unit 200 related to greetings and guidance based on this.

The artificial intelligence unit 900 checks the movement direction of the person and controls the hologram image and audio related to the corresponding greeting and guidance to be output according to the movement direction of the person.

At this time, to check the movement direction of the person, it is also possible to use one sensor if one of the sensors used in the human body detection unit 100 can confirm the movement direction of the person, but it is also possible to use multiple sensors if multiple sensors are required It is possible.

The human body detection unit 100 of the hologram service device using human body detection according to an embodiment of the present invention is characterized by utilizing any one or a plurality of infrared sensors, ultrasonic sensors, radar sensors, biosensors and image sensors can do.

An ultrasonic sensor is a sensor that detects distance, thickness, and motion by using the characteristics of ultrasonic waves or by generating ultrasonic waves. It is an ultrasonic sensor used to perceive objects and measure distance. In particular, when a piezoelectric element of a material having a specific crystal structure and a high voltage pulse are applied, there is an electrostatic effect method in which vibration is generated by electrostatic attraction.

The ultrasonic sensor is a sensor that detects the sound in the air, and usually measures the time until the ultrasonic pulse emitted from the ultrasonic sensor is reflected from the surface of the object to be measured and returned to the ultrasonic sensor. Method.

Infrared sensor is a device that detects physical quantity and chemical quantity such as temperature, pressure, and intensity of radiation using infrared light and converts it into electricity capable of signal processing.It detects that the machine emits infrared light and blocks it. Some detect infrared rays.

The commonly used Passive Infrated Sensor uses a super-infrared sensor that detects the infrared wavelengths emitted by the human body, and converts the detected infrared light into heat, so when detecting the human body, a filter that passes only a specific wavelength band is used. .

A biosensor is a device that examines the properties of a substance in a living organism. It is a type of chemical sensor that converts signals from biochemical reactions into useful signals that can be recognized, such as color, fluorescence, and electrical signals, by using or imitating biological elements when obtaining information from measurement objects.

The image sensor is a device or electronic component that detects subject information and converts it into an electric image signal, and can be largely divided into an image sensor and a solid image sensor. And beacon, plum beacon, metal oxide semiconductor (MOS), and charge-coupled device (CCD).

The image sensor has a CCD image sensor and a CMOS image sensor, but recently, as low power and high integration are required, the weight of the CMOS image sensor is gradually increasing.

CCD is an abbreviation of Charge Coupled Device and is called a charge-coupled device. A CCD is a semiconductor device that can transmit a signal of a minority carrier injected into a semiconductor as a single charge and transmit it in a direction parallel to the crystal surface by an external voltage.

A large number of photodiode elements are integrated in a CCD, and when light is shined there, electrons are generated according to the amount of light, and images (images) are generated according to the amount of generated electrons. There are various types of CCD image sensors, such as dimensions and image quality, and are widely used in digital cameras, scanners, mobile phones, automobiles, and missile sensors.

The larger the CCD, the better, in order to obtain a good quality image (image).

The principle of the CMOS image sensor was invented in the late 1960s, but it has been put into practical use since the 1990s, when micro-machining technology was advanced. As the high resolution of image sensor technology in the late 2000s progresses, BSI (back side illumination) process technology and 3D stacking sensor manufacturing process technology are emerging.

Each unit cell has an amplifier and has the characteristic of generating less electrical noise by reading the light-converted electrical signal.

Since mass production is possible with the application of the CMOS logic LSI manufacturing processor, it has the advantage of low manufacturing cost and low power consumption as compared to a CCD image sensor having a high voltage analog circuit.

In addition, the logic circuit was manufactured in the same process, and the image processing circuit was turned on-chip to be applied to image recognition devices and artificial vision devices, and some of them were commercialized. For this reason, it is sometimes called an artificial retina chip.

The human body detection unit 100 of the hologram service device using the human body detection according to an embodiment of the present invention may include a plurality of human body sensor (PIR, Passive Infrated Sensor).

The human body sensor (PIR, Passive Infrated Sensor) is a passive infrared sensor that detects human movement (motion) through infrared rays. It is a High (1) signal when there is a change in infrared (light) within the detection angle range. Is a sensor that outputs a Low (0) value when there is none.

That is, it is a sensor that senses whether there is movement (motion) by sensing infrared rays emitted from a human body.

In other words, the human body sensor is a sensor that receives infrared rays. It is a sensor that detects an object with a certain amount of infrared rays. If an object with a certain amount of infrared rays moves, it detects it and outputs it. .

Explaining the principle of operation of the human body sensor, the human body emits infrared rays of about 9 μm to 11 μm, and the emitted infrared light passes through the Fresnel Lens, the condensing lens, and reaches the window located on the surface of the sensor. This infrared signal is output as a voltage and transmitted to an amplifier built into the sensor. Finally, a high (1) signal is output when there is a change in infrared (light), and a low (0) value is output.

Fresnel Lens is a condensing lens that passes infrared rays generated from the human body and collects infrared rays in a window located on the surface of the sensor. In addition, it increases the sensing distance and maximizes the sensitivity and protects the sensor from external environmental factors.

When the cap-shaped Fresnel Lens is separated from the human body sensor, there is a small window, which is a kind of rectangular polarizing filter on the surface.

Window is a very important part of the human body sensor because it serves to pass only infrared rays in a certain frequency band.

Each of the plurality of human body sensors may independently detect a person and provide information to the artificial intelligence unit 900 using wireless communication such as Wi-Fi, and the artificial intelligence unit 900 may receive information from each sensor. It can be managed as a state to check the direction of movement of a person.

The artificial intelligence unit 900 of the hologram service device using the human body detection according to an embodiment of the present invention controls the output of the hologram unit 200 based on the detection information of the human body sensor that detects a person, but the hologram unit ( After the output of 200), the human body sensor that senses the person transitions to the idle state, and the waiting state is to be detected again after a certain period of time, so that the human body can be detected again to control the frequency of the service. Can be.

2 is a state diagram for confirming the moving direction of the customer using a plurality of human body sensor. The state diagram is only described for two sensors, and may vary depending on the number of human sensor.

Assuming that the information detected by the human body sensor A becomes State A, and the information detected by the human body sensor B becomes State B,

State A may transition to state B or another state.

When the transition from state A to state B occurs, or when the transition from state B to state A is confirmed, the direction of movement of the customer can be detected.

When a transition occurs, an appropriate voice service is possible, and after the voice service, transition to an idle state can be performed to detect delay.

That is, after a certain period of time has passed in the standby state, the state transitions to state A or state B. In state A or state B, the human body sensing function is activated to control the frequency of service.

In other words, it is possible to limit the generation of incorrect customer movement information by setting a limited time for transitioning from state A or state B to other states.

The hologram 200 of the hologram service device using human body detection according to an embodiment of the present invention is a hologram in a real hologram method using a laser or the like, or a pseudo, floating hologram hologram method using an LED, a projector, etc. It may be characterized by outputting an image.

Holography (holography) refers to a technique for recording and reproducing stereoscopic information using an interference phenomenon of light generated by two laser beams meeting each other. A hologram is a three-dimensional image created by the technology.

As a source of holography, laser light is generally used. That's because lasers are the only coherent light source humans can produce at this time. A state in which the spatial spread of waves is uniform and the phase is regular is called coherent.

Coherent light refers to a wave in which the wavelength (frequency) and phase of light are very arranged. When a stone is thrown into a quiet surface, it is like a wave spreading on the surface. On the other hand, the light of the sun, fluorescent lamp, and incandescent lamp is irregular and not coherent. It's like a wave when you throw a lot of stones at the surface. Coherent waves could be easily made with sound waves or radio waves, but in the realm of light, lasers were not realized until the invention.

If there is an object on the path of the same wave, the wave is reflected off the surface of the object and meets the original light to create an interference fringe. The pattern of this interference fringe is determined by the distance from the surface of the object. In other words, the object information is recorded on the interference fringe. So, if the photo film is placed in a suitable place and exposed, interference fringes are recorded on the film surface.

No image of the object is visible on the developed film. If coherent light (reference light) or ordinary white light is passed at the same angle, the same pattern is reproduced by diffraction of the interference pattern on the film. When you see this through a film, you can see a three-dimensional image of the object. Such a film is called a hologram.

Even if the hologram is divided into several pieces, the entire image can be reproduced in each piece. The smaller the pieces, the more faint the image.

The same phenomenon occurs in sound waves and radio waves if the same para. Research is also being conducted using coherent ultrasound to measure the shape of objects in turbid water.

The types of holograms can be largely divided into analog holograms, which are photographs that take objects as stereoscopic images, digital holograms that digitally reproduce light reflected by objects, super-multi-view stereoscopic images, and semi-transmissive screen projection images. .

The pseudo-hologram is not actually a hologram, but rather a gimmick, so it is not technically considered a hologram, but it is included in the category of hologram in applications such as entertainment. In other words, pseudo-hologram is a classification in the industrial field, which is different from the original definition.

Pseudo-holograms are those that are said to be holograms in the public and media, but not strictly holograms using holography.

Typical examples include Pepper's Ghost, stereoscopy, and autostereoscopy.

Pepper's Ghost is often called the floating hologram in the media, a popular method for VOCALOID concerts, including Michael Jackson or Tupac's post-live performances, Hatsune Miku and more. This includes square pyramid holograms (inverted glass pyramids).

Peppers Ghost is a method created by reflecting images on a half mirror (half mirror) that has been used since the 18th century theater stage, and it is the same principle that when you look at the night view outside the window, you are superimposed on the night view.

Stereoscopy is often referred to as the stereoscopy of 3D display principles such as 3D movies or 3D TVs that we see in movie theaters. It gives a three-dimensional effect by wearing glasses made up of two polarized lenses that shoot two differently polarized light from one TV screen and cancel the two light respectively. Just an optical illusion. It is not a hologram, only the same front is seen from any angle.

Augmented reality should be viewed as an upgraded way of Peppers Ghost and Stereoscope. The name of Microsoft Hologram is a compound word of hologram and lens, but it is just augmented reality plus HMD.

Autostereoscopy is a 3D display method that does not require glasses. There is a Magic Eye, and the parallax barrier method used by the Nintendo 3DS is typical. Sometimes, when you look at something like a magic eye that has been sculpted on a bookshelf or a postcard, there are people called holograms. It's lenticular.

In addition, when a 3D display is constructed through a light source that adjusts the amount, distance, angle, etc. of shooting or dropping, such as water or beads, or installs or rotates three-dimensionally in advance, it is called a volumetric display.

In the case of Kino-mo's Hypervsn hologram (3D LED type), a propeller with LED is rotated at a very high speed, and a hologram using a residual image is also used.

Recently, a 3D display method using a phenomenon in which air is plasmaized by focusing a laser beam in the atmosphere has been developed mainly in Japan. It has the advantage of high degree of freedom, but since the color is inevitably dependent on the atmosphere, the blue color is only white solid color, and it is a method of burning air. Or toxic gases may be produced.

'Holograms', which are often found in Star Wars and other science fiction movies and games, refer to these autostereoscopy.

The artificial intelligence unit 900 of the hologram service device using human body detection according to an embodiment of the present invention may be characterized by implementing artificial intelligence based on a raspberry pie.

The Raspberry Pi is a credit card-sized single board computer developed by the Raspberry Pi Foundation in England to promote education in basic computer science in schools and developing countries.

Raspberry Pi is characterized by excellent graphics performance and low cost.

The initial Raspberry Pi was equipped with a 700MHz processor and 256MB RAM in one USB port, and lacked wireless access.

The most recent version is a significant upgrade from this initial design. The Raspberry Pi 3 Model B comes with a 1.2GHz quad-core CPU, Broadcom VideoCore IV graphics processor, 1GB RAM, microSD port, four USB ports, and Wi-Fi and Bluetooth.

You can also try a variety of production projects with a full-size HDMI port, Ethernet, and 40-pin GPIO header.

As shown in FIG. 1, the hologram service device using human body detection according to an embodiment of the present invention includes a voice input unit 300 that receives a voice question, and the artificial intelligence unit 900 recalls a voice question. It may be characterized in that the voice question is converted to text by recording through the voice input unit 300 and sending it to the voice recognition cloud.

The artificial intelligence unit 900 may record the customer's voice question through the voice input unit 300 (microphone, etc.) and send it to the voice recognition cloud to convert the customer's voice question into text.

At this time, the artificial intelligence unit 900 may check whether the text for the converted voice question is a predefined question, search for a predefined answer in the database, and output information about the answer.

When the information on the answer is text, the artificial intelligence unit 900 may find the file that converts the text on the answer into speech and output the information through the speaker so that the information on the answer can be informed to the customer.

The artificial intelligence unit 900 of the hologram service device using human body detection according to an embodiment of the present invention is characterized in that it converts the voice question into text and stores information on the voice question and information on the answer in a database. , It can be characterized by customized responses to customer questions based on information stored in the database.

In other words, information about the voice question that converts the voice question to text and information about the answer to the voice question can be stored in a database.

At this time, the information on the answer to the voice question may be stored as voice or may be stored as text.

In addition, the hologram image may be stored in a database so that the information on the answer to the voice question can be output together with the synchronized hologram image upon output.

The artificial intelligence unit 900 of the hologram service device using human body detection according to an embodiment of the present invention analyzes a voice question input from the voice input unit 300 and has a content corresponding to an answer to a voice question (answer of a question) The hologram unit 200 may be controlled to be output.

At this time, the artificial intelligence unit 900 parses the voice question, and after passing through the static word processing (filtering articles, etc.) and token generation processing (tense, plural unification, etc.), extracts a highly relevant keyword based on the frequency of appearance. Analyze questions.

Keyword refers to a word or symbol used to search for information containing specific content when searching for data, and extracts a keyword that can be used to match (search) the answer to the voice question from the voice question .

The keyword may be extracted in units of morphemes.

At this time, the artificial intelligence unit 900 may be characterized by extracting a word having a TF-IDF (Term Frequency-Inverse Document Frequency) value above a predetermined value as a keyword.

TF-IDF (Term Frequency-Inverse Document Frequency) is a weight used in information retrieval and text mining. It is a statistical value indicating how important a word is in a specific document when there are groups of documents composed of several documents. It can be used for extracting key words of a document, ranking search results in a search engine, or finding similar degrees between documents.

The term frequency (TF) is a value indicating how often a specific word appears in a document. The higher the value, the more important it can be considered in the document. However, if the word itself is often used within a group of documents, this means that the word is common. This is called DF (document frequency), and the inverse of this value is called IDF (inverse document frequency). TF-IDF is the product of TF and IDF.

The IDF value depends on the nature of the document group. For example, the word 'atomic' may not be used well among general documents, so the IDF value may increase and become a key word of the document, but in the case of a group of documents that contain documents about atoms, the word becomes a idiom, and each document Other words that can be subdivided can get high weight.

Also, the artificial intelligence unit 900 may analyze the voice question by adding a keyword's importance score to the keyword based on a TF-IDF (Term Frequency-Inverse Document Frequency) value.

In addition, if the keyword is an object that expresses the voice question well, the importance score is added high, and if the keyword represents the voice question, but the object is low, the importance score can be added low.

For example, if you want to search for content related to the construction of a smart grid security system, you can search using three keywords: 'smart grid', 'security', and 'build'.

At this time, 'smart grid' and 'security' may act as important keywords, and 'build' may act as auxiliary keywords.

Accordingly, if an object is extracted from the corresponding contents into three types of 'smart grid', 'security', and 'build', 100 points can be added to 'smart grid' and 'security' and 30 points to 'build'.

Here, the importance score may be characterized in that the more the number of searched by a specific search engine is set, the less.

This is because the more searched numbers are, the less discriminating power is.

For example, when searching across all academic information of the 'Naver' search engine (as of January 28, 2019), the number searched for 'Smart Grid' was 2506, and the number searched for 'Security' was 17402. Although the number of '990' searched was 92,990, the greater the number of searched, the lower the discrimination power.

The artificial intelligence unit 900 may be characterized in that the extracted keyword is used to understand the meaning of the context and analyze the voice question based on the meaning.

The keyword may be extracted in units of morphemes, and the original meaning of the characters of the keyword may be grasped based on parts of speech and meaning of words before and after the keyword.

For example, when you want to extract the word 'cheap' from the phrase 'best cheap ballpoint' as a keyword, the word 'cheap' means 'the cost of an item or a person or item is lower than usual' It is used in several other meanings, such as placing it inside, covering it invisibly, or hiding it, 'mainly a young child can't tolerate shit or urine', and 'speak well without keeping seriously.' At this time, if the meaning and part-of-speech of the word 'cheap' in front of the word 'cheap' and the word 'ballpoint pen' located in the back are understood, the word 'cheap' means' the cost of using an item or a person or item is more than usual It is used to mean 'it is low'.

The artificial intelligence unit 900 of the hologram service device using human body detection according to an embodiment of the present invention checks whether the voice question converted into text is a predefined question, and if there is no information on a predefined answer, a general purpose cloud The voice service information may be utilized to reproduce it through a speaker.

In other words, if there is no text file, voice file, etc. for the answer, search for general-purpose cloud voice service information with the keyword of the voice question converted to text, so that voice service information corresponding to the answer is output through the speaker.

At this time, if there is no voice service information corresponding to the answer, it is also possible to convert the text information corresponding to the answer into voice and output it through the speaker.

The artificial intelligence unit 900 of the hologram service device using the human body detection according to an embodiment of the present invention may be characterized by setting an environment and controlling differently according to the environment setting.

At this time, the environment setting may be characterized in that any one selected from the illuminance, time, date, season, gender of the detected person, estimated age range of the detected person, and the state of the detected person.

For example, the morning, lunch, and evening greetings may be set differently, a hologram and a voice of a gender different from the detected person's gender may be set to be output, and a hologram and a voice of a virtual person of an age similar to the detected person's age group. It can be set to output, or, if recognized as a question, a variety of implementations are possible, such as setting to output a hologram that listens to the question.

The artificial intelligence unit 900 of the hologram service device using human body detection according to an embodiment of the present invention may be characterized in that the user directly sets greetings, guide phrases, and question and answer.

That is, the user can directly input and modify information on greetings, guide phrases, and question and answer.

The present invention is not limited to the above-described embodiment, the scope of application is, of course, various modifications are possible without departing from the gist of the invention as claimed in the claims.

100: human body detection unit
200: hologram part
300: voice input unit
900: AI

Claims (10)

A human body sensing unit 100 that senses a person;
A hologram unit 200 for outputting a hologram image and audio; And
An artificial intelligence unit (900) that checks a person's movement direction based on the information detected from the human body detection unit (100), and controls the output of the hologram unit (200) related to greetings and guidance based on the information;
Hologram service device using a human body detection comprising a.
According to claim 1,
The human body detection unit 100
A hologram service device using human body detection, characterized in that one or a plurality of infrared sensors, ultrasonic sensors, radar sensors, biosensors, and image sensors are utilized.
According to claim 1,
The human body detection unit 100
Hologram service device using a human body detection including a plurality of human body sensor (PIR, Passive Infrated Sensor).
According to claim 3,
The artificial intelligence unit 900
The output of the hologram unit 200 is controlled based on the detection information of the human body sensor that detects a person,
After the output of the hologram unit 200, the human body sensor that senses the person transitions to the idle state, and the waiting state must be elapsed for a certain period of time to allow human body detection again to control the frequency of service. Hologram service device using the human body detection characterized by.
According to claim 1,
The hologram part 200 is
A hologram service device using human body detection, characterized in that a hologram image is output in a real or hologram method.
According to claim 1,
The artificial intelligence unit 900
Hologram service device using human body detection, characterized by implementing artificial intelligence based on Raspberry Pi.
According to claim 1,
The hologram service device using the human body detection
A voice input unit 300 that receives a voice question;
Including,
The artificial intelligence unit 900
And converting the voice question into text to store information about the voice question and information about the answer in a database,
A hologram service device using human body detection, characterized in that it provides a customized response to a customer's question based on information stored in a database.
The method of claim 7,
The artificial intelligence unit 900
A hologram service device using human body detection, characterized in that a voice question is recorded through the voice input unit 300 and transmitted to a voice recognition cloud to convert the voice question into text.
The method of claim 7,
The artificial intelligence unit 900
A hologram service apparatus using human body detection, characterized in that the hologram unit 200 is controlled to analyze the voice question input from the voice input unit 300 and output the content corresponding to the answer to the voice question (question answer) .
The method of claim 7,
The artificial intelligence unit 900
A hologram service device using human body detection, characterized in that the voice question converted into text is a predefined question, and if there is no information for a predefined answer, it is reproduced through a speaker by using general-purpose cloud voice service information. .

Images