JP2021100231A - Ai assistant in glasses and storage aid for image recognition function - Google Patents

Abstract

To provide a device that captures and stores daily activities using a camera in order to verify the forgetfulness caused by atrophied brain caused by the deterioration of a body and recall the memory.SOLUTION: In an AI assistant in glasses and a memory assist device of an image recognition function that keep recording and accumulating a daily activity of a person through a camera that captures the eyes, the memory assist device of an image recognition function accumulates and stores daily records, especially for actions that are necessary and must not be forgotten in daily life, video characters and sounds are embedded and overwritten in a part of the action motion video recorded and stored in advance. When the video captured by the camera is predicted and detected as an action that the AI assistant and the storage assist device of the image recognition function are likely to forget, the AI assistant prompts the action with a reproduced video, video characters, or an announcement.SELECTED DRAWING: Figure 1

Description

The present invention relates to a device that captures daily activities using a camera and stores memory in order to verify forgetfulness caused by the atrophied brain caused by physical deterioration and recall memory.

As we get older, our eyes weaken and our ears become deaf, and as we grow older, our memory deteriorates, and there are times during the day when we have ambiguous memories of our actions.

Also, as I get older, my obsession with things diminishes, and this symptom makes my memory of behavior worse.

These symptoms in humans are said to be related to the atrophy of the brain that everyone suffers from.

As I get older, when I look back on my daily activities, there are more and more uncertain times.

Nowadays, the society is rapidly becoming an elderly nuclear family society, and the number of elderly people living alone and households living only with elderly couples is increasing.

For this reason, when handling fire at elderly people's homes, the occurrence of fires due to accidental forgetting to extinguish the fire becomes noticeable, and many elderly people die from the fire every year.

Also, as we get older, we have more ambiguous memories. For example, when we go out, we should forget to lock the front door of the house and remember exactly what we forgot. It cannot be said that it is certain, and there are cases where the lock is reconfirmed by turning back.

When I'm on the go, I'm worried about whether or not the fire on the gas stove will be destroyed.

Because of this old age, accidental forgotten behavior caused by atrophy of the brain causes damage such as unexpected fires and traffic accidents.

Things that were used without any obstacles before may be confusing at the time of use, or the procedure for using them may become ambiguous, which may be troublesome and troublesome.

In addition, the number of traffic accidents due to old age is increasing, but these are thought to be due in part to the decline in cognitive ability to discern the situation and the atrophy of the brain associated with old age such as hearing, visual acuity, and visual field deterioration.

JP 2019-192209

In recent years, the occurrence of traffic accidents among the elderly has raised social problems, including oversight of stop road signs, reverse driving on highways, oversight of traffic lights, incorrect accelerator depression, and misplaced gears. Is said to be caused by erroneous behavior due to brain atrophy.

In a traffic accident caused by an elderly person, he should have seen the road sign but could not recognize it. Also, due to the weakening of his brain, the memory of his daily activities became ambiguous, and he became more forgetful and did not realize that he had forgotten. Sometimes I'm spending time.

For example, there are cases in which many elderly people have a bad memory of taking the medicine that they should take every day after being administered, but in these cases, the memory of the other behavior is remembered by acting differently at the same time. One of the phenomena that becomes ambiguous and is inadvertently forgotten is that the memory that appears with age is weakened. I will spend it.

In order to supplement the atrophic brain, the data accumulated using a storage device will be utilized in daily life using an artificial intelligence (AI) computer. In the future AI, deep learning (a function to repeat deep learning and learning) will be artificial intelligence. There is no doubt that it will be greatly involved in the development of AI, and the more image data of daily activities accumulated in the past, the more accurate and excellent it is possible to determine and classify what is reflected in the predicted image. According to the present invention, the data information required by AI is stored in the video information of the camera that records one's daily activities, and the enormous amount of image data in the storage device is stored. Deep learning predicts behavior from this data, determines what is in the video information image captured by the camera that is currently capturing the eyes, etc., and classifies the behavior so that AI is likely to make a mistake more accurately, It predicts actions that are likely to be forgotten in advance so that the AI assistant can announce them and encourage appropriate actions.

People see what they see and remember it in their brains, but as they get older, their bodies become weaker, with glasses for their eyesight, hearing aids for their hearing, and electric power for their feet. Like using a wheelchair, in order to supplement the weakened memory, the camera or microphone captures the image reflected in the eyes instead of the eyes, and the captured video information is stored in the memory assist device instead of the weakened brain to assist the brain. It is used as a storage device, and by using an AI assistant that AI learns and analyzes the stored daily action video information, and a memory assist device with an image recognition function, you can make good use of AI even in old age and live your life. It is used as food for self-reliance. For example, when you are doing different work at the same time, if you inadvertently forget the other work behavior and fall into what you did, ask the AI assistant, the memory assist device of the image recognition function, and your own behavior. By reproducing the video and instructing rewinding etc., it is possible to trace back to the ambiguous work behavior that was started and reconfirm the behavior of the own video, which is used as a device to recall the memory, a familiar thing that has rapidly developed in recent years It is an AI assistant in the glasses and a memory assist device with an image recognition function that can be demonstrated by utilizing the AI that has become.

The present invention stores and stores daily records in an AI assistant in the glasses and a memory assist device with an image recognition function through a camera that captures the daily activities of a person, and forgets that it is necessary especially for daily life. For actions that should not be done, video characters and sounds are embedded and overwritten in a part of the action motion video recorded and stored in advance, and the AI assistant and the memory assist device of the image recognition function are likely to forget the video captured by the camera. When the AI assistant senses the prediction as an action, the AI assistant encourages the action with a reproduced video, video text, or an announcement.

By storing in advance the actions that are likely to be forgotten by the AI assistant and the memory assist device of the image recognition function, it is announced that the actions captured by the camera will be predicted, predicted, and detected by the AI. The AI assistant in the glasses of the present invention, which can prevent things that are forgotten to be prompted, missed hearings, misunderstandings, etc., can assist and assist the memory of the weakened brain like glasses, hearing aids, electric wheelchairs, etc. By utilizing this AI device as a memory assist device, it is a device that enables an independent life without relying on a caregiver even in old age.

In addition, by recording and accumulating daily behavior information on a daily basis, it is possible to trace back the ambiguous memory of one's past events and reconfirm one's own behavior with a video, which is a preventive effect to prevent deterioration of memory. It also leads to.

A front perspective view showing that each member is provided in the spectacles by the AI assistant in the spectacles and the storage assist device of the image recognition function. A perspective view from below showing that each member is provided in the spectacles by the spectacle memory assist device. A perspective view of a situation in which a spectacle memory assist device is attached. A perspective view of a situation in which a spectacle memory assist device is attached. An overall perspective view of a camera and projector on the spectacle frame that reflects what the eyes are looking at. A perspective view of the situation where a projector and a camera are installed on the forehead. A chart diagram that describes the action procedure for recalling memories such as ambiguity. A chart diagram showing that actions that follow the schedule encourage forgotten actions. A perspective view of the AI assistant in the glasses and the storage assist device for the image recognition function. A smartphone that can share the video information captured by the camera with each other. A tablet that allows mutual sharing of video information captured by the camera. A perspective view of goggles equipped with an AI assistant and a storage assist device for image recognition.

FIG. 1 is an overall perspective view of the storage assisting device in the spectacles of the present invention, which is a front view. The spectacle frame comprises an AI assistant in the spectacles in the spectacles of the present invention and a storage assisting device for an image recognition function. It is the figure which showed that each member provided.

Each member attached to the eyeglasses constructed of the present invention will be described, but the mounting position and the appearance of the constructed member may not necessarily be the same as those in the drawing, but may be slightly different, but the mounting and installation may be performed at a position satisfying the requirements. If there is, it does not necessarily have to be as shown in the drawings, and may have the same configuration of the present invention and may be worn on the head, worn on the upper body, worn on the ears, the collar of clothes, or the like.

AI assistant in the glasses, memory assist device code 5 for image recognition function are provided in the center of the glasses in Fig. 1, camera code 1 to supplement the field of view at both ends, camera code 1-1 to capture the eyes on both ends of the lens surface, earphones that transmit sound. Code 2, speaker 2-1 and microphone code 3, display code 4 and 4-1 at the bottom of both spectacle lenses, projector code 8 at the center of the spectacle, and transmitter / receiver code 6 for transmitting and receiving information are mounted in the spectacle frame code 7. The AI assistant in the eyephone of the present invention, which is a storage assist device for the image recognition function, and display codes 4 and 4-1 are display codes 4 and 4-1 that separately display images and moving images obtained from different information. In addition, the projector code 8 that projects information moving images on the ground or wall, the screen in front of you, an object, or a flat surface is also a projector that can project different information at the same time and separately.

AI assistant in the glasses in the center of the glasses, memory assist device with image recognition function The AI assistant with code 5 is an AI assistant with an image recognition function, which searches for images and videos that have been image-recognized by voice questions and asks voice. AI deep learning can determine and classify what is reflected in the predicted image as the amount of daily action video image data increases, and promotes excellent actions, but every day. The more the video information of the camera that records one's daily activities is stored in the memory assist device, and the more information there is, the more accurate the AI assistant encourages. It is a device used to supplement capacity reinforcement.

An AI assistant and a storage aid for image recognition are provided in the center of the eyeglasses, but they may be installed outside the eyeglass frame, and the camera's eyes are taken to an external storage device such as a smartphone, tablet, or computer that can be shared with each other. It may be used as a storage device for video information.

Alternatively, an AI assistant or a storage assist device having an image recognition function may be provided on the neck collar, a bandana wrapped around the forehead, or the like.

By providing the AI assistant function in the glasses, the AI assistant has the feature that it is easy to pick up the voice, but when sharing with an external storage device, smartphone, tablet, computer, transmission and reception in the glasses that can be sent and received via the microphone code 3 The device code 6 is used, and the transmitter / receiver code 6 is provided on the frame inside the spectacles.

The eyes are tired, the eyelids hang down, the field of view is narrowed, the image reflected in the eyes is narrowed, and the image captured by camera code 1-1 that captures the eyes is also narrowed.

The width of the image reflected in the pupil is narrow and the movement of the eyes is neglected, and the image captured by the camera that captures the pupil is also narrow.

Camera code 1 is provided on both sides of the eyeglasses to supplement the field of view, but if the eyes are tired and the eyelids are lowered, the eyelids are blinking, or the movement of the eyes is neglected, the field of view is changed from the camera code 1-1 that captures the eyes. It is the camera code 1 that the AI assistant image recognition function can recognize and switch to the camera code 1 to be secured.

People casually stare at things, but when the brain consciously stares at things, they look at the length of the image reflected in their eyes, blinking and looking closely.

In the case of people who meet for the first time, what they see for the first time, what they experience for the first time, behaviors that involve danger, etc., there are many blinks that they stare strongly without knowing what they see, and the pupils of their eyes become larger. The frequency also increases.

The camera code 1-1 for capturing the pupil of the present invention is a camera for capturing the pupil in order to consciously stare at the image and capture the image reflected in the pupil as an image recording particularly necessary for memory.

The AI assistant image recognition function recognizes the time to stare while blinking, the size of the pupil of the pupil, and the frequency of staring, and the AI later determines it as a particularly necessary action video image and stores it in the storage assist device.

By selecting as the above-mentioned particularly necessary video, AI can quickly select and call only the necessary video information from the huge amount of video information in which daily behaviors and actions are accumulated.

The present invention is different from the conventional camera held in the hand or attached to the head or the like to photograph and continuously record the behavior of oneself, and the photographing method and means are different.

The camera code 1-1 that captures the pupil can capture the image reflected in the pupil and the capillaries of the retina, and records and accumulates videos of daily activities, and also captures and records the capillaries of the individual's retina. Also, by recording the pattern of the capillaries of the retina captured by the camera that captures the eyes, the video information proves to be an individual's thing, and the video information of the behavior obtained every day is captured by the individual. Capillaries are called eye prints, and the capillaries of blood supplied to the retina have a complicated structure. It has a different pattern for each individual and is used to identify the same individual as the retina.

Display codes 4 and 4-1 are provided at the bottom of the lens of the spectacles. Display codes 4 and 4-1 are displays that display an image captured by the camera code 1-1 that normally captures the pupil.

The left display code 4 is a display code 4 that displays a still image or video to be searched for ambiguous objects captured by the camera, and the right display code 4-1 is a display code 4 that displays a video or still image searched by the AI assistant. Display code 4-1 is provided so that comparisons can be easily made by displaying separate images on the left and right displays.

The projector code 8 is provided in the center of the spectacles, but it does not necessarily have to be in the center of the spectacles, but it may be provided anywhere in the spectacle frame, such as a bandana wrapped around the forehead. The position and the like do not matter, and it does not have to be a spectacle frame. For example, it may be projected on a display such as a smartphone display or a tablet display personal computer for viewing.

The projector code 8 has the same function as the display described above, and it is sufficient that the image display surface to be searched and the moving image display surface to be searched can be displayed on the screen together.

The transmitter / receiver code 6 is used to transfer and record video recording information to an external storage device, a smartphone, a tablet, a personal computer, a cloud computer, etc. when the storage capacity of the AI assistant or the storage assist device of the image recognition function increases. It is a transmitter / receiver used for.

In addition, there is a transmitter / receiver code 6 capable of transmitting moving image information obtained from the camera to an AI assistant provided outside the spectacle frame and a storage assist device having an image recognition function.

If you think that you will need it at a later date due to people, things, places, etc. that you are particularly interested in captured by the camera, you can easily search with the AI assistant by saying words etc., and smartphones and tablets that share this video information with each other , It is a transmission / reception device used so that the AI assistant can be instructed to send and store by asking a personal computer or the like, and the AI assistant can be instructed to send and instruct the external storage device that shares the processed video stored in the storage assist device described above. It is a communication device.

It is a transmitter / receiver used by AI assistants to search the Internet through an external terminal in order to obtain more detailed information on what is shown on the video screen of the display captured by the camera.

In addition, it is a transmission / reception device that can receive information images from a personal computer smartphone or the like shared on the Internet or externally at any time.

It is assumed that the transmitter / receiver can receive information from external media, but if it receives an emergency broadcast announcement such as an earthquake or flood, it can be obtained with earphone code 2 and speaker code 2-1 in the glasses. is there.

People have a brain mechanism in which the older the memory of the past, the more ambiguous the memory is, and as a person's wisdom, some people keep a diary of the events of the day and keep a record, but it is reasonable to trace the memory. It works, but it's almost impossible to get back to the details of what happened on the day.

It is said that the reason why memory fades and becomes ambiguous as time goes by is to avoid the limit of the amount of memory of the brain to remember, and to protect the body of the brain, which shrinks with time. In the invention, in order to compensate for the deterioration of memory due to the atrophy of the brain that everyone faces, the information obtained from the camera in daily activities is used as an AI assistant in the glasses, a memory assist device for image recognition function, and an external device. It is a storage device for its own electronic dictionary that records, stores, and stores the experience information obtained in daily activities so that it can be shared with each other on smartphones, tablets, and personal computers.

It is characterized by recording and accumulating information taken by the camera of daily actions, and the necessary action information is stored in the storage auxiliary device and asked to the AI assistant to retroactively reproduce and utilize the actions of oneself. AI assistant in the glasses, image recognition function invented for the purpose of being able to easily reproduce the behavior of the day when it is needed by going back to the time of the required age even if it gets older and older. However, when the storage memory capacity of the storage auxiliary device is limited, transfer recording can be performed in an external memory such as a cloud or a computer.

In addition, it will be possible to transfer and memorize it to an external storage device that is shared with each other, and talk to the AI assistant about the past daily action videos required by smartphones, tablets, computers, etc. and reproduce them on the display or projector. It is an AI assistant in the glasses and a memory assist device for the image recognition function.

A GPS position information system is added to the image information captured by the camera, and the position and time information of the video information obtained by the action is shared with smartphones, tablets, personal computers, etc., and the action information is recorded and stored. You can watch the reproduced video on the tablet display.

The AI assistant in the spectacles of the present invention and the spectacles of the memory assist device of the image recognition function are worn to lead a daily life, but it is related to people and things that must not be forgotten in daily life. Information such as usage, etc., is spoken to the AI assistant as a necessary action, and it is stored in the AI assistant in the glasses and the memory assist device of the image recognition function.

In addition, because we have forgotten to distinguish the actions that should not be forgotten in the actions of the day, we rank the risks that the actions cause and the risks that increase with the passage of time, talk to the AI assistant and memorize them, and the camera If the AI assistant searches for a rank level that seems to be dangerous based on the behavior detected by the AI assistant and determines that it is dangerous, the AI assistant in the glasses that prompts attention or warnings according to the rank level of the danger, and the memory assistance of the image recognition function It is a device.

I spend my daily life wearing the AI assistant in the glasses of the present invention and the glasses of the memory assist device of the image recognition function, but the action video captured by the camera stores the video information such as the GPS position information time, and the memory is stored. In order to recall the memory of the vague and faint time zone, I specified a rough time and place and talked to the AI assistant about the video of my own action stored in the memory assist device and called the action video and reproduced myself. AI assistant in the glasses used to recall the memory that became ambiguous by seeing the action Memory assist device of the image recognition function Although it is a memory, the more information that is obtained by accumulating daily action images, the more AI analyzes it. The predictions and results that are learned and derived will be excellent, and daily action video information will be recorded and accumulated in detail in order to predict forgetfulness with the information obtained from daily actions with a camera and to use it as information that encourages decisions on risk prediction prevention. It is a thing.

If you forget how to use the previously used memory aid from the daily storage aids and the usage is ambiguous, talk to the AI assistant based on the recorded conversational words and use it in the past. It is possible to recall the reproduced video that is being used, and by watching the reference video that the AI assistant searched and displayed from other media and storage media, etc., it can be used to recall the usage and memory when used. It is an AI assistant in the glasses that can be used, and a memory assist device with an image recognition function.

Also, if you do not know the name of the thing you saw for the first time or how to use the thing, you can watch the video information searched and displayed via the smartphone, tablet, PC, Internet, etc. shared by the AI assistant. It is an AI assistant in the glasses and a storage aid for the image recognition function.

I use the AI assistant in the glasses and the glasses of the memory assist device of the image recognition function on a daily basis, but sometimes there are behaviors that I have inadvertently forgotten in my daily life, and a video of the behaviors recorded during the time period that needs confirmation is See Fig. 8, which is a memory assist device for the AI assistant image recognition function in the glasses that allows you to search for videos of your own actions by talking to the AI assistant based on time.

The camera captures the daily behavior of the person wearing the glasses, selects and distinguishes the necessary behavior patterns in the recorded video, and voice recognition that can extract a specific voice image in the distinguished video. See Fig. 7, which is a memory assist device for the AI assistant image recognition function in the glasses that allows the AI assistant to reproduce the embedded and required distinctive videos as a timetable reservation video that encourages action on a display or projector.

The confirmation of one's own behavioral memory, which is uneasy in one day's behavior, can be displayed as a playback video on a smartphone, tablet, computer, etc. shared by the display in the glasses or the projectors by asking a voice question. It is a memory assist device with an AI assistant image recognition function in the glasses that can recall lost memories by watching the video, and because there are things such as missing or accidentally forgetting, I wake up one morning and then go to bed Paste the above-mentioned processed motion video that encourages the time of action in the fixed time zone until, and obtain the pasted image or video from the video information of the camera that the pupil captures in the fixed time zone. If it cannot be done, the AI assistant image recognition function recognizes it as a forgotten action, and the AI assistant announces it on a smartphone, tablet, computer, etc. and encourages the action. 10.11.

Due to old age, the image reflected in the eyes is narrowed due to the drooping eyelids, and the image field captured by the camera that captures the eyes is narrow. If AI detects an image in which the eyelids blink or the movement of the eyes is neglected when the camera that captures the eyes captures the image reflected in the eyes, AI assistant image recognition is an action that makes it easy to overlook things due to eye fatigue. When the memory assist device of the AI assistant image recognition function recognizes the negligent movement of the eyes by letting the function memorize it, the AI assistant speaks as an action that is easy to forget and calls attention, and the field of view is viewed from the camera that captures the eyes. See Figures 1 to 6.9, which are memory aids for the AI assistant image recognition function in the eyeglasses that can be switched to a supplementary camera.

Two displays in the glasses that reproduce the image can display still images and videos captured by the camera on one side, and the stored images and videos can be displayed on the other display. See Figure 1.9, which is an in-glass memory assist device with two displays inside the eyeglasses.

The object projected by the camera is not recorded in the storage assist device of the AI assistant image recognition function in the glasses, and it is shared on the smartphone, tablet, personal computer, internet based on the still image or video of the image information displayed on the left display. The information image and video obtained by searching with the AI assistant image recognition function can be displayed on the right display.

As a display for comparison and verification, search images, videos, materials, etc. derived by the AI assistant image recognition function are displayed on the right display, and information videos and images are displayed separately on the left and right in situations where advance notice display action images, etc. are required. AI assistant in the glasses that can be used separately as a display It is a storage assist device for the image recognition function. If it is a display that can display the required images separately, it does not necessarily have to be a display in the glasses. A display, a tablet display, a personal computer display, or the like may be used.

In the embodiment, the AI assistant image in the glasses The AI assistant image in the glasses is used as a reference by talking to the AI assistant about the stored memory action video that records the daily activities of the memory assist device of the memory recognition function with the camera. Describe the use example of the memory assist device of the recognition function, and describe how to obtain and use the information that is needed now from the past action record.

For example, the number of people who participated in the event to be held in the future, the list of participants, etc. In order to refer to the event to be held in the future, the past behavior data is spoken to the AI assistant and called from the reproduced video. It will be described as an example of utilization of the storage assist device of the AI assistant image recognition function in the glasses of the present invention to obtain and utilize reference data.

The thing you are watching is reflected in your eyes. By capturing this image with your eyes, everything you are watching is stored in a storage aid, an external storage medium, a smartphone, a tablet, a personal computer, etc., along with the date, time, and place, and past events. Search by age and date and time when you did, but in order to narrow down the search, ask the AI assistant about the words that seemed to be in action at that time, the location of the conversation content, etc., and reproduce the video of the event on the day Then, guide the participants from the attendees and use them as a reference.

If you can understand the face of the participant but not the name, use it as a reference to recall the memory of the name etc. from the conversation etc. in the playback video.

Also, search and display the video that you should have seen in the playback video that is watching the participant list, make the video screen that is watching the list a still image, copy the list in the image, and hold it from now on. Paste it on the participation list for reference.

As mentioned above, by accumulating the information obtained by one's own actions in the storage device every day, even if the past accumulated information such as trivial past failure cases, success cases and experience records is accumulated over the years. It should be remembered in the brain as well, which can be reproduced clearly as a movie at any time, but unfortunately no one can remember it clearly.

The present invention is an electronic dictionary of one's own memory that oneself has acquired and accumulated through actions, which is used and utilized as a memory assisting device that replaces the human brain.

In the second embodiment, an example of utilizing the storage assist device of the AI assistant image recognition function in the glasses of the present invention used for suppressing an accident caused by forgetting an action required by a person will be described.

A video that is distinguished and memorized as an action that should not be inadvertently forgotten in daily life. The AI assistant announces the behaviors that cause troubles, the danger messages, and the behaviors that can be recovered, classified into three stages: caution messages.

At the time of acquiring a car license, I called the video I was watching to learn road signs etc. in a textbook, and while driving the image of the road sign I ranked and memorized the sign image as a warning message memory of high risk as a particularly necessary action record Keep it.

When the camera in the glasses detects a stop sign, the color of a traffic light, etc. while driving, the AI assistant promptly announces a warning or caution instruction by voice.

By recognizing and memorizing signs, it is possible to prevent accidents such as reverse-way driving on highways that could lead to accidents by inadvertently overlooking the signs.

An example of storing it as pre-memory information necessary for driving is described, but it is reflected in the eyes just by looking at the information materials required for action in advance, and the camera memorizes it in the storage assist device, but it is especially necessary at a later date. In the material, I will say it as a word that leads to the search of AI assistant.

Until now, people have learned by looking at textbooks and materials, and by writing and learning only the parts that they think are necessary many times in notebooks and notepads so that they will not forget what they see.

Just by wearing the glasses of the storage assist device of the AI assistant image recognition function in the glasses of the present invention and looking at the materials and textbooks, the camera captures the details in detail and the memory assist device memorizes them.

It is a memory assist device of the AI assistant image recognition function in the glasses of the present invention that can reduce the function of the brain that was written and learned for memorization and can utilize the function of the brain in other fields.

In Example 3, an example of a fire or the like is given as an example of an accident caused by distraction of attention as the elderly age, and an example used by the present invention to suppress the accident is given.

Sometimes I forget that I accidentally put the stove on the stove because I put a pot and a kettle on the stove in the kitchen and was distracted by other things.

This inadvertently forgotten behavior is that the ability to recognize and handle things at the same time is that the brain is atrophied and can not instruct the previous action, AI assistant image of this inadvertently forgotten stove. If the memory assist device of the recognition function does not show the image of the stove fire in the eyes for a certain period of time and the AI assistant image recognition function detects it, the AI assistant makes a warning announcement.

In the above-mentioned actions of performing multiple actions at the same time, the same mistakes are often repeated as the years go by.

In this way, in multiple work actions performed at the same time, voices instructing cautions, warnings, etc. are embedded in the stored video of action mistakes involving danger in the past, and caution is taken when similar actions are detected. It is a memory assist device in the glasses that is predicted to announce instructions and warnings, and a part of the accumulated past dangerous behavioral mistake videos is stored as a still image that made a mistake. It is a memory assist device of the AI assistant image recognition function in the glasses of the present invention equipped with a predictive prediction detection function for preventing and preventing the recurrence of behaviors that cause similar behavioral mistakes.

In Example 4, the utilization of the storage assist device in the spectacles of the present invention, which looks back on the behavior of inadvertently forgetting, will be described.

In recent years, when visiting for the first time, many large supermarkets with large parking lots are open in the suburbs, there are things that I can't remember after shopping at the place where I parked my car.

Based on the approximate time of entering the parking lot, ask the AI assistant of the memory assist device of the AI assistant image recognition function in the glasses, specify the search time zone, and show the video on the display or projector to enter the spar parking lot. See Fig. 8, which is a memory assist device in the glasses of the present invention that is used as a trigger to recall ambiguous memory by reproducing it. In this way, the camera that captures the image reflected in the pupil also has the GPS position information time and so on. Since it is remembered, in order to prevent the climber from getting lost and getting lost, if he / she enters the wrong route and becomes uneasy, ask the AI assistant and go back to the route that seems to have made a mistake and reproduce the action. It can be confirmed by doing so and can be used to prevent distress accidents in the mountains.

In Example 5, an example of utilizing the action record recorded in the storage assist device of the AI assistant image recognition function in the glasses of the present invention will be described.

Reflect it in the knowledge you need now based on the images of TV, dictionaries, etc. that you casually watched in the past.

For example, when climbing for the first time, you may come into contact with the flowers of alpine plant clusters that you see for the first time, but it is thought that you do not remember the names of the flowers because you do not have any experience.

This is a video of past actions recorded in the action, and I am watching alpine plants in the dictionary in the casual action, which lists TV auditions such as mountain climbing contributions and dictionaries of flowers and vegetables in the vegetable garden in casual actions. Flowers etc. may be recorded, but the person himself hardly remembers and remembers them, and they are stored in the memory assist device of the AI assistant image recognition function in the glasses.

As mentioned above, various information over the years is stored in the action videos recorded and accumulated every day.

This is a storage assist device for the AI assistant image recognition function in the glasses of the present invention, which asks the AI assistant to memorize the recorded moving images by asking the AI assistant for easy retrieval by classifying the recorded moving images into categories such as animals, plants, and people.

In the sixth embodiment, an example will be described in which the AI assistant calls and utilizes the reference moving image stored in the storage assist device in the glasses of the present invention in order to correspond to what is being seen now.

For example, you may have to try disassembling the item in order to repair the item that is broken and has become stagnant.

If the number of disassembled parts is small, it is easy to assemble, but there are dozens of disassembled parts and the repaired parts have been repaired, but there are processes in which the assembly procedure is ambiguous during assembly. ..

When assembling, if you make a mistake in the assembly procedure, it will be a serious problem that the original product will not be restored.

The work of disassembling an object is a work that can be disassembled relatively easily, but when reassembling the disassembled items in order, it is necessary to rely on memory.

When the storage assist device of the AI assistant image recognition function in the glasses of the present invention is used, the action from the time of disassembly is captured and recorded by the camera, and the work of disassembling, repairing, and assembling is also captured. The work up to the assembly operation is recorded.

A book that allows you to reconfirm the ambiguous assembly order by asking the AI assistant for the past disassembly process work video that was memorized in the assembly process that became ambiguous during assembly, recalling it, and reproducing and watching the action video at the time of disassembly. It is a memory assisting device of the AI assistant image recognition function in the glasses of the present invention.

When a person has the first experience of seeing something for the first time, the first action or experience is accompanied by trips and failures, and everyone grows with anxiety and failure.
In order to reduce or avoid this anxiety and failure, the AI assistant searches from the past accumulated and memorized action videos based on the story and conversation of the person who talked about the failure story and experience story of the predecessor. Use people's experiences and failures as reference videos for the first actions you are seeing.

Even if you remember that you have never actually acted, what you heard with your eyes or ears in the past is now called by the AI assistant as a reference for actual actions, and a reference for actions to avoid failure of the first action you are doing now. To.

A person is improved by repeatedly learning mistakes, and by accumulating that knowledge for many years, he / she has the ability to cope with living in various difficult situations. You can use the memories of your predecessors' failures and experiences that you have memorized for the actions that fall on you, and even if you have the first experience, you will be further memorized as your own actions that avoided failures, and the memory area of the brain for learning by repeating failures You will be able to use your brain to acquire other knowledge.

As described above, for example, the technical information that a skilled worker has gained through experience using the storage assist device of the AI assistant image recognition function in the glasses of the present invention is stored in the storage device in the glasses, and this technical information is copied. By doing so, it is possible to reproduce in detail, so even beginners can practice it as their own technology by using the technology in the same way based on this copied video.

A person may make the same mistake because the important memory of the failure fades, but when the memory assist device in the glasses of the present invention is used, it is pointed out that the camera predicts and detects the same behavior as the failed memory behavior. It is a memory assist device of the AI assistant image recognition function in the glasses of the present invention that can be avoided to be repeated.

In Example 8, information is extracted from each individual's memory and compared with each other to guide the behavior that seems to be optimal.

In order to avoid the crisis in front of us by acting in a small group of group actions, we call up information videos that can be used as reference from individual past memories with AI assistant, and project them on the screen, ground, wall, etc. with a projector, and individually. It will be used as a reference for actions to avoid a crisis, which is the best way to share opinions.

In this way, the behavioral information of the memory from each past is instantly called up as reference information and projected by the projector, and the projected past experience information video and the information seen and heard are compared to examine and utilize the optimum behavior. It is a storage assist device of the AI assistant image recognition function in the glasses of the present invention.

In the ninth embodiment, an embodiment in which the memory of the distant past, which is stored in the storage assist device, can be instantly searched based on the date and time and the time is returned to the action of the day will be described.

Human memory continues to memorize daily actions in the brain over the years, and the memory of the distant past becomes the memory lost from the ambiguous memory and disappears from the brain.

While accumulating the daily memories stored in the memory assist device in the spectacles of the present invention, the behavior record of the person wearing the spectacles of the present invention is continuously memorized without being lost.

People who are getting older over time and whose travels are weakened and cannot stay can feel like they have traveled by watching the recorded videos of the travel destinations in the travel guide, but the memories of their past trips can be remembered. It is a memory assist device of the AI assistant image recognition function in the glasses of the present invention that can return to the day of the lost young journey.

Watching the action video played on the day of the trip of memories of the distant past that the person forgot, part of the forgotten memory is revived and he returns to the video played on the projector as the beginning of a new trip A part of the memory that can be experienced and lost during the trip is revived and the real view is felt while in the room, and this experience behavior is also memorized. The memory assist device of the AI assistant image recognition function in the glasses of the present invention. Is.

In the tenth embodiment, the memory assisting device in the spectacles of the present invention that changes the past will be described, but a person makes mistakes and mistakes and grows older every day.

The present invention is a storage assist device for the AI assistant image recognition function in eyeglasses, which was invented to avoid failures and mistakes, but it is best because there is no accumulated data to be used as a reference for avoiding failures and mistakes. The behavior that made an error or failure in the behavior that was performed is stored in the storage assist device.

People sometimes look back on the past, realize that they should have done this at that time, and feel regret.

When a decision is made, the decision is made as the optimal decision action, and the action is stored in the storage assist device.

The memory assist device of the AI assistant image recognition function in the glasses of the present invention records and saves actions so as not to repeat mistakes and mistakes, but at a later date, to avoid repeating actions driven by regret. It is possible to embed and memorize the contents to be pointed out and reference materials in the recorded behavior.

Over the years, looking back on the past, if similar behaviors driven by regret do not seem to occur, all past behaviors driven by regret can be traced back and erased.

It is also a storage assist device for the AI assistant image recognition function in the glasses of the present invention, which has a history that changed the past by rewriting and saving the memory of the memory assist device as a record of the past without regrets.

Nowadays, the society is becoming an aging society, and the shortage of the working population of young people is becoming a big problem.

It is a big problem that skilled workers with advanced technology are retired and the technology is cut off.

In addition, in order to acquire advanced technology, it is necessary to repeatedly make mistakes in the workplace until it is acquired for a certain period of time.

There are few young people who become skilled workers who need years, and inheriting the skills acquired by skilled workers has become a major issue for companies that mainly manufacture products.

The storage assisting device stores daily work operations and detailed actions of skilled workers using the storage assisting device of the AI assistant image recognition function in the glasses of the present invention.

By using the memory assist device in the spectacles that copies the memorized action record of the skilled worker, the person wearing the spectacles can perform the same work as the skilled worker by referring to the work operation procedure displayed on the display in the spectacles. , The memory assist device of the AI assistant image recognition function in the glasses of the present invention that can prevent failures caused by lack of inexperienced experience and quickly learn the technology.

1 Camera that supplements the field of view
1-1 Camera that projects the pupil and the image reflected in the pupil
2 earphones
2-1 speaker
3 microphone
4 A display that displays the image captured by the camera that captures the tip of the eye
4-1 A display that displays the image captured by the camera that captures the eyes.
5 Storage aid for AI assistant image recognition function in glasses
6 Transmitter / receiver
7 Eyeglass frames
8 projector
9 eyes
10 Smartphone
11 tablets

A front perspective view showing that each member is provided in the spectacles by the AI assistant in the spectacles and the storage assist device of the image recognition function. A perspective view from below showing that each member is provided in the spectacles by the spectacle memory assist device. A perspective view of a situation in which a spectacle memory assist device is attached. A perspective view of a situation in which a spectacle memory assist device is attached. An overall perspective view of a camera and projector on the spectacle frame that reflects what the eyes are looking at. A perspective view of the situation where a projector and a camera are installed on the forehead. A chart diagram that describes the action procedure for recalling memories such as ambiguity. A chart diagram showing that actions that follow the schedule encourage forgotten actions. A perspective view of the AI assistant in the glasses and the storage assist device for the image recognition function. A smartphone that can share the video information captured by the camera with each other. A tablet that allows mutual sharing of video information captured by the camera. A perspective view of goggles equipped with an AI assistant and a storage assist device for image recognition. A perspective view in which a camera is provided in the center of the goggle lens surface to capture an image reflected in the pupil.

Claims (12)

It consists of a camera with GPS function that records the date and time in the eyeglass frame, a camera that secures the field of view, a microphone, earphones, speakers, an AI assistant, an image recognition function, a display, a projector, and a camera that captures the eyes. An AI assistant in the glasses equipped with a storage assist device that can record camera image information, and a transmission device that can send and receive this stored information so that it can be shared with external smartphones, tablets, personal computers, etc. Memory assist device for image recognition function. The AI in the glasses according to claim 1, which is characterized in that a camera that captures the eyes captures the image reflected in the eyes, and the memory assist device in the glasses records what is seen in the eyes in daily activities and keeps accumulating and memorizing the objects. Assistant, memory aid for image recognition. Claim 1 in order to bring back the ambiguous objects and people you are looking at by projecting the objects and people in your eyes on the left display as optical images of moving images and still images using a camera that captures your eyes. From the stored video information of the storage assist device described in the above, similar moving image information or an optical image that calls up the image, which is referred to by the AI assistant, is projected on the right display as a reproduced moving image and a reproduced still image. The feature is that a separate display screen is provided to display the searched image display screen and the searched image display screen, which can be reproduced on the screen and compared with the reproduced video, the video captured by the camera, and the still image side by side. The AI assistant in the glasses of claims 1 and 2, and the storage assist device of the image recognition function. When the camera that captures the eyes captures the image reflected in the eyes, the image that the movement of the eyes and the blinking of the eyelids are neglected is recorded and memorized as a video of the action due to eye fatigue, and the video of the action that is easily overlooked. The eyeglasses according to any one of claims 1 to 3, characterized in that the video information of the video captured at the time of fatigue is embedded with a voice or a text image of a caution instruction and overwritten. AI assistant in, memory assist device of image recognition function. The feature is that when the eye movements of the eyes hang down due to eye fatigue, the eyelids hang down, the blinking becomes negligent and the field of view decreases, the camera that captures the eyes can be switched to the camera that secures the field of view by the AI assistant's judgment and the instructions of the AI assistant. The AI assistant in the eyelid and the storage assist device for the image recognition function according to any one of claims 1 to 4. One of claims 1 to 5, which is characterized in that this processed video, which is overwritten by embedding a voice or character display on the recorded video of one's own action, is made into a processed video that can be generated by asking the AI assistant on a display or projector. AI assistant in the glasses described in, memory assist device of image recognition function. Any of claims 1 to 6, characterized in that the AI assistant is provided with a communication device capable of transmitting and receiving according to the instructions of the AI assistant by asking the AI assistant to a personal computer, tablet, smartphone, etc. that shares the processed video stored in the storage assist device. The AI assistant in the glasses and the memory assist device for the image recognition function described in one. Among the action videos in the memory assist device that the camera captures and records daily daily actions, the action videos that are absolutely necessary in the day are processed to call attention and warning through the AI assistant. Claims 1 to 7 characterized in that this processed video is pasted at the scheduled time of the day's time zone, the video can be generated on the display or projector at the scheduled time, and the video is an information video that prompts the action by an announcement at the time of reproduction. The AI assistant in the glasses and the storage assist device for the image recognition function described in any one of them. If the AI predicts that the behavior of the processed video pasted at the scheduled time to prompt the action is forgotten, or if the camera captures the jumped behavior and the AI assistant or image recognition function detects it, the AI assistant will make the above-mentioned schedule. The AI assistant in the glasses and the memory assist device of the image recognition function according to any one of claims 1 to 8, characterized in that an announcement is made to encourage action. Copy a part of the required video from the accumulated past own action video, paste it at the scheduled date and time, add the pictogram and voice of the necessary additional information, and overwrite it to show the action of the scheduled timetable The AI assistant in the glasses and the storage assist device for the image recognition function according to any one of claims 1 to 9, wherein the moving image is used. When the AI assistant makes an announcement to encourage action, the information required to predict the behavior is that the AI assistant predicts the behavior based on the video information of the stored memory assist device described above. The AI assistant in the glasses and the memory assisting device for the image recognition function according to any one of 1 to 10. The camera that captures the pupil captures the image reflected in the pupil and the capillaries of the retina, and the recorded video information of daily activities is recorded by copying the capillaries of the retina, so that it is probable as personal intellectual property video information. The AI assistant in the retina and the memory assist device of the image recognition function according to any one of 1 to 11, which is characterized by demonstrating.

Images