KR20210035418A - Beamr devices and mixed reality content for delivering brain fitness services - Google Patents

Abstract

According to one embodiment of the present invention, a beam projector and mixed reality (BeaMR) device and mixed reality content providing system for providing a brain fitness service may provide an integrated beam projector and mixed reality (BeaMR) H/W device based on a 3D camera and beam projector for providing mixed reality content. The mixed reality content providing system for providing a brain fitness server comprises: a server; and a terminal.

Description

BeaMR devices and mixed reality content for providing brain fitness services {BEAMR DEVICES AND MIXED REALITY CONTENT FOR DELIVERING BRAIN FITNESS SERVICES}

The present invention relates to a system for providing a brain fitness service, and a description of the configuration and method of a platform for producing content that meets various demands of consumers by developing a BeaMR device and mixed reality content for brain fitness and providing the content produced through it. About technology It is a technology that provides content tailored to the needs of consumers through various channels.

Mixed reality (MR) is a concept that includes virtual reality (VR) and augmented reality (AR), and combines immersion, which is the advantage of virtual reality, and reality, which is the advantage of augmented reality. In the form of HMD or smart glasses, applications are expanding to medical, education, entertainment, manufacturing, aerospace, shopping, and design. However, due to technical constraints and high prices, released products are limited to developers only, and commercialization of products for the general public is sluggish. In order for the industry to develop in the future, it is necessary to drastically cut prices according to mass production of products, overcome technical restrictions, reduce weight and eliminate heterogeneity for convenient device wearing, smart design, emergence of leading platforms, and massive expansion of content that can be enjoyed. Do.

KR20180097287A KR20180006573

The embodiments intend to develop a BeaMR device, an MR (mixed reality) platform in which 3D camera-based motion sensing and context-aware technologies are fused to prevent and manage brain diseases in response to an aging society.

The examples aim at the evaluation of clinical effectiveness through the development of brain fitness education program contents and analysis based on big data.

An embodiment may develop an integrated BeaMR (Beam projector + Mixed Reality) H/W device based on a 3D camera for providing mixed reality content and a Beam project.

The embodiments may develop a BeaMR device, which is an MR (mixed reality) platform in which 3D camera-based motion sensing and context-aware technologies are fused for prevention and management of brain diseases in response to an aging society.

Examples may evaluate clinical effectiveness through development of brain fitness training program contents and analysis based on big data.

1 is a view for explaining an embodiment.
2 is a view for explaining an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes may be made to the embodiments, the scope of the patent application is not limited or limited by these embodiments. It is to be understood that all changes, equivalents, or substitutes to the embodiments are included in the scope of the rights.

Specific structural or functional descriptions of the embodiments are disclosed for the purpose of illustration only, and may be changed and implemented in various forms. Accordingly, the embodiments are not limited to a specific disclosure form, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical idea.

Although terms such as first or second may be used to describe various components, these terms should be interpreted only for the purpose of distinguishing one component from other components. For example, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component.

When a component is referred to as being "connected" to another component, it is to be understood that it may be directly connected or connected to the other component, but other components may exist in the middle.

The terms used in the examples are used for illustrative purposes only and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present specification, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof does not preclude in advance.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the embodiment belongs. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in the present application. Does not.

In addition, in the description with reference to the accompanying drawings, the same reference numerals are assigned to the same components regardless of the reference numerals, and redundant descriptions thereof will be omitted. In describing the embodiments, when it is determined that a detailed description of related known technologies may unnecessarily obscure the subject matter of the embodiments, the detailed description thereof will be omitted.

The embodiments may be implemented in various types of products such as a personal computer, a laptop computer, a tablet computer, a smart phone, a television, a smart home appliance, an intelligent vehicle, a kiosk, and a wearable device.

1 is a view for explaining according to an embodiment.

Recently, mixed reality (MR) is emerging following virtual reality (VR) and augmented reality (AR). Virtual reality is a technology that makes people interact with real surroundings without directly experiencing an environment that is difficult to experience on a daily basis, and augmented reality is augmented virtual information by augmenting virtual information in real time in real time. It is a technique that improves work efficiency by interacting with.

Mixed reality (MR) is a concept that includes virtual reality (VR) and augmented reality (AR). By mixing real and virtual spaces, a new space is built where real and virtual objects are affected in real time. . It is applied to various fields in the form of head-mounted displays (HMD) and smart glasses by combining immersion, which is the advantage of virtual reality, and reality, which is the advantage of augmented reality. It is expected to become the mainstream.

Mixed reality (MR) is a reality created by mixing a variety of ways that can exist between reality and virtual reality. It enables you to solve the limitations of imagination that did not communicate well with others. It is expected that a world where people can enjoy life will come. By combining the immersion of virtual reality and the function of realizing data in the real world of augmented reality, it will be a technology suitable for both general consumers and businesses. Mixed reality is less immersive than virtual reality, but it is easy to simulate, so it is advantageous when experimenting with risk or expressing something that requires understanding of a certain situation.

In addition, virtual reality requires a headset device such as an HMD, and augmented reality must have a medium such as a smartphone, but mixed reality has the advantage of being able to experience without any intermediate media like watching a movie. Although virtual reality does not actually exist, it is filled with only reality that seems to exist, and reality created by specially manufactured HMD goggles, but the created reality is similar to real reality, giving a sense of immersion. Augmented reality does not actually exist in the scene, but'Pokemon Go' is a representative view by adding images or information related to it through special glasses, smartphone, or tablet photography.

Augmented Virtuality (AV) is a technology that allows interaction by adding realistic elements and making it based on a virtual reality technique. To the human eye, it appears to be entering the goal. Unlike virtual reality and augmented reality, mixed reality has not yet been commercialized, but the released product is limited to developers, not general consumers, and the price is very expensive, so it is still difficult for the general public to use it.

This is because there are technical limitations such as processing large amounts of data. In order to use mixed reality in mobile devices, camera position recognition technology attached to the device, technology representing virtual digital information in real space, interaction technology that gives immersion to reality mixed with reality and virtual reality, mixed reality suitable for the application field. Additional detailed techniques such as manufacturing techniques are required. In addition, as a technology that provides immersive and immersive services, it is necessary to improve network and transmission technology for delivery of large-capacity 3D images, improve image quality and real-time processing technology, lighter HMD, and develop sensor and display hardware technology for high quality. .

The BeaMR device for providing brain fitness service and the mixed reality content providing system according to an embodiment can develop an integrated BeaMR (Beam projector + Mixed Reality) H/W device based on a 3D camera and Beam project for providing mixed reality content. have.

The system according to an embodiment may provide brain fitness mixed reality content for efficient training of various brain training programs.

The system according to an embodiment may provide four or more types of brain fitness content using a device that acquires certification and develops for commercialization of a prototype H/W device.

The system according to an embodiment may convert the activity information of subjects using brain fitness into big data, and extract quantitative data for before and after improvement through data analysis.

The system according to an embodiment may perform the following steps.

● 3D camera and Beam projector integrated BeaMR device design and development

-BeaMR device design incorporating a 3D camera and a beam projector, a projection display device, for user and mixed reality environment perception

-BeaMR device design and development considering 4 device installation types according to various mixed reality service provision types

● BeaMR device testing in MR (mixed reality) service environment

-BeaMR device operation test in user's exercise ability measurement mode

-BeaMR device operation test in mixed reality situational awareness mode

-Device operation test and optimization by 4 types of device installation type (ceiling type, .stand-mounting type, floor projection type, stand table type)

● Acquired the certification of the developed BeaMR device

-KOLAS certified test for durability performance certification of BeaMR device

-KC conformity certification and autonomous safety test for commercialization of BeaMR devices

● More than 4 types of brain fitness content development

-Out of 5 evaluation and improvement functions for brain fitness (cognitive function, motor function, balance function, language function, vision function), 4 functions that can be measured with BeaMR device (cognitive function, motor function, balance function, vision function) Content development

-Development content can be independent content for each function or complex content that can measure two or more complex functions at the same time.

-Derivation of optimal contents through joint research with 3 detailed institutions, which are clinical and verification institutions

● BeaMR-based brain fitness total solution development

-Derived brain fitness total solution consisting of development H/W device BeaMR, motion sensing and context-aware engine, and mixed reality content

-Package the development system at the level that can be sold as a commercial solution after completion of the project

● Brain fitness clinical effectiveness evaluation environment establishment and execution

-Establish an environment and provide a system for evaluating clinical effectiveness of 3 detailed institutions

-Joint construction of test bed to verify clinical applicability

-Provides a system for clinical efficacy evaluation

● Sold the Brain Fitness Total Solution (BFTS) that combines the BeaMR device developed through this project, motion sensing and context-aware engine, and brain training content.

● For commercialization, endurance performance certification (KOLAS), KC conformity certification, and autonomous safety tests are carried out for commercialization.

● Through the brain fitness content verification of specialized medical staff in the 3rd detail, the effectiveness of the developed solution compared to the existing brain training method is verified, and it is planned to be used as a key marketing element.

● Close cooperation with three hospitals based on the University Medical Center (Anam, Ansan, Guro, especially, Korea University Guro Hospital Medical Device Intermediate Clinical Support Center) that performed clinical and verification, and the infrastructure of related institutions Proliferation of development solutions

● Initial system utilization and sales targets are set for local government-based healthcare facilities such as community centers and public health centers, and expanded to domestic and international nursing hospitals and elderly care facilities such as nursing homes and rehabilitation facilities.

● By providing personalized brain training programs for various user ages, it is possible to provide services considering various users such as middle-aged and cognitive rehabilitation patients, as well as the elderly who are urgently needed to prevent and manage brain diseases.

● Exercise and physical strength measurement technology through a 3D camera can be used as a system for providing athletic ability and physical strength improvement services for kids, youth and adults as well as brain fitness services.

● 3D camera image-based motion sensing and context-aware algorithms can be applied not only to healthcare, but also to various industries that provide personalized services by recognizing the user's movement and environment, such as medical care, rehabilitation, entertainment, education, and defense.

● The introduction and installation cost of expensive existing overseas similar systems is high, but the scalability and applicability are low, and there is a disadvantage of providing only limited content.

● The developed BeaMR system and brain fitness content can improve various functional elements of existing brain training at low cost.

2 is an exemplary diagram of a configuration of an apparatus according to an embodiment.

The device 301 according to one embodiment includes a processor 302 and a memory 303. The device 301 according to an embodiment may be a server or a terminal. The processor may include at least one device described above with reference to FIG. 1, or may perform at least one method described above with reference to FIG. 1. The memory 303 may store information related to the above-described method or a program in which the above-described method is implemented. The memory 303 may be a volatile memory or a nonvolatile memory.

According to one embodiment, the processor 302 may execute a program and control the device 301. The code of a program executed by the processor 302 may be stored in the memory 303. The device 301 is connected to an external device (for example, a personal computer or a network) through an input/output device (not shown), and can exchange data.

The embodiments described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices, methods, and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. Further, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or, to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

As described above, although the embodiments have been described by the limited drawings, a person of ordinary skill in the art can apply various technical modifications and variations based on the above. For example, the described techniques are performed in a different order from the described method, and/or components such as systems, structures, devices, circuits, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the following claims.

Claims (1)

A server that provides mixed reality content for providing brain fitness services; And
Terminal displaying the content
Including,
The above contents are provided based on an integrated BeaMR (Beam projector + Mixed Reality) H/W device based on a 3D camera and Beam project for providing mixed reality contents,
Brain fitness-based mixed reality content delivery system.

Images