CN112598938A - Cognitive function training system, method, device, equipment and storage medium based on augmented reality - Google Patents
Cognitive function training system, method, device, equipment and storage medium based on augmented reality Download PDFInfo
- Publication number
- CN112598938A CN112598938A CN202011583311.7A CN202011583311A CN112598938A CN 112598938 A CN112598938 A CN 112598938A CN 202011583311 A CN202011583311 A CN 202011583311A CN 112598938 A CN112598938 A CN 112598938A
- Authority
- CN
- China
- Prior art keywords
- cognitive
- augmented reality
- article
- information
- reality display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 212
- 238000012549 training Methods 0.000 title claims abstract description 72
- 230000003920 cognitive function Effects 0.000 title claims abstract description 59
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000001149 cognitive effect Effects 0.000 claims abstract description 218
- 239000011521 glass Substances 0.000 claims abstract description 75
- 230000000007 visual effect Effects 0.000 claims abstract description 47
- 238000004590 computer program Methods 0.000 claims description 13
- 238000004891 communication Methods 0.000 claims description 10
- 238000004422 calculation algorithm Methods 0.000 claims description 7
- 238000013527 convolutional neural network Methods 0.000 claims description 7
- 230000000694 effects Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 10
- 230000003930 cognitive ability Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Tourism & Hospitality (AREA)
- Theoretical Computer Science (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Human Resources & Organizations (AREA)
- General Business, Economics & Management (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention is suitable for the technical field of computers, and provides a cognitive function training system, a method, a device, equipment and a storage medium based on augmented reality, wherein the system comprises an augmented reality display server; the system comprises a display terminal, a glasses type augmented reality display terminal and a cognitive article identification end, wherein the display terminal is used for judging whether the cognitive article identification end exists in a user visual field range according to a preset rule, determining identification information of the cognitive article identification end and cognitive article display information corresponding to the identification information when the cognitive article identification end exists, and sending the identification information to the glasses type augmented reality display terminal; and the glasses type augmented reality display terminal is used for receiving the display information of the cognitive articles and displaying the cognitive articles in an augmented reality mode. According to the cognitive function training system provided by the invention, the cognitive article identification end is scattered at each position, and when a child wears the glasses type augmented reality display terminal to 'see' the cognitive article identification end, the more vivid and virtual cognitive article display information is displayed in an augmented reality manner, so that the cognitive function training effect of the child is improved.
Description
Technical Field
The invention belongs to the technical field of computers, and particularly relates to a cognitive function training system, method, device, equipment and storage medium based on augmented reality.
Background
With the development and progress of society, most parents pay more and more attention to the training of cognitive ability of children.
The training of the cognitive ability of the children is mainly realized based on the perception and understanding of external objects by the children, and is mainly realized by depending on entity tools such as toys, storybooks and the like at present, so that the cognitive information displayed for the children is less, the children are not vivid enough, the interest of the children is low, and the training of the cognitive ability of the children is influenced.
Therefore, the existing training method for the cognitive ability of the children mainly displays entity cognitive information for the children, the information is little, and the training of the cognitive ability of the children is influenced due to the fact that the information is not vivid enough.
Disclosure of Invention
The embodiment of the invention aims to provide a cognitive function training system based on augmented reality, and aims to solve the technical problems that the existing training method for the cognitive ability of children is low in training efficiency of the cognitive ability of children due to the fact that display information is few and vivid enough.
The embodiment of the invention is realized in such a way that a cognitive function training system based on augmented reality comprises an augmented reality display server, a glasses type augmented reality display terminal and at least one cognitive article identification end; cognitive article display information associated with the identification information of the cognitive article identification end is stored in advance on the augmented reality display server end;
the augmented reality display server is used for judging whether a cognitive article identification end exists in a visual field range of a user wearing the glasses type augmented reality display terminal according to a preset rule, and determining identification information of the cognitive article identification end when judging that the cognitive article identification end exists; determining cognitive article display information associated with the identification information according to the identification information, and sending the cognitive article display information to a glasses type augmented reality display terminal;
the glasses type augmented reality display terminal is used for receiving the cognitive article display information sent by the augmented reality display server and displaying the cognitive article display information in an augmented reality mode.
Another object of an embodiment of the present invention is to provide an augmented reality-based cognitive function training method, which is executed on an augmented reality display server in the cognitive function training system described above, and specifically includes the following steps:
judging whether a cognitive article identification end exists in a visual field range when a user wears the glasses type augmented reality display terminal according to a preset rule;
when the cognitive article identification end exists, identification information of the cognitive article identification end is determined;
and determining cognitive article display information associated with the identification information according to the identification information, and sending the cognitive article display information to the glasses type augmented reality display terminal so that the glasses type augmented reality display terminal displays the cognitive article display information in an augmented reality mode.
Another object of an embodiment of the present invention is to provide an augmented reality-based cognitive function training device, which is disposed on an augmented reality display server in the cognitive function training system, and specifically includes the following units:
the cognitive article identification end existence judging unit is used for judging whether the cognitive article identification end exists in the visual field range when the user wears the glasses type augmented reality display terminal according to a preset rule;
the identification information determining unit is used for determining the identification information of the identification end of the cognitive article when judging that the cognitive article exists;
and the cognitive article display information sending unit is used for determining the cognitive article display information associated with the identification information according to the identification information and sending the cognitive article display information to the glasses type augmented reality display terminal so that the glasses type augmented reality display terminal displays the cognitive article display information in an augmented reality mode.
It is a further object of an embodiment of the present invention to provide a computer device, including a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to execute the steps of the augmented reality based cognitive function training method as described above.
It is a further object of an embodiment of the present invention to provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, causes the processor to perform the steps of the augmented reality-based cognitive function training method as described above.
The cognitive function training system based on augmented reality provided by the embodiment of the invention is improved on the basis of the existing augmented reality system, and comprises an augmented reality display service end, a glasses type augmented reality display terminal and at least one cognitive article identification end, wherein cognitive article display information associated with the identification information of the cognitive article identification end is stored in the augmented reality display service end in advance, so that when the augmented reality display service end judges that the cognitive article identification end exists in a visual field range when a user wears the glasses type augmented reality display terminal according to a preset rule, the cognitive article display information associated with the cognitive article identification end is determined and is sent to the glasses type augmented reality display terminal to be displayed in an augmented reality mode. The cognitive function training system based on augmented reality can be better applied to a home scene, and through scattering the identification end of the cognitive object at each position, when a child wears the glasses type augmented reality display terminal to 'see' the identification end of the cognitive object, the more vivid and virtual cognitive object display information can be displayed in an augmented reality mode, so that the cognitive function training effect of the child is improved.
Drawings
Fig. 1 is a schematic structural diagram of a cognitive function training system based on augmented reality according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of another augmented reality-based cognitive function training system according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating steps of a cognitive function training method based on augmented reality according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a cognitive function training device based on augmented reality according to an embodiment of the present invention;
fig. 5 is an internal structure diagram of a computer device for performing an augmented reality-based cognitive function training method according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, a schematic structural diagram of an augmented reality-based cognitive function training system according to an embodiment of the present invention is described in detail as follows.
In the embodiment of the present invention, the cognitive function training system mainly comprises an augmented reality display server 110, a glasses-type augmented reality display terminal 120, and at least one cognitive item identifier 130, wherein cognitive item display information associated with identifier information of the cognitive item identifier 130 is stored in advance on the augmented reality display server 110.
In the embodiment of the present invention, the augmented reality display server 110 is configured to determine, according to a preset rule, whether the cognitive article identifier 130 exists in a visual field range of a user wearing the glasses-type augmented reality display terminal 120, and determine identifier information of the cognitive article identifier 130 when determining that the cognitive article identifier 130 exists; then the identification information determines the cognitive article display information associated with the identification information and sends the cognitive article display information to the glasses type augmented reality display terminal 120; the glasses type augmented reality display terminal 120 is configured to receive the cognitive article display information sent by the augmented reality display server and display the cognitive article display information in an augmented reality manner.
In the embodiment of the invention, it needs to be explained that the glasses type augmented reality display terminal displays the cognitive article display information in an augmented reality manner belongs to a conventional technical means of augmented reality. Therefore, the specific implementation principle of displaying the cognitive article display information in an augmented reality manner is not specifically described in the invention.
In the invention, the cognitive article identification end can be understood as a small chip, and a circuit with a corresponding function is arranged in the cognitive article identification end, so that the position can be changed according to the requirement of a user.
According to the invention, the plurality of cognitive article identification ends are arranged, the cognitive article display information associated with the identification information of the cognitive article identification ends is prestored in the augmented reality display server, and the cognitive article display information corresponding to the cognitive article identification ends existing in the visual field range of the user when wearing the glasses type augmented reality display terminal is automatically displayed by judging, so that vivid and virtual information can be displayed for children, and the cognitive function training of the children can be effectively promoted in a home scene.
As a preferred embodiment of the present invention, a feasible implementation manner is provided in which a cognitive function training system determines whether a cognitive object identifier exists in a visual field range of a user wearing a glasses-type augmented reality display terminal according to a preset rule, and the following is detailed below:
at this time, an orientation determining unit is disposed on the glasses-type augmented reality display terminal 120; a positioning communication unit is preset on the cognitive article identification end 130;
the glasses-type augmented reality display terminal 120 is configured to determine, by the orientation determining unit, user position information and view direction information of a user wearing the glasses-type augmented reality display terminal 120, and send the user position information and the view direction information to the augmented reality display server 110; while
The cognitive object identification terminal 130 is configured to determine position information of the cognitive object identification terminal 130 through the positioning communication unit, and send the position information of the cognitive object identification terminal and identification information thereof to the augmented reality display server terminal 110;
at this time, the augmented reality display server 110 determines whether the cognitive object identifier 130 exists in the field of view when the user wears the glasses-type augmented reality display terminal 120 according to the user position information, the field of view orientation information, and the cognitive object identifier position information.
In the embodiment of the present invention, in consideration of the specific application of the present invention to an indoor scenario, the position determining unit and the positioning communication unit may be implemented based on positioning of the internet of things, for example, the positioning communication unit may be implemented by near field communication such as Wifi or bluetooth, and the position determining unit may also be implemented by 2 or 3 positioning units disposed on the glasses-type augmented reality display terminal to determine the user position information and the view direction information.
As another preferred embodiment of the present invention, another feasible implementation manner is provided in which the cognitive function training system determines whether the cognitive object identifier exists in the field of view of the user wearing the glasses-type augmented reality display terminal according to a preset rule, which is detailed as follows:
at this time, an image acquisition unit is disposed on the glasses-type augmented reality display terminal 120;
the glasses-type augmented reality display terminal 120 is configured to determine, through the image acquisition unit, visual field image information of a user wearing the glasses-type augmented reality display terminal 120, and send the visual field image information to the augmented reality display server 110;
at this time, the augmented reality display server 110 determines whether the cognitive object identifier exists in the field of view range of the user wearing the glasses-type augmented reality display terminal according to the field of view image information and a preset cognitive object identifier image recognition model.
In the embodiment of the invention, the preset cognitive article identification end image recognition model is generated by training based on a convolutional neural network model algorithm in advance. It should be noted that the convolutional neural network model algorithm belongs to the common knowledge well known to those skilled in the art, and the present invention is not specifically described herein, and is specifically generated by training a sample image containing a cognitive object identification end. And further to improve the efficiency of the convolutional neural network model algorithm, the cognitive article identification end has a specific shape or a specific color so as to more accurately and rapidly identify the cognitive article identification end.
In the embodiment of the present invention, the image capturing unit may be, for example, a camera, and of course, parameters of the camera need to be set so that an image captured by the camera is the same as that in the field of view of the user.
As a further preferred embodiment of the present invention, a two-dimensional code image is disposed on the cognitive article identification end 130; the two-dimensional code image is associated with the identification information of the cognitive article identification end.
The glasses type augmented reality display terminal 120 is configured to send the two-dimensional code image to the augmented reality display server 110 when the image acquisition unit reads the two-dimensional code image set on the cognitive goods identifier 130.
At this time, the augmented reality display server 110 determines the identification information of the cognitive article identification end associated with the two-dimensional code image directly according to the two-dimensional code image.
The cognitive function training system based on augmented reality provided by the embodiment of the invention is improved on the basis of the existing augmented reality system, and comprises an augmented reality display service end, a glasses type augmented reality display terminal and at least one cognitive article identification end, wherein cognitive article display information associated with the identification information of the cognitive article identification end is stored in the augmented reality display service end in advance, so that when the augmented reality display service end judges that the cognitive article identification end exists in a visual field range when a user wears the glasses type augmented reality display terminal according to a preset rule, the cognitive article display information associated with the cognitive article identification end is determined and is sent to the glasses type augmented reality display terminal to be displayed in an augmented reality mode. The cognitive function training system based on augmented reality can be better applied to a home scene, and through scattering the identification end of the cognitive object at each position, when a child wears the glasses type augmented reality display terminal to 'see' the identification end of the cognitive object, the more vivid and virtual cognitive object display information can be displayed in an augmented reality mode, so that the cognitive function training effect of the child is improved.
As shown in fig. 2, a schematic structural diagram of another augmented reality-based cognitive function training system provided in an embodiment of the present invention is described in detail as follows.
In the embodiment of the present invention, the difference from the structural schematic diagram of the augmented reality-based cognitive function training system shown in fig. 1 is that the cognitive function training system further includes a cognitive item display information entry client 210, which is mainly used for implementing entry and association of a cognitive item identifier and cognitive item display information.
The cognitive article display information input client 210 is configured to acquire identification information of the cognitive article identification end 130, receive cognitive article display information input by a user and associated with the identification information, and send the identification information of the cognitive article identification end and the associated cognitive article display information to the augmented reality display server 110.
In the embodiment of the invention, the cognitive article display information input client is arranged, so that the cognitive article display information corresponding to the cognitive article identification terminal can be freely updated and switched, and the flexibility of the system is improved.
As a preferred embodiment of the present invention, the cognitive article display information includes image display information and sound output information. The cognitive article identification end 130 is provided with a voice output unit.
At this time, the augmented reality display server 110 determines image display information and sound output information associated with the identification information according to the identification information; and sending the image display information to the glasses type augmented reality display terminal 120, and sending the sound output information to the cognitive article identification terminal 130.
The cognitive article identification terminal 130 is further configured to output the sound output information through the voice output unit.
In the embodiment of the invention, the voice interaction between the child and the cognitive function training system can be realized.
According to the cognitive function training system based on augmented reality, the cognitive article display information input client is additionally arranged, so that the active selection input of the identification information and the cognitive article display information is realized, and the cognitive function training system based on augmented reality is more flexible.
As shown in fig. 3, a flowchart of steps of a cognitive function training method based on augmented reality according to an embodiment of the present invention is provided, where the method is mainly executed on an augmented reality display server 110 of a cognitive function training system based on augmented reality as shown in fig. 1 or fig. 2, and specifically includes the following steps:
step S302, judging whether a cognitive object identification end exists in the visual field range of the user when the user wears the glasses type augmented reality display terminal according to a preset rule. When the judgment is present, step S304 is executed; when the judgment result is not present, other steps are executed.
In the embodiment of the present invention, the preset rule is generally implemented based on the positioning information or based on the image recognition information.
Specifically, as a feasible scheme, the wearable glasses type augmented reality display terminal uploads user position information and visual field orientation information through the position determining unit, meanwhile, the cognitive object identification terminal can acquire the position information through the positioning communication unit and uploads the position information together with the identification information, and at the moment, the augmented reality display server can process the user position information, the visual field orientation information and the cognitive object identification end position information according to a preset calculation formula so as to judge whether the cognitive object identification terminal exists in a visual field range of the user when the wearable glasses type augmented reality display terminal is worn.
As another feasible scheme, the wearable glasses-type augmented reality display terminal can acquire and upload the visual field image information of the user when wearing the glasses-type augmented reality display terminal through the image acquisition unit, and the augmented reality display server can judge whether the user has the cognitive object identifier in the visual field range when wearing the glasses-type augmented reality display terminal according to a cognitive object identifier image recognition model generated by training based on a convolutional neural network algorithm in advance.
As another feasible scheme, a two-dimensional code image is arranged on the cognitive article identification terminal, and at this time, when the wearing glasses type augmented reality display terminal acquires the two-dimensional code image through the image acquisition unit and uploads the two-dimensional code image to the augmented reality display server, the augmented reality display server can directly determine that the cognitive article identification terminal exists in the visual field range of the user wearing the glasses type augmented reality display terminal.
And step S304, determining the identification information of the cognitive article identification end.
In the embodiment of the invention, because only data can be stored in the augmented reality display server, the identification information of the cognitive article identification end can be understood as the data which is stored in the augmented reality display server and is used for describing the cognitive article identification end. And the identification information of the cognitive article identification end can be accurately acquired based on the positioning information or the image identification information.
And S306, determining the cognitive article display information associated with the identification information according to the identification information, and sending the cognitive article display information to the glasses type augmented reality display terminal.
In the embodiment of the invention, the identification information of the identification end of the cognitive article and the display information of the cognitive article are pre-associated and stored on the augmented reality display server, so that the display information of the cognitive article associated with the identification information can be determined according to the identification information and then sent to the glasses type augmented reality display terminal to display the display information of the cognitive article, thereby realizing the cognitive function training of children.
As shown in fig. 4, a schematic structural diagram of a cognitive function training device based on augmented reality according to an embodiment of the present invention is mainly disposed on an augmented reality display server 410 of a cognitive function training system based on augmented reality as shown in fig. 1 or fig. 2, and specifically includes the following units:
and the cognitive article identification end existence judging unit 410 is used for judging whether the cognitive article identification end exists in the visual field range of the user when the user wears the glasses type augmented reality display terminal according to a preset rule.
In the embodiment of the present invention, the preset rule is generally implemented based on the positioning information or based on the image recognition information.
Specifically, as a feasible scheme, the wearable glasses type augmented reality display terminal uploads user position information and visual field orientation information through the position determining unit, meanwhile, the cognitive object identification terminal can acquire the position information through the positioning communication unit and uploads the position information together with the identification information, and at the moment, the augmented reality display server can process the user position information, the visual field orientation information and the cognitive object identification end position information according to a preset calculation formula so as to judge whether the cognitive object identification terminal exists in a visual field range of the user when the wearable glasses type augmented reality display terminal is worn.
As another feasible scheme, the wearable glasses-type augmented reality display terminal can acquire and upload the visual field image information of the user when wearing the glasses-type augmented reality display terminal through the image acquisition unit, and the augmented reality display server can judge whether the user has the cognitive object identifier in the visual field range when wearing the glasses-type augmented reality display terminal according to a cognitive object identifier image recognition model generated by training based on a convolutional neural network algorithm in advance.
As another feasible scheme, a two-dimensional code image is arranged on the cognitive article identification terminal, and at this time, when the wearing glasses type augmented reality display terminal acquires the two-dimensional code image through the image acquisition unit and uploads the two-dimensional code image to the augmented reality display server, the augmented reality display server can directly determine that the cognitive article identification terminal exists in the visual field range of the user wearing the glasses type augmented reality display terminal.
And an identification information determining unit 420, configured to determine, when the presence is determined, the identification information of the cognitive article identification end.
In the embodiment of the present invention, the preset rule is generally implemented based on the positioning information or based on the image recognition information.
Specifically, as a feasible scheme, the wearable glasses type augmented reality display terminal uploads user position information and visual field orientation information through the position determining unit, meanwhile, the cognitive object identification terminal can acquire the position information through the positioning communication unit and uploads the position information together with the identification information, and at the moment, the augmented reality display server can process the user position information, the visual field orientation information and the cognitive object identification end position information according to a preset calculation formula so as to judge whether the cognitive object identification terminal exists in a visual field range of the user when the wearable glasses type augmented reality display terminal is worn.
As another feasible scheme, the wearable glasses-type augmented reality display terminal can acquire and upload the visual field image information of the user when wearing the glasses-type augmented reality display terminal through the image acquisition unit, and the augmented reality display server can judge whether the user has the cognitive object identifier in the visual field range when wearing the glasses-type augmented reality display terminal according to a cognitive object identifier image recognition model generated by training based on a convolutional neural network algorithm in advance.
As another feasible scheme, a two-dimensional code image is arranged on the cognitive article identification terminal, and at this time, when the wearing glasses type augmented reality display terminal acquires the two-dimensional code image through the image acquisition unit and uploads the two-dimensional code image to the augmented reality display server, the augmented reality display server can directly determine that the cognitive article identification terminal exists in the visual field range of the user wearing the glasses type augmented reality display terminal.
And the cognitive article display information sending unit 430 is configured to determine cognitive article display information associated with the identification information according to the identification information, and send the cognitive article display information to the glasses-type augmented reality display terminal.
In the embodiment of the invention, the identification information of the identification end of the cognitive article and the display information of the cognitive article are pre-associated and stored on the augmented reality display server, so that the display information of the cognitive article associated with the identification information can be determined according to the identification information and then sent to the glasses type augmented reality display terminal to display the display information of the cognitive article, thereby realizing the cognitive function training of children.
FIG. 5 is a diagram illustrating an internal structure of a computer device in one embodiment. As shown in fig. 5, the computer apparatus includes a processor, a memory, a network interface, an input device, and a display screen connected through a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program that, when executed by the processor, causes the processor to implement an augmented reality based cognitive function training method. The internal memory may also have stored therein a computer program that, when executed by the processor, causes the processor to perform an augmented reality based cognitive function training method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, the augmented reality-based cognitive function training apparatus provided by the present application may be implemented in the form of a computer program, which is executable on a computer device as shown in fig. 5. The memory of the computer device may store various program modules constituting the apparatus, such as the cognitive article identifier presence determining unit 410, the identifier information determining unit 420, and the cognitive article display information transmitting unit 430 shown in fig. 4. The computer program of each program module causes the processor to execute the steps of the augmented reality based cognitive function training method of each embodiment of the present application described in the present specification.
For example, the computer device shown in fig. 5 may execute step S302 by the cognitive item identifier presence determination unit 410 in the augmented reality-based cognitive function training apparatus shown in fig. 4; the computer device may perform step S304 through the identification information determination unit 420; the computer device may perform step S306 through the cognitive item display information transmitting unit 430.
In one embodiment, a computer device is proposed, the computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
judging whether a cognitive article identification end exists in a visual field range when a user wears the glasses type augmented reality display terminal according to a preset rule;
when the cognitive article identification end exists, identification information of the cognitive article identification end is determined;
and determining cognitive article display information associated with the identification information according to the identification information, and sending the cognitive article display information to the glasses type augmented reality display terminal so that the glasses type augmented reality display terminal displays the cognitive article display information in an augmented reality mode.
In one embodiment, a computer readable storage medium is provided, having a computer program stored thereon, which, when executed by a processor, causes the processor to perform the steps of:
judging whether a cognitive article identification end exists in a visual field range when a user wears the glasses type augmented reality display terminal according to a preset rule;
when the cognitive article identification end exists, identification information of the cognitive article identification end is determined;
and determining cognitive article display information associated with the identification information according to the identification information, and sending the cognitive article display information to the glasses type augmented reality display terminal so that the glasses type augmented reality display terminal displays the cognitive article display information in an augmented reality mode.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in various embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (10)
1. A cognitive function training system based on augmented reality is characterized by comprising an augmented reality display server, a glasses type augmented reality display terminal and at least one cognitive article identification end; cognitive article display information associated with the identification information of the cognitive article identification end is stored in advance on the augmented reality display server end;
the augmented reality display server is used for judging whether a cognitive article identification end exists in a visual field range of a user wearing the glasses type augmented reality display terminal according to a preset rule, and determining identification information of the cognitive article identification end when judging that the cognitive article identification end exists; determining cognitive article display information associated with the identification information according to the identification information, and sending the cognitive article display information to a glasses type augmented reality display terminal;
the glasses type augmented reality display terminal is used for receiving the cognitive article display information sent by the augmented reality display server and displaying the cognitive article display information in an augmented reality mode.
2. The cognitive function training system according to claim 1, wherein an orientation determining unit is disposed on the glasses type augmented reality display terminal; a positioning communication unit is arranged on the cognitive article identification end in advance;
the glasses type augmented reality display terminal is used for determining user position information and visual field orientation information of a user wearing the glasses type augmented reality display terminal through the direction determining unit and sending the user position information and the visual field orientation information to the augmented reality display server;
the cognitive article identification end is used for determining the position information of the cognitive article identification end through the positioning communication unit and sending the position information and the identification information of the cognitive article identification end to the augmented reality display server end;
judging whether the user has the step of recognizing the article identification end in the visual field range when wearing the glasses type augmented reality display terminal according to the preset rule, and specifically:
and judging whether a cognitive article identification end exists in the visual field range of the user when the user wears the glasses type augmented reality display terminal or not according to the user position information, the visual field orientation information and the cognitive article identification end position information.
3. The cognitive function training system according to claim 1, wherein an image acquisition unit is arranged on the glasses type augmented reality display terminal;
the glasses type augmented reality display terminal is used for determining the visual field image information of a user wearing the glasses type augmented reality display terminal through the image acquisition unit and sending the visual field image information to the augmented reality display server;
judging whether the user has the step of recognizing the article identification end in the visual field range when wearing the glasses type augmented reality display terminal according to the preset rule, and specifically:
judging whether a cognitive article identification end exists in a visual field range when the user wears the glasses type augmented reality display terminal according to the visual field image information and a preset cognitive article identification end image recognition model; the preset cognitive article identification end image recognition model is generated in advance based on convolutional neural network model algorithm training.
4. The cognitive function training system according to claim 3, wherein a two-dimensional code image is arranged on the cognitive article identification end; the two-dimensional code image is associated with identification information of the cognitive article identification end;
the glasses type augmented reality display terminal is used for sending the two-dimensional code image to the augmented reality display server side when the two-dimensional code image arranged on the cognitive article identification terminal is read through the image acquisition unit;
judging whether a cognitive article identification end exists in the visual field range of the user when wearing the glasses type augmented reality display terminal according to a preset rule, and determining identification information of the cognitive article identification end when judging that the cognitive article identification end exists, wherein the steps are as follows:
and determining identification information of the cognitive article identification end associated with the two-dimensional code image according to the two-dimensional code image.
5. The cognitive function training system of claim 1, further comprising a cognitive item display information entry client;
the cognitive article display information input client is used for acquiring identification information of the cognitive article identification end; receiving cognitive article display information which is input by a user and is associated with the identification information, and sending the identification information of the cognitive article identification end and the associated cognitive article display information to an augmented reality display server end.
6. The cognitive function training system of claim 5, wherein the cognitive item presentation information comprises image presentation information and audio output information; a voice output unit is arranged on the cognitive article identification end; the method comprises the following steps of determining cognitive article display information associated with the identification information according to the identification information, and sending the cognitive article display information to a glasses type augmented reality display terminal, wherein the steps are as follows:
determining image display information and sound output information associated with the identification information according to the identification information; sending the image display information to a glasses type augmented reality display terminal, and sending the sound output information to a cognitive article identification end;
the cognitive article identification end is further used for outputting the sound output information through the voice output unit.
7. An augmented reality-based cognitive function training method, which is operated on an augmented reality display server in a cognitive function training system according to any one of claims 1 to 6, specifically comprising the steps of:
judging whether a cognitive article identification end exists in a visual field range when a user wears the glasses type augmented reality display terminal according to a preset rule;
when the cognitive article identification end exists, identification information of the cognitive article identification end is determined;
and determining cognitive article display information associated with the identification information according to the identification information, and sending the cognitive article display information to the glasses type augmented reality display terminal so that the glasses type augmented reality display terminal displays the cognitive article display information in an augmented reality mode.
8. An augmented reality-based cognitive function training device, which is arranged on an augmented reality display server in the cognitive function training system according to any one of claims 1 to 6, and specifically comprises the following units:
the cognitive article identification end existence judging unit is used for judging whether the cognitive article identification end exists in the visual field range when the user wears the glasses type augmented reality display terminal according to a preset rule;
the identification information determining unit is used for determining the identification information of the identification end of the cognitive article when judging that the cognitive article exists;
and the cognitive article display information sending unit is used for determining the cognitive article display information associated with the identification information according to the identification information and sending the cognitive article display information to the glasses type augmented reality display terminal so that the glasses type augmented reality display terminal displays the cognitive article display information in an augmented reality mode.
9. A computer device comprising a memory and a processor, the memory having stored thereon a computer program that, when executed by the processor, causes the processor to perform the steps of a method of augmented reality based cognitive function training as recited in claim 7.
10. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, causes the processor to carry out the steps of a method of augmented reality based cognitive function training as claimed in claim 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011583311.7A CN112598938A (en) | 2020-12-28 | 2020-12-28 | Cognitive function training system, method, device, equipment and storage medium based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011583311.7A CN112598938A (en) | 2020-12-28 | 2020-12-28 | Cognitive function training system, method, device, equipment and storage medium based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112598938A true CN112598938A (en) | 2021-04-02 |
Family
ID=75202875
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011583311.7A Pending CN112598938A (en) | 2020-12-28 | 2020-12-28 | Cognitive function training system, method, device, equipment and storage medium based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112598938A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113377204A (en) * | 2021-07-05 | 2021-09-10 | 深圳心颜科技有限责任公司 | Cognitive learning system, method, computer equipment and storage medium |
| CN113952583A (en) * | 2021-12-22 | 2022-01-21 | 山东省心岛人工智能科技有限公司 | Cognitive training method and system based on VR technology |
| US11886767B2 (en) | 2022-06-17 | 2024-01-30 | T-Mobile Usa, Inc. | Enable interaction between a user and an agent of a 5G wireless telecommunication network using augmented reality glasses |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102799761A (en) * | 2012-06-20 | 2012-11-28 | 惠州Tcl移动通信有限公司 | Augmented reality method and system used for mobile communication terminal |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN106340213A (en) * | 2016-08-19 | 2017-01-18 | 苏州七彩部落网络科技有限公司 | Method and device for realizing assisted education through AR |
| CN107798932A (en) * | 2017-12-08 | 2018-03-13 | 快创科技（大连）有限公司 | A kind of early education training system based on AR technologies |
| CN108877340A (en) * | 2018-07-13 | 2018-11-23 | 李冬兰 | A kind of intelligent English assistant learning system based on augmented reality |
| CN109087172A (en) * | 2018-08-08 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | Commodity identifying processing method and device |
| CN109213728A (en) * | 2017-06-29 | 2019-01-15 | 深圳市掌网科技股份有限公司 | Cultural relic exhibition method and system based on augmented reality |
| US10347254B2 (en) * | 2012-09-18 | 2019-07-09 | Qualcomm Incorporated | Leveraging head mounted displays to enable person-to-person interactions |
| CN110400388A (en) * | 2019-07-02 | 2019-11-01 | 上海德衡数据科技有限公司 | A kind of intelligent inspection system based on augmented reality |
-
2020
- 2020-12-28 CN CN202011583311.7A patent/CN112598938A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102799761A (en) * | 2012-06-20 | 2012-11-28 | 惠州Tcl移动通信有限公司 | Augmented reality method and system used for mobile communication terminal |
| US10347254B2 (en) * | 2012-09-18 | 2019-07-09 | Qualcomm Incorporated | Leveraging head mounted displays to enable person-to-person interactions |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN106340213A (en) * | 2016-08-19 | 2017-01-18 | 苏州七彩部落网络科技有限公司 | Method and device for realizing assisted education through AR |
| CN109213728A (en) * | 2017-06-29 | 2019-01-15 | 深圳市掌网科技股份有限公司 | Cultural relic exhibition method and system based on augmented reality |
| CN107798932A (en) * | 2017-12-08 | 2018-03-13 | 快创科技（大连）有限公司 | A kind of early education training system based on AR technologies |
| CN108877340A (en) * | 2018-07-13 | 2018-11-23 | 李冬兰 | A kind of intelligent English assistant learning system based on augmented reality |
| CN109087172A (en) * | 2018-08-08 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | Commodity identifying processing method and device |
| CN110400388A (en) * | 2019-07-02 | 2019-11-01 | 上海德衡数据科技有限公司 | A kind of intelligent inspection system based on augmented reality |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113377204A (en) * | 2021-07-05 | 2021-09-10 | 深圳心颜科技有限责任公司 | Cognitive learning system, method, computer equipment and storage medium |
| CN113952583A (en) * | 2021-12-22 | 2022-01-21 | 山东省心岛人工智能科技有限公司 | Cognitive training method and system based on VR technology |
| CN113952583B (en) * | 2021-12-22 | 2022-04-08 | 山东省心岛人工智能科技有限公司 | Cognitive training method and system based on VR technology |
| US11886767B2 (en) | 2022-06-17 | 2024-01-30 | T-Mobile Usa, Inc. | Enable interaction between a user and an agent of a 5G wireless telecommunication network using augmented reality glasses |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112598938A (en) | Cognitive function training system, method, device, equipment and storage medium based on augmented reality | |
| US11238272B2 (en) | Method and apparatus for detecting face image | |
| CN113038287B (en) | Method and device for realizing multi-user video live broadcast service and computer equipment | |
| CN111787242B (en) | Method and apparatus for virtual fitting | |
| CN111476871B (en) | Method and device for generating video | |
| US11790064B2 (en) | Motion-based credentials using magnified motion | |
| CN109993150B (en) | Method and device for identifying age | |
| CN109309842B (en) | Live broadcast data processing method and device, computer equipment and storage medium | |
| CN112527115B (en) | User image generation method, related device and computer program product | |
| CN112423022A (en) | Video generation and display method, device, equipment and medium | |
| CN111950056B (en) | BIM display method and related equipment for building informatization model | |
| CN113870133B (en) | Multimedia display and matching method, device, equipment and medium | |
| CN110059623B (en) | Method and apparatus for generating information | |
| US11934643B2 (en) | Analyzing augmented reality content item usage data | |
| US11574005B2 (en) | Client application content classification and discovery | |
| CN108983974B (en) | AR scene processing method, device, equipment and computer-readable storage medium | |
| CN111340865B (en) | Method and apparatus for generating image | |
| US20200195518A1 (en) | Computer system, remote control notifacation method and program | |
| CN114842120A (en) | Image rendering processing method, device, equipment and medium | |
| CN107622241A (en) | Display methods and device for mobile device | |
| KR102293416B1 (en) | Communication device, server and communication method thereof | |
| CN109523360B (en) | Information recommendation method and system | |
| Delabrida et al. | Towards a wearable device for monitoring ecological environments | |
| CN116193187A (en) | Page display method, page display device, electronic device, storage medium and program product | |
| US20230289560A1 (en) | Machine learning techniques to predict content actions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210402 |