KR102272837B1 - multi table type cognitive training device using artificial intelligence and method for driving the same - Google Patents

Abstract

The present invention discloses a multi table type cognitive training device using artificial intelligence and a method for driving the same. The multi table type cognitive training device disclosed in the present invention comprises: a display unit including a touch panel for displaying content games for providing cognitive training or cognitive stimulation to a user and a plate on which the touch panel is seated; a base unit for supporting the display unit; and a management system for controlling the base unit. In addition, the management system of the present invention comprises: a first sensor unit disposed along a periphery of a side surface of the display unit to obtain location information of the user; a second sensor unit disposed inside a display area corresponding to a display area of the display unit to obtain face information of the user; a third sensor unit disposed along a non-display area between the touch panel and the plate of the display unit to obtain a position of a user's marker and information included in the marker; and a fourth sensor unit in an upper space of the display unit to obtain movement information of a user who plays a content game.

Description

Multi table type cognitive training device using artificial intelligence and method for driving the same

The present invention relates to a multi-table type cognitive training apparatus using artificial intelligence, and more particularly, artificial intelligence that allows a plurality of users to be provided with cognitive training and cognitive stimulation as a content game at the same time. It relates to a multi-table type cognitive training apparatus using and a driving method thereof.

As the life expectancy of people is significantly extended, the incidence of geriatric diseases is also rapidly increasing. According to US statistics, the death rate from major diseases such as cancer and cardiovascular disease has been steadily decreasing due to improved treatment methods, but it is reported that the death rate from dementia is continuously increasing.

In fact, according to the Alzheimer's Association of America, the death rate from dementia has increased by 89% since 2000. With the aging population, the incidence of dementia is also increasing, and the cause of dementia is still unknown. However, the information related to dementia known so far is as follows.

When analyzing the brains of dementia patients, a representative example was the fact that agglomerated masses (plaques) of amyloid beta protein were observed as a kind of waste product along the periphery of brain cells. Based on this, studies to remove amyloid beta have been actively conducted at one time, but it has not been established as an alternative to solving dementia. This is because, in many cases, people's cognitive ability did not improve even if amyloid beta was removed, and even those with many plaques (clumps) did not have dementia.

In addition, it has been reported that people with early dementia are more likely to recover from dementia through continuous cognitive training and cognitive stimulation rather than treatment with the aforementioned drugs.

For this reason, many complex stimulation devices and methods for preventing dementia by providing physical activity and brain stimulation at the same time have been proposed, and Korean Patent Laid-Open No. 2009-0067578 is also one of these technologies. In this technology, game content such as language, math, common sense, etc. is provided to the user through a monitor, and when the user takes a specific reaction action according to the instruction of the provided content, the result is fed back to the user.

The advantage of this technology is that it can increase the concentration of education in that it can provide users with various types of content games visually. However, it stores the results of repeated tests without user information and provides content for each level. way to provide

In addition, the technology of Korean Patent Laid-Open No. 2009-0067578 is limited to individual dementia patients because it is a method to provide brain stimulation to a specific user using game contents. In other words, there is a problem that people with similar dementia conditions cannot provide cognitive ability training or cognitive stimulation in a cooperative way.

Republic of Korea Patent Publication No. 2009-0067578

An object of the present invention is to provide a multi-table type cognitive training apparatus using artificial intelligence that can provide cognitive training and cognitive stimulation along with visual, auditory and physical movements in various ways to a patient with dementia or a patient with low cognitive ability and a driving method thereof is in providing.

In addition, it is an object of the present invention to provide a multi-table type cognitive training apparatus using artificial intelligence, and a method for driving the same, in which a plurality of dementia patients or patients with low cognitive ability can simultaneously receive cognitive training and cognitive stimulation in a cooperative manner. .

In addition, it is an object of the present invention to recognize players through a learning model by deep learning, and then a multi-table using artificial intelligence to enable the game area set for each player to move in the display area following the moving player during the game. To provide a type cognitive training apparatus and a driving method thereof.

Another object of the present invention is to provide a multi-table type cognitive training apparatus using artificial intelligence capable of providing content games suitable for each level to a plurality of dementia patients or patients with low cognitive ability, and a method for driving the same.

In addition, it is an object of the present invention to provide stimulation for various sensory organs such as sight, hearing, and touch by providing various events when a dementia patient or a patient with low cognitive ability plays a content game to receive cognitive training or cognitive stimulation An object of the present invention is to provide a multi-table type cognitive training apparatus and a driving method thereof using artificial intelligence that can do this.

The multi-table type cognitive training apparatus of the present invention includes: a display unit including a touch panel for displaying content games for providing cognitive training or cognitive stimulation to a user and a plate on which the touch panel is seated; and a base unit supporting the display unit and a management system controlling the display unit and the base unit.

In addition, the management system of the present invention, the first sensor unit disposed along the periphery of the side of the display unit to obtain the location information of the user; a second sensor unit disposed on the inside corresponding to the display area of the display unit to obtain face information of the user; a third sensor unit disposed along a non-display area between the touch panel and the plate of the display unit to obtain a position of a user's marker and information included in the marker; and a fourth sensor unit configured to obtain movement information of a user who plays a content game in an upper space of the display unit.

In addition, the base unit of the present invention, while supporting the display unit, the display unit up-and-down movement, rotation movement and tilt movement of the first support portion; and a second support part disposed below the first support part and in contact with the ground, wherein the management system includes a user's face information image provided from the second sensor part and a user's movement provided from the fourth sensor part It is characterized in that the position of the player playing the content game is tracked based on the information image, and the game area on the display area provided to the user is moved to proceed with the content game based on the tracked location information.

In addition, the management system of the multi-table type cognitive training apparatus of the present invention, touch information is input and a display unit for displaying the content game; a storage unit for storing information on content games and information on users; a driving unit that moves the display unit up and down, rotates and tilts; a content providing unit that provides a content game for cognitive ability training and a content game for cognitive stimulation training to the user and tracks the location of the user who plays the content game; a recognition unit for recognizing a touch pattern based on the touch information input through the display unit; and a determination unit that selects only a touch pattern related to a content game currently being played from among the touch patterns recognized by the recognition unit.

In addition, the content providing unit may include: a first cognitive content unit providing a content game for cognitive ability training to the user; a second cognitive content unit providing a content game for cognitive stimulation training to the user; and a tracking unit for recognizing and locating players who play content games using a learning model built by deep learning and moving the game area set in the player on the display area corresponding to the current player's location do.

In addition, the tracking unit, the face recognition unit for recognizing the face of the player; a motion recognition unit for recognizing movements when the player plays a game; a learning model for recognizing a player based on the image provided by the face recognition unit and the motion recognition unit and identifying the position thereof; and a region moving unit for moving the game region to the current player's position based on the player's information recognized by the learning model and the recognized player's position information.

In addition, the multi-table type cognitive training apparatus of the present invention, a plurality of air nozzles for providing tactile stimulation to the user by spraying air to the display unit; a speaker unit for outputting sound to the base unit; and a vibrator for providing movement to a user by vibrating the display unit.

In addition, the driving method of the multi-table type cognitive training apparatus of the present invention, a display unit having a touch panel for displaying content games and a plate on which the touch panel is seated; A method of driving a multi-table type cognitive training apparatus comprising a base unit supporting the display unit and a management system for controlling the display unit and the base unit, wherein the multi-table type cognitive training apparatus is operated by the management system obtaining face information images of a plurality of users who play the content game; acquiring motion information images of a plurality of users who play the content game; extracting images of users using a learning model built by deep learning based on the images of face information and motion information of the users; comparing the extracted user's image information with the user's face information before playing the content game, and selecting users who are currently playing the content game; comparing the extracted user image information with a motion image of a user before playing the current content game to determine users who currently play in the content game among the selected users; After identifying the locations of the determined users, moving the game areas set for a plurality of users who play the first content game in the display area of the display unit to the location of the user currently playing the content game It is characterized in that the operation is performed.

The multi-table type cognitive training apparatus and its driving method using artificial intelligence of the present invention have the effect of providing cognitive training and cognitive stimulation along with visual, auditory and physical movements to dementia patients or patients with low cognitive ability in various ways. have.

In addition, the multi-table type cognitive training apparatus and driving method using artificial intelligence of the present invention has an effect that a plurality of dementia patients or patients with low cognitive ability can receive cognitive training and cognitive stimulation in a cooperative manner at the same time.

In addition, the multi-table type cognitive training apparatus and its driving method using artificial intelligence of the present invention recognize players through a learning model by deep learning, and then the game area set for each player follows the moving player while the game is in progress. It has the effect of being able to move in the display area.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention have the effect of providing content games suitable for each level to a plurality of dementia patients or patients with low cognitive ability.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention provide various events when a dementia patient or a patient with low cognitive ability plays a content game to receive cognitive training or cognitive stimulation. It has the effect of providing stimulation to various sensory organs such as , hearing, and touch.

1 is a diagram showing how users use the multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.
2 is a perspective view showing the structure of a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.
3 is a block diagram of a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.
4A to 4D are diagrams illustrating a state in which a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention provides a play area according to the number of users.
5 is a diagram for explaining a process of recognizing a user or an object based on a touch input input to a display unit by the multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.
6 to 8 are diagrams for explaining the principle of recognizing a user using a multi-table type cognitive training apparatus using artificial intelligence and an object used in a provided content game according to an embodiment of the present invention.
9 is a diagram for explaining a user's touch operation and an object operation of content in the multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.
10 is a diagram illustrating a state in which a multi-table type cognitive training apparatus using artificial intelligence recognizes a touch position of a display area according to an embodiment of the present invention.
11 is a diagram illustrating a state in which a possible touch pattern CP is estimated from the touch contact units TC input to the display area DA.
12 is a diagram illustrating a touch ID corresponding to touch information such as the touch contact unit TC.
13 is a diagram in which a function corresponding to a touch ID is applied to a content game played in the display area DA.
14 is a block diagram illustrating a detailed configuration of a recognition unit of a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.
15 is a block diagram illustrating a detailed configuration of a driving unit of a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.
16 is a view for explaining the operation of the display unit and the event provision of the multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.
17 is a block diagram showing the structure of the content providing unit of the multi-table type cognitive training apparatus using artificial intelligence of the present invention.
18 is a block diagram illustrating a structure of a tracking unit disposed in the content providing unit of FIG. 17 .
19 is a diagram illustrating a state in which the multi-table type cognitive training apparatus using artificial intelligence according to the present invention tracks a player who plays a content game.

Since the present invention can apply various transformations and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. Effects and features of the present invention, and a method of achieving them, will become apparent with reference to the embodiments described below in detail in conjunction with the drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various forms. In the following embodiments, terms such as first, second, etc. are used for the purpose of distinguishing one component from another, not in a limiting sense. Also, the singular expression includes the plural expression unless the context clearly dictates otherwise. Also, terms such as include or have means that the features or components described in the specification are present, and do not preclude the possibility that one or more other features or components will be added. In addition, in the drawings, the size of the components may be exaggerated or reduced for convenience of description. For example, since the size and thickness of each component shown in the drawings are arbitrarily indicated for convenience of description, the present invention is not necessarily limited to the illustrated bar.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, and when described with reference to the drawings, the same or corresponding components are given the same reference numerals, and the overlapping description thereof will be omitted. .

1 is a diagram showing how users use the multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention. 2 is a perspective view showing the structure of a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.

1 and 2, the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention includes a display unit 100a and a base unit 100b supporting the display unit 100a. The display unit 100a includes a display area DA that provides various content games to a user and a non-display area NDA disposed along the periphery of the display area DA. A display panel capable of displaying a content game may be disposed in an area corresponding to the display area DA. The display panel may be a touch screen panel (TSP) implemented with a liquid crystal display (LCD) or an organic light emitting display (OLED). In addition, the multi-table type cognitive training apparatus 100 of the present invention is a personal computer, laptop, notebook, netbook or tablet, personal digital assistant (PDA), navigation, home appliance (home appliance), image processing It may be implemented in a device, such as a device, a smartphone, a 3D TV, or a digital information display (DID). In particular, each of the components of the present invention may be operated within a processor and a memory disposed within the devices described above.

Recognition means for recognizing a user may be disposed in the non-display area NDA. For example, a plurality of authentication pads N1 , N2 , N3 , and N4 for checking information of a user who uses a content game may be disposed. The authentication pads N1, N2, N3, and N4 may function to recognize a card including a user's unique identifier information and provide a customized content game based on the recognized user's information. In addition, when the first to fourth authentication pads N1, N2, N3, and N4 recognize different information for a plurality of users, based on this, a content game that a plurality of users can play together can be recommended or provided. have. That is, the multi-table type cognitive training apparatus 100 of the present invention provides a cognitive training content game or a cognitive stimulation content game required for each of a plurality of users, or recommends and provides a content game that a plurality of users can play together. can do.

In addition, the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention provides a content game performed by a plurality of users (P1, P2, P3, P4) together or each content game suitable for individual users. , the display area DA may be divided into first to fourth game areas 110a, 110b, 110c, and 110d.

A plurality of users (players: P1, P2, P3, P4) may place a marker M in their divided first to fourth game areas 110a, 110b, 110c, and 110d, respectively, and play a content game. Also, the display area DA may include a common display area CDA. The common display area CDA is commonly applied to all of the plurality of users (players: P1, P2, P3, P4) when a plurality of users (players: P1, P2, P3, P4) play one content game together. It may be a game area. Also, when a plurality of users (players: P1, P2, P3, P4) play an individual content game, it may be an area commonly used by individual content games.

Referring to FIG. 2 , the display unit 100a of the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention may be implemented in the form of a rectangular plate or a table. The upper surface of the display unit 100a includes a display area DA and a non-display area NDA for displaying content games. In addition, the first sensor unit 130a in which a plurality of sensors are arranged at regular intervals may be disposed on four sides of the display unit 100a. The first sensor unit 130a functions to obtain location information of a user for playing a content game. Accordingly, the sensors constituting the first sensor unit 130a may be any one or a mixture of at least one of an ultrasonic sensor, an infrared sensor, a LIDAR sensor, a radar sensor, and a camera sensor.

A second sensor unit 130b capable of acquiring face information (facial information) of users (players) may be disposed in the display area DA of the display unit 100a. In the drawing, four sensors are disposed in areas corresponding to each corner of the display unit 100a having a rectangular structure, but this may be changed according to the number of a plurality of users playing a content game. For example, when six players play a content game, the number of sensors constituting the second sensor unit 130b may be six or more.

The third sensor unit 130c may be disposed on an upper surface corresponding to each corner of the non-display area NDA of the display unit 100a. When the ID card including the user's unique identifier information is placed, the third sensor unit 130c obtains information on the ID card of the user (player) to provide a content game or a play area in which to play the content game according to the number of ID cards can be used to partition Also, the third sensor unit 130c may serve to recognize the presence or absence of a player who is currently playing a content game provided based on a state in which the player's ID card is placed. In particular, the area of the third sensor unit 130c may partially overlap the display area DA.

In the non-display area NDA of the display unit 100a, first to fourth authentication pads N1, N2, N3, and N4 may be disposed. Although they are respectively arranged in the four corner areas of the display unit 100a in the drawing, this is not fixed. In particular, even if the user marker M sequentially contacts the authentication pad by the control unit connected to the first to fourth authentication pads N1, N2, N3, and N4, information including unique identifier information for each user is drawn. If possible, only one authentication pad (N) may be disposed.

In addition, in the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention, the fourth sensor unit 130d may be disposed in the space above the display unit 100a. The fourth sensor unit 130d may continuously acquire subject information of players who play the content game and reflect it in the content game, or obtain movement information of a player (user) and use it as information for determining the player's cognitive ability. A sensor constituting the fourth sensor unit 130d may be formed of a charge coupled device (CCD) or a complementary metal semiconductor (CMOS).

The base unit 100b includes a first support 120 that supports the display unit 100a and can vertically move, rotate, and tilt the display unit 100a, and is disposed below the first support 120 . and a second support 121 in contact with the . Components for controlling the operation of the multi-table type cognitive training apparatus 100 to be described later may be disposed inside the first support unit 120 . In addition, the second support part 121 may include a plurality of bridge parts so as to distribute the loads of the display unit 100a and the first support part 120 while being coupled to the first support part 120 . As shown in the drawing, the moving means 123 may be disposed on each bridge unit.

In addition, although not specifically illustrated in FIGS. 1 and 2 , the display unit 100a may be disposed in a horizontal direction or may be disposed in a vertical inclination direction by the first support unit 120 . Accordingly, the first support unit 120 may be coupled to the rear surface of the display unit 100a and a shaft capable of moving in the vertical direction may be disposed. The shaft may perform an up/down operation in the vertical direction by the power provided by the driving unit, and the display unit 100a is placed on the ground in response to the up/down operation of the shaft. It may be erected in a vertical direction or inclined to have a predetermined angle with respect to the ground.

As such, when the display unit 100a is erected or inclined, it can be used in a content game in which players are positioned on both sides with the display unit 100a interposed therebetween.

In addition, the display unit 100a may be provided with an event providing unit capable of providing a vivid sense of presence to players in the process of playing a content game. The event providing unit may be composed of a plurality of air nozzles or vibration motion or an intelligent speaker.

As described above, the multi-table type cognitive training apparatus and driving method using artificial intelligence of the present invention can provide cognitive training and cognitive stimulation along with visual, auditory and physical movements to dementia patients or patients with low cognitive ability in various ways. there is an effect

In addition, the multi-table type cognitive training apparatus and driving method using artificial intelligence of the present invention has an effect that a plurality of dementia patients or patients with low cognitive ability can receive cognitive training and cognitive stimulation in a cooperative manner at the same time.

In addition, the multi-table type cognitive training apparatus and its driving method using artificial intelligence of the present invention recognize players through a learning model by deep learning, and then the game area set for each player follows the moving player while the game is in progress. It has the effect of being able to move in the display area.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention have the effect of providing content games suitable for each level to a plurality of dementia patients or patients with low cognitive ability.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention provide various events when a dementia patient or a patient with low cognitive ability plays a content game to receive cognitive training or cognitive stimulation. It has the effect of providing stimulation to various sensory organs such as , hearing, and touch.

3 is a block diagram of a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention. 4A to 4D are diagrams illustrating a state in which a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention provides a play area according to the number of users. 5 is a view for explaining a process of recognizing a user or an object based on a touch input input to the display unit by the multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention. 6 to 8 are diagrams for explaining a principle of recognizing a user using a multi-table type cognitive training apparatus using artificial intelligence and an object used in a provided content game according to an embodiment of the present invention. 9 is a diagram for explaining a user's touch operation and an object operation of content in the multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention. 10 is a diagram illustrating a state in which a multi-table type cognitive training apparatus using artificial intelligence recognizes a touch position of a display area according to an embodiment of the present invention. 11 is a diagram illustrating a state in which a possible touch pattern CP is estimated from the touch contact units TC input to the display area DA, and FIG. 12 is touch information such as the touch contact unit TC. It is a diagram showing a touch ID corresponding to , and FIG. 13 is a diagram in which a function corresponding to the touch ID is applied to a content game played in the display area DA.

Referring to FIGS. 3 to 13 together with FIG. 2 , the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention includes a display unit 100a and a base unit 100b.

The multi-table type cognitive training apparatus 100 of the present invention may recognize users who play in order to provide a customized content game to the user or recognize tools used in the content game. In addition, the multi-table type cognitive training apparatus 100 of the present invention may provide customized cognitive training or a cognitive stimulation content game, respectively, according to the degree of cognitive ability for a plurality of users. The multi-table type cognitive training apparatus 100 includes first to fourth sensor units 130a, 130b, 130c, 130d, an input unit 301, a storage unit 302, a driving unit 303, a content providing unit 304, It may be operated by a management system including a control unit 305 , a recognition unit 306 , a determination unit 307 , and a display unit 308 .

As described above, the first sensor unit 130a acquires distance and location information between the user and the multi-table type cognitive training apparatus 100 for cognitive ability training, and the second sensor unit 130b allows the user to play a content game. Acquires facial (face) information before and after playing in a state positioned at one's place to play, and the third sensor unit 130c is a marker including an ID card containing user information or a card containing object information. The position of (M) and the information of the marker (M) are obtained, and the fourth sensor unit 130d obtains movement information of players (users) who play the content game.

In particular, the second sensor unit 130b and the fourth sensor unit 130d may include a camera including a color image sensor and a depth image sensor. In some embodiments, the depth image sensor may provide a depth image in which depth information of a scene is expressed as, for example, a 16-bit integer in units of [mm]. The number of bits for expressing depth information is not limited to 16 bits and may be changed, and may be provided in a real number type without being limited to an integer type. The depth image sensor may measure the distance from the camera to the object and the background by using infrared rays or the like to provide a depth image having a value proportional to or inversely proportional to the distance.

The pixel value of the depth image may be, for example, an integer of [mm] unit (but not limited thereto), instead of RGB color information.

The color image sensor is a device for acquiring a color image, and may be, for example, a complementary metal-oxide-semiconductor (CMOS) image sensor, a charge-coupled device (CCD) image sensor, or a stereo camera. The depth sensor may be a kinect, a time-of-flight (TOF) depth camera, or an optical 3D scanner, or the like.

The input unit 301 may include a touch screen panel because touch information may be input through the display unit 308 . Accordingly, the input unit 301 receives the information provided through the first to fourth sensor units 130a, 130b, 130c, and 130d and the display unit 308, prior information about the user, and information related to content games (pattern information). may be provided. Also, the input unit 301 may be implemented integrally with the display unit 308 .

The storage unit 302 may include information about content games and information about users. For example, when the user performs a test to determine the degree of dementia in advance, result information thereof may be stored. Information on content games may include information on characters played in each game and information on operations that can be performed in each game. The storage unit 302 may include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, or an optical data storage device. . Storage 302 also includes instructions (eg, executable instructions), such as computer readable instructions or processor readable instructions. The instructions may include one or more instructions executable by a computer, such as by each of one or more processors.

For example, the one or more instructions may be executable by the one or more processors to perform operations comprising: determining a motion vector of the depth image and processing the depth image to encode the depth image. have.

As described above, the driving unit 303 physically moves the display unit 100a constituting the multi-table type cognitive training apparatus 100 or the first to fourth sensor units 130a, 130b, 130c, and 130d. It is possible to provide power to move the constituting sensors.

The content providing unit 304 may provide content games prepared for cognitive ability training and content games prepared for cognitive stimulation.

The recognizer 306 may recognize and analyze touch patterns based on the touch information provided from the display 308 , and then recognize an object corresponding to the analyzed pattern. Also, the recognizer 306 may recognize touch information provided by the player as well as touch information of a marker disposed on an object.

The determination unit 307 may obtain patterns and object information corresponding to the patterns recognized through the display unit 308 or filter the recognized patterns but not related to the content game currently in progress. In this way, by combining the selected object recognition information and the touch information provided from the player through the display unit 308, it is possible to finally determine which command is for which object.

Also, the recognition unit 306 and the determination unit 307 may determine the content games to be provided based on the number of users who will play the content game and information on the users. For example, when a plurality of users are authenticated by the multi-table type cognitive training apparatus 100, an individually customized content game may be provided based on the information of each user, or a content game that a plurality of users may progress together may be provided. .

Also, the recognition unit 306 and the determination unit 307 may divide the display area DA into a plurality of areas to correspond to a plurality of authenticated users, and then provide a game area to each user. At this time, the information input through the first to fourth sensor units 130a, 130b, 130c, 130d is synthesized without dividing the display area DA only when the user's marker is simply authenticated through the authentication pads. Split.

In particular, the multi-table type cognitive training apparatus 100 of the present invention includes a second sensor unit 130b and a fourth sensor unit when a plurality of users need to move along the circumference of the display unit 100a when a content game is played. Using 130d, a plurality of users (players) may be individually recognized and their positions may be tracked. In this way, when a player is recognized and tracked based on the image provided by the second sensor unit 130b and the fourth sensor unit 130d, when starting the first content game, the divided game area set for each player is displayed You can move to the position of the player along the edge of the area DA.

Accordingly, the player does not need to return to his/her initially set divided game area when there is a movement in the process of playing the content game. If the divided game areas set for a plurality of users (players) overlap each other, the game area is the closest area using the ultrasonic sensor information of the first sensor unit 130a and is the game area immediately adjacent to the player's game area. can be located. For example, if the second player is in the position of the fourth player in the process of playing the content game, the second player is placed in the adjacent area of the fourth player's game area so as not to overlap the fourth player's game area so that the next play can be performed do.

As described above, since the input unit 301 may be integrally formed with the display unit 308 , the control unit 305 , the storage unit 302 , the driving unit 303 , the content providing unit 304 , and the recognition unit 306 . , the determination unit 307 may be disposed in the base unit 100b of the multi-table type cognitive training apparatus 100 .

4A to 4D, the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention divides the display area DA into a plurality of divided display areas ( game area).

When there are two users to perform cognitive ability training or cognitive stimulation training through a content game, as shown in FIG. 4A , the display area DA is divided into an A1 game area and an A2 game area. Two users can play different content games in the divided game areas A1 and A2 or play one content game simultaneously in their own game areas.

As described above, in the case of a cooperative game or a competitive game in which one content game is played together, the user may move along the circumference of the display unit 100a while playing the game. In the multi-table type cognitive training apparatus 100 of the present invention, the divided game areas A1 and A2 may recognize and track the user to move the game area to a location corresponding to the current player's location. Accordingly, the player (user) playing the content game may proceed with the next play from the moving position without returning to the initially set divided game areas A1 and A2.

When there are three users to perform cognitive ability training or cognitive stimulation training through a content game, as shown in FIG. 4B , the display area DA is divided into an A1 area, an A2 game area, and an A3 game area. When there are four users to perform cognitive ability training or cognitive stimulation training through a content game, as shown in FIG. 4C , the display area DA is an A1 game area, A2 game area, A3 game area, and A4 game area. divided into regions. When there are five users to perform cognitive ability training or cognitive stimulation training through a content game, as shown in FIG. 4D , the display area DA is an A1 game area, A2 game area, A3 game area, and A4 game area. It is divided into area and A5 game area.

In addition, as described above, in the case of a cooperative game or a competitive game in which 3, 4, or 5 players play one content game together, when users move while playing the game, the divided game areas A1, A2, A3 , A4, A5) can move by tracking the direction of movement of the users. Accordingly, players (users) who play the content game can continuously play the next play from the play position without returning to the initially set or previously located game area.

The multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention may recognize an object such as a tool used in a content game or a marker M that can identify a user (player).

5 is a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention may recognize a user's marker or a marker of a tool used in a game. User markers or tool markers consist of physical objects. That is, it can be seen as recognition of an object rather than recognition of a part of the user's body.

Accordingly, the user marker M and the marker M attached to the tool include a touch point TP that provides touch information to the display unit 100a. The size of the touch point TP, the location of the touch point TP, and the number of touch points TP may be different for each marker M.

Referring to (a) of FIG. 5 , when three touch points TP are disposed on the marker M and each touch point TP is connected, a triangular pattern implemented by the touch points TP can be obtained. have. Also, the area of each of the three touch points TP may be the same or at least one may be different. As shown in the drawing, the area occupied by the touch point TP is the touch area TA, the touch pattern CP formed by the connection of the touch points TP, and the area of the touch pattern CP is the pattern area. (PA) is defined as a direction TD of a touch point related to direction information for each touch point TP.

The multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention may obtain information provided by each marker M by analyzing the touch points TP disposed on the marker M. For example, figure information on whether the touch pattern CP is a triangle, a rectangle, or a pentagon may be acquired by using the touch point TP disposed on one marker M. That is, the multi-table type cognitive training apparatus 100 of the present invention may acquire information on the size and shape of a figure constituting the touch pattern CP. Also, information on the touch area TA for each touch point TP may be acquired. Also, with respect to the figure constituting the touch pattern CP, information on the direction of the touch point TP corresponding to each vertex may be obtained. For example, in the triangle of FIG. 5 (a), if a virtual coordinate axis is formed in the center perpendicular to each other, the upper vertex is the north (N), the lower left touch point (TP) is the southwest (SW), and the lower right touch point ( TP) may acquire the direction information TD of the touch point like the southeast SE.

In this way, the multi-table type cognitive training apparatus using artificial intelligence of the present invention can distinguish each marker M based on various information provided by the touch points TP disposed on the marker.

In addition, the multi-table type cognitive training apparatus using artificial intelligence of the present invention is based on the touch area of the touch points TP disposed on the marker, and the direction of the touch point TP located at each vertex of the touch pattern CP. Markers can be distinguished from each other.

6 illustrates a principle of recognizing a marker M of a user using a content game provided by the multi-table type cognitive training apparatus 100 . Users who play a content game for cognitive ability training or a content game for cognitive stimulation are provided with a marker M so that they can be recognized as a player in the game. The marker M may be recognized by the authentication pads N1 , N2 , N3 , N4 of the above-described multi-table type cognitive training apparatus 100 or recognized by the marker recognition unit of the display unit 100a. As described above, each of the markers M provided to a plurality of users may be composed of touch points TP having different numbers and shapes, respectively.

As shown in FIGS. 6A to 6E , the same number of touch points TP are disposed in the first marker M1 and the second marker M2. However, the first marker M1 has a structure in which each of the touch points TP is disposed in a corner area adjacent to the touch point TP disposed at the edge of the first marker M1. , and the second marker M2 has a structure in which the touch points TP are disposed at both corners and the center of the second marker M2, respectively. Accordingly, the first marker M1 and the second marker M2 have different positions of the touch points TP, and the shape (figure shape) of the touch pattern CP based on the touch points TP disposed at each marker is also shown. It changes. Based on this information, the multi-table type cognitive training apparatus 100 of the present invention distinguishes the first marker M1 and the second marker M2.

Although only the first and second markers M1 and M2 on which the three touch points TP are disposed are illustrated in the drawing, a plurality of markers M including the three touch points TP may be formed. When there are a plurality of markers M composed of three touch points TP, it may be difficult to accurately distinguish only the position of the touch point TP and the shape of the touch panel CP. In this case, the touch area TA for each of the touch points TP disposed on each marker M is made different from each other, or any one or two of the three touch points TP is set to a different type of touch point TP. ) can be implemented. For example, one of the three touch points TP may be formed in a circle, and the other two may be formed in an ellipse or a triangle (or a rectangular structure), respectively.

Referring to FIGS. 6C and 6D , four touch points TP are disposed on the third marker M3 and the fourth marker M4 . The touch points TP of the third marker M3 are respectively disposed at four corners of the third marker M3 , and the touch points TP of the fourth marker M4 are located on one side of the fourth marker M4 . Two touch points TP are disposed at both corners, and two touch points TP are disposed between both edges of the other side facing one side. Accordingly, the touch pattern CP formed by the touch points TP of the third marker M3 has the same rectangular pattern as the shape of the third marker M3 and the touch point TP of the fourth marker M4. The touch pattern CP formed by the elements has a trapezoidal shape. That is, since the number of touch points TP disposed on the third marker M3 and the fourth marker M4 is the same, but the shape of the touch pattern CP is different, the two markers M3 and M4 are different markers. can be recognized. As described above, when there are a plurality of markers M composed of four touch points TP, the touch areas TA of the four touch points TP are formed differently, or the touch areas TA of the four touch points TP are formed differently. By combining the location coordinate information, the markers M may be recognized differently.

The fifth marker M5 of FIG. 6E has five touch points TP, and the touch pattern CP formed by these touch points TP has a pentagonal structure. Accordingly, the first to fourth markers M1 , M2 , M3 , and M4 of (a) to (d) may be distinguished from each other because the shape of the touch pattern CP is different. As described above, when there are a plurality of markers M composed of five touch points TP, the touch areas TA of the five touch points TP are formed differently, or the touch areas TA of the five touch points TP are formed differently. By combining the location coordinate information, the markers M may be recognized differently.

7 is a marker (M) for recognizing a tool (horse) used in a chess game when a chess game is provided among the content games provided by the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention. can be attached.

In a chess game, pieces consisting of king, queen, bishop, knight, rook, and pawn are placed on both sides of 64 squares to catch the opponent's king. Therefore, the multi-table type cognitive training apparatus 100 must be able to recognize the horses so that the player can proceed with the game. In (a) to (d), the type of horse (tool) was recognized by attaching a marker (M) to the lower side of the king, queen, bishop and knight used in chess. Three touch points TP are arranged on the marker M attached to the king, and these form a triangular touch pattern CP. Four touch points TP are arranged on the marker M attached to the queen, and these are formed in the structure of a triangular touch pattern CP as shown in (a), but a touch point TP is additionally arranged in the center. It can be distinguished from the King's Marker (M). As described above, the recognition of the marker M includes the number of touch points TP, the touch pattern CP formed by the touch points TP, the area (shape) of each touch point TP, and the touch pattern. Since the areas of the CP are recognized by combining them, even if the number of touch points TP is the same, they can be recognized as different markers M.

8 shows that the content game is a mole game, and when a player uses a hammer (tool), the players (Player1, Player2, Player3, Player4) can be distinguished by attaching markers (M) to both edge surfaces of the hammer. have.

Three touch points TP are arranged on the poof hammer marker M of the first player (player1), and 4 touch points TP are disposed on the poof hammer marker M of the second player (player2). ) is placed, 4 touchpoints TP are placed on the marker M of the bang hammer that the third player (player3) has, and 5 touch points TP are placed on the marker M of the bang hammer that the fourth player (player4) has. A touch point TP is disposed. As described in FIG. 7 , the number of touch points TP that each player has, the touch pattern CP formed by the touch points TP, the area (shape) of each touch point TP, and The area of the touch pattern CP may be combined and recognized.

In particular, since the mole game as shown in FIG. 8 is progressed by each of the players holding their bang hammer and touching the display area DA where the moles are displayed, information about the touch point TP placed on the marker M and The movement information of the player obtained by the fourth sensor unit 130d disposed in the multi-table type cognitive training apparatus 100 may be used together.

That is, a touch point TP is disposed on the marker M disposed on the poof hammer, and when the marker M of the bang hammer comes into contact with the display area DA by the action of the player, the touch point TP is included. The display unit 308 acquires the marker (M) information. In this case, when a plurality of players (player1, player2, player3, player4) simultaneously use the bang hammer, movement information of the players may be additionally considered in order to obtain more accurate game result information.

For example, if balloons or moles that need to be popped or hit with a bang hammer in the display area (DA) are divided to correspond to each player (player1, player2, player3, player4) (color, haze, etc.), the balloon or mole It is possible to accurately identify the bang hammer (player) in contact, so that the game progress and game result can be shown. Therefore, when a plurality of poof hammers contact (touch) a balloon or a mole in a specific area, the multi-table type cognitive training apparatus 100 of the present invention can accurately distinguish the matching between the poof hammer and the balloon or the mole. The fourth sensor The movement information of the player by the unit 130d is acquired.

FIG. 9 is a diagram for explaining touch information on a finger and a function in the content game for the touch information of a user (player) when using a user's (player) finger touch information when playing a content game. When the user (player) finger-touches (FT) a character or object of the content game with his index finger as in (a), the multi-table type cognitive training apparatus 100 of the present invention selects the touched character or object. can be recognized and made to function.

When the first and second finger touches FT1 and FT2 are performed using the index and middle fingers as shown in (b), the multi-table type cognitive training apparatus 100 of the present invention is the size of the character or object touched in the content game. can be recognized and functioned as controlling When the first to third finger touches (FT1, FT2, FT3) are performed with the index finger, middle finger, and ring finger (or thumb, index finger and middle finger) as shown in (c), the multi-table type cognitive training apparatus 100 of the present invention is The touched character or object can be recognized as moving and functioned.

As shown in (d), when the first to fourth finger touches (FT1, FT2, FT3, FT4) are performed using the index finger, middle finger, ring finger, and little finger (or thumb, index finger, middle finger, and ring finger), the present invention The multi-table type cognitive training apparatus 100 may recognize and function as rotating a character or object touched in a content game.

(a) of FIG. 10 shows that the touch part touched on the display area DA is recognized in the form of position coordinates, and (b) of FIG. 10 shows that when the touch points TP are arranged like the marker M, the corresponding touch point ( For TP), ①, ②, and ③ are designated and recognized as one touch ID, and (c) is the area or shape of the touch point (TP) disposed on the marker (M) as described above. It represents the case of different cases and recognition of an area due to a finger touch (FT) by a human finger.

When a touch point TP or a touch by a finger is input to the display area DA, the multi-table type cognitive training apparatus 100 using the artificial intelligence of the present invention for the touch portion is the horizontal axis of the display area DA. (X coordinate) and the vertical axis (Y coordinate) to calculate the touch coordinates. Accordingly, when a touch input is provided to the display area DA, the multi-table type cognitive training apparatus 100 of the present invention recognizes the position coordinates of the touch part.

In addition, (b) shows that a finger touch FT by a finger or a plurality of markers M having the same number of touch points TP or different numbers of touch points TP in the display area DA is input. In this case, information such as a touch pattern (CP) may be acquired by numbering the corresponding touch contact unit as in ①, ②, or ③. That is, the touch ID may be set with respect to the touch pattern CP composed of the touch contact units based on the shape, size, and location information of each touch contact unit.

In addition, as in (c), based on the touch area TA recognized in the display area DA by the touch points TP disposed on the marker M and the finger touches FT by the finger, An object touched on the display area DA may be identified.

For example, when a marker M on which the touch points TP are disposed or a finger touch FT by a finger is input through the display area DA, the multi-table type cognitive training apparatus 100 of the present invention performs each touch The position coordinates (x, y) of the contact part are recognized. When a plurality of users play a content game, many touch contact units (such as a touch point or a touch by a finger) are recognized in the display area DA, and only valid touch information from among such touch information needs to be filtered. The marker information by the touch points TP of the marker M or the function information by the finger are preset and stored. Thereafter, when touch inputs are provided to the display area DA, it is necessary to extract only valid information from among a lot of touch information touched on the display area DA.

11 is a diagram illustrating a state in which a possible touch pattern CP is estimated from the touch contact units TC input to the display area DA, and FIG. 12 is touch information such as the touch contact unit TC. It is a diagram showing a touch ID corresponding to , and FIG. 13 is a diagram in which a function corresponding to the touch ID is applied to a content game played in the display area DA.

11 to 13 , in the display area DA, a tool used for a content game, a marker M of a player (user), and finger touch information of the player may be input. Accordingly, as shown in FIG. 11 , a large number of touch contact units TC can be recognized in the display area DA, and a plurality of touch patterns CP including the touch contact units TC are provided. may appear As shown in the drawing, when 16 touch contact units TC are recognized in the display area DA, touch patterns CP that can be recognized as 16 touch contact units TC are first to eleventh touch patterns CP. These are the touch patterns P1 to P11.

However, since the first to eleventh touch patterns P1 to P11 do not all provide information on the content game, the player's finger touch, or the player's marker M, it is necessary to select valid touch patterns among these touch patterns. have.

As shown in Figure 12, the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention is a touch pattern (CP) consisting of the touch contact unit (TC) shown in (a) to (d). It is saved in the form of touch ID (ID11, ID21, ID23, ID105). As described above, the touch ID information includes not only the shape of the touch pattern CP made of the touch contact units TC, but also information about the areas of each touch contact unit TC, the direction of the touch contact unit TC, The area information of the touch pattern CP is combined and stored as one touch ID information.

Accordingly, as shown in FIG. 11 , when a plurality of touch contact units TC are input to the display area DA, the first to eleventh touch patterns P1 to P11 including the touch contact units TC are recognized. After that, only information that is effective and appropriate for the currently provided content game is selected by comparing the recognized first to eleventh touch patterns P1 to P11 with pre-stored touch ID information.

As shown in FIG. 13 , among the first to eleventh touch patterns P1 to P11 recognized in FIG. 11 , a first touch pattern P1 : ID11 , a fourth touch pattern P4 : ID23 , and an eleventh touch pattern It can be seen that only (P11: ID21) and the seventh touch pattern (P7: ID105) are matched with information previously stored in the multi-table type cognitive training apparatus 100 . The seventh touch pattern P7 matches the touch pattern of the pre-stored information, but does not function on the display area DA when the touch pattern is not used in the current content game.

The first touch pattern (P1: ID11) performs a function of instructing a character (person) and moving in the direction in which it is located, and the fourth touch pattern (P4: ID23) is an object movement speed within the range in the content game. Performs an effect function of doubling, the eleventh touch pattern (P11: ID21) performs a function of instructing the vehicle and moving in the direction it is located, and the seventh touch pattern (P7: ID105) is currently executed There is no registered object or function data in the content game in progress.

Accordingly, as shown in FIG. 13 , among the first to eleventh touch patterns P1 to P11 displayed in the display area DA, the first touch patterns P1: ID11 and the fourth touch patterns P4: ID23 ) and the eleventh touch pattern (P11: ID21) can be seen operating in the content game.

In this way, the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention filters and selects the touch information input to the display area DA to selectively perform only the functions effectively required in the content game. It works.

In addition, the multi-table type cognitive training apparatus and driving method using artificial intelligence of the present invention can provide cognitive training and cognitive stimulation along with visual, auditory and physical movements to dementia patients or patients with low cognitive ability in various ways. It works.

In addition, the multi-table type cognitive training apparatus and driving method using artificial intelligence of the present invention has an effect that a plurality of dementia patients or patients with low cognitive ability can receive cognitive training and cognitive stimulation in a cooperative manner at the same time.

In addition, the multi-table type cognitive training apparatus and its driving method using artificial intelligence of the present invention recognize players through a learning model by deep learning, and then the game area set for each player follows the moving player while the game is in progress. It has the effect of being able to move in the display area.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention have the effect of providing content games suitable for each level to a plurality of dementia patients or patients with low cognitive ability.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention provide various events when a dementia patient or a patient with low cognitive ability plays a content game to receive cognitive training or cognitive stimulation. It has the effect of providing stimulation to various sensory organs such as , hearing, and touch.

14 is a block diagram illustrating a specific configuration of a recognition unit of a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention. 15 is a block diagram illustrating a detailed configuration of a driving unit of a multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention. 16 is a view for explaining the operation of the display unit and the event provision of the multi-table type cognitive training apparatus using artificial intelligence according to an embodiment of the present invention.

14 and 15 together with FIGS. 2 and 3 , the multi-table type cognitive training apparatus 100 using artificial intelligence of the present invention includes the first to fourth sensor units 130a, 130b, 130c, and 130d. , an input unit 301 , a storage unit 302 , a driving unit 303 , a content providing unit 304 , a control unit 305 , a recognition unit 306 , a determining unit 307 , and a display unit 308 . The recognition unit 306 recognizes and analyzes touch information input through the display unit 308 to recognize an object, a pattern recognition unit 306a, a pattern analysis unit 306b, a pattern database 306c, Data Base, and an object. It includes a recognition unit 306d and an object database 306e (Data Base).

As described above, in the storage unit 302 disposed in the multi-table type cognitive training apparatus 100 of the present invention, the touch patterns CP of the markers M and the touch patterns composed of a finger touch by the user's finger. (CP) information is stored. When touch information by a finger touch of a player (user) and touch points TP of a marker M is input through the display area DA of the display unit 308, the pattern recognition unit ( 306a).

As described with reference to FIG. 11 , touch information is input to the plurality of touch contact units TC in the display area DA by touch points TP disposed on the marker M and a touch provided by the player's finger. do. The pattern recognition unit 306a provides all the touch contact units TC input to the display area DA to the pattern analysis unit 306b to analyze the touch patterns CP formed by the touch contact units TC. do. That is, based on the pattern information stored in the pattern DB 306c, whether the touch patterns CP by the touch contact units TC input to the display area DA are a touch pattern indicating an object or a specific function (effect) Analyze whether it is a touch pattern that implements Although the pattern DB 306c is illustrated as a configuration of the recognition unit 306a, it may be implemented as a part of the storage unit 302 of the multi-table type cognitive training apparatus 100 .

After the pattern analyzer 306b analyzes the touch patterns CP of the touch contact units TC input to the display area DA, the results are provided to the object recognizer 306d. The object recognition unit 306d recognizes which object or specific function the touch patterns CP analyzed by the pattern analysis unit 306b are related to. The object recognition unit 306d compares the touch pattern CP provided by the pattern analysis unit 306b based on the object information (including specific effect and function information corresponding to the touch pattern) stored in the object database 306e. . That is, the object database 306e lists characters active in each content game, specific effect and function information that can be performed in the game, and touch patterns (CP) in the form of a lookup table. Accordingly, a character having the same touch pattern CP or a specific effect and function in a game may be matched with the touch patterns CP analyzed by the pattern analysis unit 306b.

In addition, the object recognition unit 306d receives each content game information stored in the storage unit 302, and although it was recognized as a valid pattern as the touch pattern CP, it is valid (used) in relation to the current content game. ) whether it is a touch pattern can be filtered. For example, if the pattern analysis unit 306b analyzes the touch pattern CP, but it is an object or a specific effect (function) that is not used in the content game currently provided to the user, the object recognition unit 306d will filter it. can

When the touch pattern CP and the object (or a specific effect of a game) are matched in the object recognition unit 306d, the determination unit 307 finally determines the object or a specific effect in the currently ongoing content game, and then the control unit 305 forward to The control unit 305 controls the content providing unit 304 so that the object or specific effect determined by the determination unit 307 operates (functions) on the display unit 308 .

15 , the multi-table type cognitive training apparatus 100 of the present invention includes a display unit 100a and a base unit 100b supporting the display unit 100a, and provides users with various content games through Provides cognitive skills training and cognitive stimulation. The driving unit 303 illustrated in FIG. 3 may horizontally rotate the display unit 100a or vertically stand it according to the provided content game. In addition, the multi-table type cognitive training apparatus 100 of the present invention can provide the user with various events that can be performed in the content game provided through the driving unit 303 .

To this end, the driving unit 303 includes a first moving unit 303a, a second moving unit 303b, a first event providing unit 303c, and a second event providing unit 303d.

As shown in FIG. 16 , the first to fourth air nozzles AIR1 , AIR2 , AIR3 and AIR4 may be disposed on the display unit 100a of the multi-table type cognitive training apparatus 100 . In addition, the base unit 100b includes a speaker unit SP for outputting sound and a vibrating unit VR. More specifically, the speaker unit SP and the vibrating unit VR may be disposed inside or outside the first support unit 120 of the base unit 100b.

The first moving unit 303a of the driving unit 303 functions to provide power to the moving unit 123 disposed on the second support unit 121 when the multi-table type cognitive training apparatus 100 needs to be moved. . That is, it serves to provide power for moving the entire multi-table type cognitive training apparatus 100 .

As shown in FIG. 16 , the second moving unit 303b of the driving unit 303 functions to provide power when the display unit 100a is vertically rotated or horizontally rotated. That is, according to the type of content game provided to the user, the display unit 100a may be arranged horizontally, or the display unit 100a may be arranged vertically, such as a white board attached to a wall. When the display unit 100a is erected vertically, the game may be played in a manner in which players provide touch information to the display unit 100a in both regions with the vertical display unit 100a interposed therebetween.

In addition, the first event providing unit 303c of the driving unit 303 includes the first to fourth air nozzles AIR1, AIR2, AIR3, AIR4 in order to provide a vivid sense of presence to users (players) according to the type of content game. ) to blow air through the For example, when a game for providing cognitive stimulation is a game in which a number of bubbles are selectively popped in the background of a well in the mountains, it can be used as a function to provide a sense of touch, such as providing cool air to players. .

This may provide the players with auditory elements such as birdsong and various animal sounds through the speaker unit SP of the second event providing unit 303d, which will be described later. Therefore, the multi-table type cognitive training apparatus 100 of the present invention can maximize cognitive training or cognitive stimulation by providing various synesthetic functions together when providing cognitive ability training or cognitive stimulation to a user.

The second event providing unit 303c of the driving unit 303 functions to provide sound and vibration events to users according to the type of content game. The base unit 100b may include a speaker unit SP capable of outputting sound and a vibrating unit VR that vibrates the multi-table type cognitive training apparatus 100 . The speaker unit SP may transmit various information to users (eg, provide a tutorial for a game) and output sounds related to each object when a content game is played. In addition, an appropriate background sound may be provided according to the type of content game. For example, various sounds may be provided to users according to a case in which a content game is played on the sea, in the sea, in a casino, in the sky, and the like.

The vibrator VR functions to provide necessary movements according to the content game. For example, when a content game is played on a carriage, a car, or a boat, a corresponding movement may be provided to users. As described above, the multi-table type cognitive training apparatus 100 of the present invention has the effect of providing stimulation not only visually but also tactile and auditory to a user who needs cognitive training or cognitive stimulation.

As described above, the multi-table type cognitive training apparatus and driving method using artificial intelligence of the present invention can provide cognitive training and cognitive stimulation along with visual, auditory and physical movements to dementia patients or patients with low cognitive ability in various ways. there is an effect

In addition, the multi-table type cognitive training apparatus and driving method using artificial intelligence of the present invention has an effect that a plurality of dementia patients or patients with low cognitive ability can receive cognitive training and cognitive stimulation in a cooperative manner at the same time.

In addition, the multi-table type cognitive training apparatus and its driving method using artificial intelligence of the present invention recognize players through a learning model by deep learning, and then the game area set for each player follows the moving player while the game is in progress. It has the effect of being able to move in the display area.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention have the effect of providing content games suitable for each level to a plurality of dementia patients or patients with low cognitive ability.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention provide various events when a dementia patient or a patient with low cognitive ability plays a content game to receive cognitive training or cognitive stimulation. It has the effect of providing stimulation to various sensory organs such as , hearing, and touch.

17 is a block diagram showing the structure of the content providing unit of the multi-table type cognitive training apparatus using artificial intelligence of the present invention. 18 is a block diagram illustrating a structure of a tracking unit disposed in the content providing unit of FIG. 17 . 19 is a diagram illustrating a state in which the multi-table type cognitive training apparatus using artificial intelligence according to the present invention tracks a player who plays a content game.

17 to 19 , the multi-table type cognitive training apparatus 100 of the present invention provides a customized content game to the user based on the user's information (age, gender, academic background, occupation, etc.) or by performing a pre-test. can do. The content providing unit 304 of FIG. 3 includes a first cognitive content unit 304a, a second cognitive content unit 304b, and a tracking unit 304c. The first cognitive content unit 304a may provide the user with content games related to cognitive ability training, and the second cognitive content 304b may provide the user with content games related to cognitive stimulation. In addition, as shown in FIG. 18 , the tracking unit 304c recognizes and locates each of the players who play the content game using a learning model built by deep learning, so as to correspond to the player in the display area DA ) can be tracked according to the movement of the player. Therefore, in the multi-table type cognitive training apparatus 100 of the present invention, if there is a change in location while the players who are playing the content game play the game, the next play can be performed from the current location without returning to the initially set game area. . That is, the multi-table type cognitive training apparatus 100 of the present invention recognizes each player and matches each player through a learning model built by deep learning even if a plurality of players change positions while playing a game. The area can be moved in the direction of the player's movement.

Referring to FIG. 18 together with FIGS. 2 and 3 , the tracking unit 304c disposed in the multi-table type cognitive training apparatus 100 of the present invention includes a face recognition unit 314 for recognizing a player's face, and a player Each player is extracted through a learning model 316 based on the images provided by the gesture recognition unit 315, the facial recognition unit 314, and the gesture recognition unit 315 for recognizing movements when playing the game. an extracting unit 317 that initially compares the face information of each player with the extracted image information of the player, and a first comparison unit 318 that compares the first player's location information with the extracted player's current location information A second comparator 319, a determination unit 320 for determining a player with a change in position, and a region moving unit 321 for moving the game area to the current player's position (the position of the player with a change in position) include

The face recognition unit 314 receives the face image of the player provided from the second sensor unit 130b, and converts the face image into a binarized image so that the provided image can be recognized by the learning model 316 .

The motion recognition unit 315 receives a motion (movement) image of the player provided from the fourth sensor unit 130d, and converts the image into a binarized image in order to classify the motions of the player by the learning model 316 based on the provided image. convert to

For machine learning of the learning model 316 built as a deep learning model, not only a neural network, but also a machine learning algorithm such as a decision tree, a Bayesian network, or a support vector machine (SVM) will be used. can

For example, it may include neural networks having fully connected layers, such as a Mask Recurrent Convolutional Neural Network (Mask-RCNN). Accordingly, the neural network constituting the learning model 316 may include a feature pyramid network (FPN), a core neural network (Resnet), and a region proposal network (Region Proposal Network).

The learning model 316 is a content game unit provided by the multi-table type cognitive training device 100, and includes a face (front view) image of a player and a multi-table type cognitive training device ( 100) It is placed on the upper part, and it is possible to learn deep learning based on an image that captures the action (action) process of the players. Such deep learning learning makes it possible to identify the positions of the players during the game from the relationship between the player's face image and the motion image.

Accordingly, the images (facial images and motion images) captured in the course of a game by a user (player) using the content game are continuously provided as the learning model 316, and the extraction unit 317 is the Extract facial and motion images.

The extracted face and motion images of the players are taken when the players are placed in the multi-table type cognitive training apparatus 100 before starting the first game through the first comparison unit 318, and the process of performing the play and the facial images taken Compare with facial images taken in Preliminary players are primarily selected through image comparison of the first comparison unit 318 . Here, the facial images to be compared may be facial images before determining a player for the current game result.

Then, before starting the first game through the second comparator 319, when the players are positioned in the multi-table type cognitive training apparatus 100, the motion images taken and the motion images taken during play compare with Here, the motion images may be images in which the player operated before determining the player for the game result.

Players are selected from preliminary players secondarily selected through the comparison image of the second comparison unit 320 , and players are finally determined through the determination unit 320 . At this time, it is possible to check where the players are in the multi-table type cognitive training apparatus 100 from the extracted image.

That is, the multi-table type cognitive training apparatus 100 of the present invention can identify in real time where a plurality of players are located when they move while performing a content game. That is, if the player moves from position A to position B while playing the game when starting the first content game, each player may be recognized through the learning model 316 and their positions may be determined.

When the determining unit 320 recognizes each player and determines the player's position, when the first content game is started through the area moving unit 321, the set game area of each player is displayed on the display area DA. can be moved to

That is, the tracking unit 304c disposed in the content providing unit 304 of the multi-table type cognitive training apparatus 100 of the present invention moves from its initial position to another position in the course of a plurality of players playing the content game. In this case, the player can proceed with the next play from the current position without returning to the initial position because his/her game area set at the initial position also moves.

Referring to FIG. 19 , in the display unit 100a of the multi-table type cognitive training apparatus 100 of the present invention, a display area DA for displaying a content game is disposed. For example, in the case of a content game that can be played by 6 players, the display area DA before starting the first game is the position of the display area DA corresponding to the position of each player. The game areas PA1 , PA2 , PA3 , PA4 , PA5 , PA6 are displayed.

Then, when a movement occurs in the process of six players playing the content game, the multi-table type cognitive training apparatus 100 of the present invention displays the game areas PA1, PA2, PA3, PA4 displayed in the display area DA. , PA5, PA6) can be moved to the player's moving position. That is, when the second player Player2 starts the first game or moves at any point in playing the game, it is tracked by the player tracking operation of the above-described tracking unit 304c.

Accordingly, the game area PA2 of the second player Player2 moves to a position in the display area DA corresponding to the moving line of the second player Player2 (solid line PA2 block). As shown in the drawing, it can be seen that the game area PA2 moves to a position corresponding to the tracked path and tracking the movement of the player. It can be seen that the second game area PA2 is located on the display area DA corresponding to the area where the second player 2 is located.

However, as described above, when the players closely overlap, for example, when the first player (player1) is located at the position where the second player (player2) has moved, the tracked second game area PA2 is the second game area PA2. 1 may overlap the game area PA1. In this case, the second game area PA2 is located as an area closest to the area where the first player player1 is located.

Accordingly, a method of moving game areas set for a plurality of players in the display area while the multi-table type cognitive training apparatus 100 of the present invention is driven is as follows.

The multi-table type cognitive training apparatus 100 of the present invention includes a display unit having a touch panel for displaying content games and a plate on which the touch panel is seated; and a base unit supporting the display unit and a management system controlling the display unit and the base unit.

Here, the multi-table type cognitive training apparatus by the management system, comprising the steps of: acquiring face information images of a plurality of users who play the content game; acquiring motion information images of a plurality of users who play the content game; extracting images of users using a learning model built by deep learning based on the images of face information and motion information of the users; comparing the extracted user's image information with the user's face information before playing the content game, and selecting users who are currently playing the content game; comparing the extracted user image information with a motion image of a user before playing the current content game to determine users who currently play in the content game among the selected users; After identifying the locations of the determined users, moving the game areas set for a plurality of users who play the first content game in the display area of the display unit to the location of the user currently playing the content game perform the action

In this way, the multi-table type cognitive training apparatus 100 of the present invention waits for his or her play turn to come from the current position without the need to return to the original position when the player moves in the process of playing the game, and then plays the game thereafter. can proceed.

In addition, the multi-table type cognitive training apparatus and driving method using artificial intelligence of the present invention can provide cognitive training and cognitive stimulation along with visual, auditory and physical movements to dementia patients or patients with low cognitive ability in various ways. It works.

In addition, the multi-table type cognitive training apparatus and driving method using artificial intelligence of the present invention has an effect that a plurality of dementia patients or patients with low cognitive ability can receive cognitive training and cognitive stimulation in a cooperative manner at the same time.

In addition, the multi-table type cognitive training apparatus and its driving method using artificial intelligence of the present invention recognize players through a learning model by deep learning, and then the game area set for each player follows the moving player while the game is in progress. It has the effect of being able to move in the display area.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention have the effect of providing content games suitable for each level to a plurality of dementia patients or patients with low cognitive ability.

In addition, the multi-table type cognitive training apparatus and the driving method thereof using artificial intelligence of the present invention provide various events when a dementia patient or a patient with low cognitive ability plays a content game to receive cognitive training or cognitive stimulation. It has the effect of providing stimulation to various sensory organs such as , hearing, and touch.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and used by those skilled in the computer software field. Examples of computer-readable recording media include hard disks, magnetic media such as floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floppy disks. medium), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. A hardware device may be converted into one or more software modules to perform processing in accordance with the present invention, and vice versa.

The specific implementations described in the present invention are only examples, and do not limit the scope of the present invention in any way. For brevity of the specification, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of the lines between the components shown in the drawings exemplarily represent functional connections and/or physical or circuit connections, and in an actual device, various functional connections, physical connections that are replaceable or additional may be referred to as connections, or circuit connections. In addition, unless there is a specific reference such as “essential” or “importantly”, it may not be a necessary component for the application of the present invention.

In addition, although the detailed description of the present invention has been described with reference to a preferred embodiment of the present invention, those skilled in the art or those having ordinary knowledge in the art will appreciate the spirit of the present invention described in the claims to be described later. And it will be understood that various modifications and variations of the present invention can be made without departing from the technical scope. Accordingly, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

100: multi-table type cognitive training device
100a: display unit
100b: base unit
120: first support
121: second support
123: means of transportation
130a: first sensor unit
130b: second sensor unit
130c: third sensor unit
130d: fourth sensor unit
301: input unit
302: storage
303: driving unit
304: content provider
305: control unit
306: recognition unit
307: judgment unit
308: display unit
TP: touch point
TA: touch area
CP: touch pattern
TD: direction of touchpoint

Claims (7)

a display unit including a touch panel for displaying content games for providing cognitive training or cognitive stimulation to a user and a plate on which the touch panel is seated;
a base unit supporting the display unit; and
A management system for controlling the display unit and the base unit,
The management system is
a first sensor unit disposed along a periphery of a side surface of the display unit to obtain location information of the user;
a second sensor unit disposed on the inside corresponding to the display area of the display unit to obtain face information of the user;
a third sensor unit disposed along a non-display area between the touch panel and the plate of the display unit to obtain a position of a user's marker and information included in the marker; and
The upper space of the display unit includes a fourth sensor unit for acquiring movement information of a user who plays a content game,
The base unit is
a first support unit for vertically moving, rotating, and tilting the display unit while supporting the display unit; and
and a second support portion disposed below the first support portion and in contact with the ground,
The management system tracks the position of the player who plays the content game based on the user's face information image provided from the second sensor unit and the user's motion information image provided from the fourth sensor unit, and the tracked position To move the game area on the display area provided to the user in order to proceed with the content game based on the information
Multi-table cognitive training device. According to claim 1,
The management system is
a display unit for inputting touch information and displaying a content game;
a storage unit for storing information on content games and information on users;
a driving unit that moves the display unit up and down, rotates and tilts;
a content providing unit that provides a content game for cognitive ability training and a content game for cognitive stimulation training to the user and tracks the location of the user who plays the content game;
a recognition unit for recognizing a touch pattern based on the touch information input through the display unit; and
A determination unit for selecting only a touch pattern related to a content game currently in progress among the touch patterns recognized by the recognition unit;
Multi-table cognitive training device. 3. The method of claim 2,
The content providing unit,
a first cognitive content unit providing a content game for cognitive ability training to the user;
a second cognitive content unit providing a content game for cognitive stimulation training to the user; and
After recognizing and locating players who play the content game using a learning model built by deep learning, a tracking unit that moves the game area set in the player on the display area corresponding to the current player's location
Multi-table cognitive training device. 4. The method of claim 3,
The tracking unit,
a face recognition unit for recognizing a player's face;
a motion recognition unit for recognizing movements when the player plays a game;
a learning model for recognizing a player based on the image provided by the face recognition unit and the motion recognition unit and identifying the position thereof; and
and a region moving unit for moving the game region to the current player position based on the player information recognized by the learning model and the recognized player position information.
Multi-table cognitive training device. According to claim 1,
a plurality of air nozzles for providing tactile stimulation to the user by jetting air to the display unit;
a speaker unit for outputting sound to the base unit; and
Vibrating the display unit comprising a vibrator to provide movement to the user
Multi-table cognitive training device. a display unit including a touch panel for displaying content games and a plate on which the touch panel is mounted; In the driving method of a multi-table type cognitive training apparatus comprising a base unit supporting the display unit and a management system for controlling the display unit and the base unit,
The multi-table type cognitive training apparatus by the operation of the management system,
acquiring face information images of a plurality of users who play the content game;
acquiring motion information images of a plurality of users who play the content game;
extracting images of users using a learning model built by deep learning based on the images of face information and motion information of the users;
comparing the extracted user's image information with the user's face information before playing the content game, and selecting users who are currently playing the content game;
comparing the extracted user image information with a motion image of a user before playing the current content game to determine users who currently play in the content game among the selected users; and
After identifying the positions of the determined users, moving the game areas respectively set to the plurality of users who play the first content game in the display area of the display unit to the location of the user currently playing the content game performing the action
A method of driving a multi-table type cognitive training device. 7. The method of claim 6,
The management system is
a display unit for inputting touch information and displaying a content game;
a storage unit for storing information on content games and information on users;
a driving unit that moves the display unit up and down, rotates and tilts;
a content providing unit that provides a content game for cognitive ability training and a content game for cognitive stimulation training to the user and tracks the location of the user who plays the content game;
a recognition unit for recognizing a touch pattern based on the touch information input through the display unit; and
A determination unit for selecting only a touch pattern related to a content game currently in progress among the touch patterns recognized by the recognition unit;
A method of driving a multi-table type cognitive training device.

Images