WO2024071486A1 - Système d'interaction intelligent basé sur une surveillance d'état de nageur - Google Patents

Système d'interaction intelligent basé sur une surveillance d'état de nageur Download PDF

Info

Publication number
WO2024071486A1
WO2024071486A1 PCT/KR2022/014775 KR2022014775W WO2024071486A1 WO 2024071486 A1 WO2024071486 A1 WO 2024071486A1 KR 2022014775 W KR2022014775 W KR 2022014775W WO 2024071486 A1 WO2024071486 A1 WO 2024071486A1
Authority
WO
WIPO (PCT)
Prior art keywords
swimmer
information
sensor
module
body part
Prior art date
Application number
PCT/KR2022/014775
Other languages
English (en)
Korean (ko)
Inventor
장승진
황효균
마용범
김남영
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to PCT/KR2022/014775 priority Critical patent/WO2024071486A1/fr
Publication of WO2024071486A1 publication Critical patent/WO2024071486A1/fr

Links

Images

Classifications

    • E—FIXED CONSTRUCTIONS
    • E04—BUILDING
    • E04H—BUILDINGS OR LIKE STRUCTURES FOR PARTICULAR PURPOSES; SWIMMING OR SPLASH BATHS OR POOLS; MASTS; FENCING; TENTS OR CANOPIES, IN GENERAL
    • E04H4/00—Swimming or splash baths or pools
    • E—FIXED CONSTRUCTIONS
    • E04—BUILDING
    • E04H—BUILDINGS OR LIKE STRUCTURES FOR PARTICULAR PURPOSES; SWIMMING OR SPLASH BATHS OR POOLS; MASTS; FENCING; TENTS OR CANOPIES, IN GENERAL
    • E04H4/00—Swimming or splash baths or pools
    • E04H4/14—Parts, details or accessories not otherwise provided for
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B21/00—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
    • G01B21/02—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant for measuring length, width, or thickness
    • G01B21/04—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant for measuring length, width, or thickness by measuring coordinates of points
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/06—Systems determining position data of a target
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/50—Systems of measurement based on relative movement of target
    • G01S13/58—Velocity or trajectory determination systems; Sense-of-movement determination systems
    • G01S13/62—Sense-of-movement determination
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/08—Alarms for ensuring the safety of persons responsive to the presence of persons in a body of water, e.g. a swimming pool; responsive to an abnormal condition of a body of water
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B3/00—Audible signalling systems; Audible personal calling systems
    • G08B3/10—Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B5/00—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied
    • G08B5/22—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied using electric transmission; using electromagnetic transmission

Definitions

  • the present invention relates to a smart interaction system based on swimmer condition monitoring. Specifically, it relates to an Interactive swimming Pool System that monitors the location and status of swimmers using surface and underwater sensors and provides services to increase fun and safety for users based on the monitoring results. .
  • a safety guard was deployed to visually inspect the swimming pool, or a method of visually monitoring through CCTV installed inside or outside the swimming pool was used.
  • Patent Publication No. 10-2065516 discloses a device that detects movement information of people using underwater cameras, and has been registered in Korea.
  • Patent Publication No. 10-2406948 discloses a system that detects the position and movement of each swimmer through a photography device and safety management program placed at the top of the swimming space
  • Domestic Patent Publication No. 10-2432675 discloses a system that detects the position and movement of each swimmer.
  • US patent application US20190087548A1 proposes a swimming pool monitoring system that prevents emergency accidents by monitoring the condition of swimmers on the surface or underwater through a surface and underwater monitoring device moving inside the swimming pool.
  • the user's location and movement is monitored through a camera or other imaging device to detect abnormal behavior of the swimmer, thereby detecting the occurrence of an emergency such as a drowning accident in real time and quickly carrying out rescue activities.
  • an emergency such as a drowning accident in real time and quickly carrying out rescue activities.
  • this prior art discloses a method of monitoring the user's location and movement by installing one or more imaging devices inside/outside the swimming space or underwater in order to detect the user's abnormal behavior, which violates the swimmer's privacy.
  • the present invention aims to solve the above-described problems and other problems.
  • the purpose of the present invention is to monitor the position and condition of the swimmer using a water surface sensor and an underwater sensor, and to increase the fun and safety of the user based on the monitoring results.
  • the purpose is to provide an interactive swimming pool system that provides services and a control method thereof.
  • the interaction pool system detects the swimmer's body parts through a first sensor module above the water and a second sensor module below the water.
  • a sensor module that senses and obtains first and second information about the swimmer's body part; And by combining the first and second information input from the first and second sensor modules, one or more of the swimmer's position, height, posture, and motion information is generated. and a processor that generates an event based on the generated information, wherein the processor controls an application execution screen corresponding to the generated event to be output on the display.
  • the first sensor module is disposed on the water surface to sense one or more swimmer body parts located on the water surface, and includes body part identification information and coordinate information (x, y) of the sensed swimmer body part. and acquire first information including distance information from the water surface to the body part, and the second sensor module is disposed below the water surface to sense one or more body parts of the swimmer located below the water surface, and the sensed swimming It is characterized by obtaining second information including coordinate information (x, y) of the user's body part and distance information from the bottom of the swimming pool to the sensed body part.
  • the processor synthesizes the first and second information input from the first and second sensor modules through a swimming sensor fusion algorithm to determine the sensed swimmer's body part. It includes a swimmer information generation module that generates position, height, posture, and motion information of the swimmer, and the swimmer information generation module identifies the swimmer. It is characterized by further generating identification information.
  • it further includes a memory operably coupled to the processor, wherein the processor stores the generated position, height, posture, and motion information of the swimmer and the It is characterized in that control is performed so that swimmer information including swimmer identification information is stored in the memory.
  • the processor includes a swimmer position monitoring module for monitoring the position of the swimmer based on the swimmer information, and a swimmer position monitoring module for detecting the swimmer's state based on the monitoring result and the swimmer information. It further includes a state detection module, wherein the swimmer state detection module generates a predefined event based on the detected state of the swimmer, and the event includes notification information generated based on the detected state of the swimmer. It is characterized by:
  • the peripheral device is characterized in that it is at least one of electronic devices that control lighting, music, and waves in the swimming pool.
  • the first sensor module is equipped with one or more sensors selected from a lidar sensor or a radar sensor, and the type, number, and arrangement of the one or more sensors are determined by the sensing range and the swimming pool of the sensor provided in the first sensor module. It is characterized by being determined based on size.
  • the first sensor module when the first sensor module determines that the sensed body part is the swimmer's head based on body part identification information of the one or more sensed body parts of the swimmer, the first sensor module detects a sensor from the water surface to the head.
  • the swimmer's head height which is the distance of The calculated swimmer's head height and the swimmer's maximum height are further included in the first information.
  • the second sensor module is provided with one or more sensors selected from an optical sensor or an ultrasonic sensor, and the type, number, and arrangement of the one or more sensors are determined by the sensing range and pool of the sensors provided in the second sensor module. It is characterized by being determined based on size.
  • the second sensor module is a vertical measurement underwater sensor that is disposed in a vertical direction with one or more display panels provided on the display and senses one or more body parts of the swimmer located in a vertical direction of the display panel.
  • a first inclination measurement underwater sensor that is spaced apart from the vertical measurement underwater sensor and inclined in the first inclination angle direction to sense one or more body parts of the swimmer located in the first inclination angle direction
  • the first inclination measurement underwater is provided with a second inclination measurement underwater sensor that is spaced apart from the sensor and inclined in a second inclination angle direction and senses one or more body parts of the swimmer located in the second inclination angle direction
  • the second tilt measurement underwater sensor is characterized in that it is arranged side by side, forming one or more lines between the display panels.
  • the second sensor module 120 is configured to detect the sensor in the first and second tilt measuring underwater sensors. Based on the distance to the sensed body part and the first and second inclination angles, distance information from the bottom of the swimming pool to the sensed body part is obtained.
  • the swimmer status detection module counts the number of swimmers located in the swimming pool based on the monitoring result and the swimmer information, calculates the swimming pool complexity based on the counting result, and calculates the swimming pool complexity. It is characterized by generating notification information including the swimming pool complexity and generating a predefined event.
  • the swimmer based on the monitoring results and the swimmer information, it is determined whether the swimmer is located in a specific area of the swimming pool with a depth suitable for the swimmer's height, and based on the determination result, the swimmer is determined. It is characterized by generating a predefined event by generating notification information including the swimmer's identification information, location information, and a warning message.
  • the swimmer state detection module determines whether the time the swimmer stays inside the pool is outside a predefined appropriate water play time range based on the monitoring result and the swimmer information; , Characterized in generating a predefined event by generating notification information including the swimmer identification information, location information, and a rest guidance message based on the determination result.
  • the swimmer state detection module determines whether motion information included in the swimmer information matches a predefined abnormal movement pattern of the swimmer based on the monitoring result and the swimmer information. determines, and generates notification information including swimmer identification information, location information, movement information, and a risk information message of the swimmer based on the judgment result to generate a predefined event, and the abnormal movement pattern of the swimmer is It is characterized by one or more of the following movement patterns: trembling, head locking, whole body locking, and drowning.
  • the swimmer state detection module predefines movement information included in the swimmer information based on the monitoring results and the swimmer information in one or more game applications installed in the swimming pool system. Determine whether it matches the game-related movement pattern, and based on the determination result, generate notification information including the swimmer's swimmer identification information, location information, movement information, and the game application information to trigger a predefined event.
  • the predefined game-related movement pattern is a specific area where the game screen of the game application is displayed, such as the swimmer's standing state, jumping state, waving left or right hand, and foot in the area where the game screen of the game application is displayed. It is characterized by including a pattern in which the state of pressing is detected.
  • first and second displays one of the first and second displays is arranged in the form of a rooftop signage display, and the other is arranged in the form of a flow signage display on the bottom of the swimming pool. It is characterized by being placed.
  • the processor further includes an application control module that executes an application or a specific function of the application corresponding to the event based on the generated event, wherein the application control module displays the execution screen of the application. It is characterized by controlling the output to at least one of the first and second displays provided in the display.
  • the processor further includes a sound output module that outputs a notification sound corresponding to notification information included in an event generated by the processor.
  • the control method of the interaction swimming pool system is to control the swimming pool through a first sensor module above the water and a second sensor module below the water. Sensing a body part to obtain first and second information about the swimmer's body part, synthesizing the first and second information input from the first and second sensor modules to determine the swimmer's position ( Generating one or more of Position, Height, Gesture, and Motion information, generating an event based on the generated information, and creating an application execution screen corresponding to the generated event. It is characterized in that it includes the step of controlling the output to the display.
  • the present invention monitors the location and status of the swimmer using a surface sensor and an underwater sensor, and provides a service to increase the fun and safety of the user based on the monitoring results. There is an effect of providing an interactive swimming pool system and a control method thereof.
  • FIG 1 is an internal block diagram of an interaction pool system according to an embodiment of the present invention.
  • Figure 2 is a conceptual diagram showing the configuration of an interaction swimming pool system according to an embodiment of the present invention.
  • Figure 3 is a conceptual diagram showing the configuration of a first sensor module according to an embodiment of the present invention.
  • FIG. 4 is a conceptual diagram illustrating the configuration of a second sensor module by partially expanding area A of FIG. 3.
  • Figure 5 is a conceptual diagram illustrating a sensing process of a first sensor module according to an embodiment of the present invention.
  • Figure 6 is a conceptual diagram illustrating a sensing process of a second sensor module according to an embodiment of the present invention.
  • FIG. 7 is a cross-sectional view showing the sleep sensor module of FIG. 3 from above, and is a conceptual diagram illustrating a method of arranging the sleep sensor module.
  • FIGS. 8A to 8C are cross-sectional views showing the underwater sensor module of FIG. 2 from above and are conceptual diagrams showing a method of arranging the underwater sensor module.
  • Figure 9 is a conceptual diagram illustrating a process for obtaining information about the swimmer's head height and the maximum height of the swimming pool based on the image extracted by the water surface sensor module.
  • Figure 10 is a conceptual diagram illustrating a process of acquiring distance information from the bottom of a swimming pool to a swimmer's body part by an underwater sensor module.
  • Figure 11 is an internal block diagram of a processor according to an embodiment of the present invention.
  • Figure 12 is a block diagram showing the first and second sensor modules, processors, and operation processes according to an embodiment of the present invention.
  • Figure 13 is a conceptual diagram illustrating a process for calculating a swimmer's height through a swimming sensor fusion algorithm according to an embodiment of the present invention.
  • Figure 14 is a conceptual diagram illustrating a process for calculating posture information through a swimming sensor fusion algorithm according to an embodiment of the present invention.
  • Figure 15 is a block diagram showing the internal operation process of the processor according to an embodiment of the present invention.
  • Figure 16 is a conceptual diagram illustrating a process for detecting an abnormal state of a swimmer according to an embodiment of the present invention.
  • Figure 17 is an exemplary diagram illustrating a game application according to an embodiment of the present invention.
  • Figure 18 is a flowchart showing a control method of an interaction swimming pool system according to an embodiment of the present invention.
  • Electronic devices described in this specification may be applied to fixed terminals such as digital TVs, desktop computers, kiosks, and digital signage.
  • the electronic devices described in this specification can be applied to non-contact display devices such as kiosks, digital signage, etc., that is, image display devices.
  • the interaction pool system 10 includes a sensor module 100 including a first sensor module 110 and a second sensor module 120, a processor 200, and a display. It may include (300).
  • FIG. 1 The components shown in FIG. 1 are not essential for implementing the interaction pool system 10, so the interaction pool system 10 described herein may include more or fewer components than the components listed above. You can have them.
  • Figure 2 is a conceptual diagram showing the configuration of the interaction pool system 10 according to an embodiment of the present invention.
  • the interaction swimming pool system 10 includes a first sensor module 110 disposed above the water, a second sensor module 120 disposed below the water, a processor 200, It may include a display 300 and a memory 400.
  • the display 300 may include one or more displays, at least one of the one or more displays is arranged in the form of a rooftop signage display, and at least the other one is arranged in the form of a flow signage display on the bottom of the swimming pool. It may be possible, but it is not limited to this.
  • the display arranged in the form of the rooftop signage display is called a first display
  • the display arranged on the bottom of the swimming pool in the form of the flow signage display is called a second display.
  • the interaction pool system 10 may further include a communication module 500 and a sound output module 600 operably coupled to the processor 200, and the processor 200 ) can control peripheral devices 700 in the swimming pool through the communication module 500.
  • the peripheral device 700 may refer to one or more electronic devices that control lighting, music, and waves in a swimming pool, but is not limited thereto.
  • the communication module 500 included in the interaction pool system 10 enables wireless communication between the interaction pool system 10 and at least one peripheral device or between an external server. It may include one or more modules, but is not limited thereto.
  • the communication module 500 may include one or more modules that connect the interaction pool system 10 to one or more networks.
  • Modules included in the communication module 500 may include a wireless Internet module.
  • the wireless Internet module refers to a module for wireless Internet access and may be built into or external to the interaction pool system 10.
  • the wireless Internet module can be configured to transmit and receive wireless signals in a communication network based on wireless Internet technologies.
  • wireless Internet technologies include, for example, Wireless LAN (WLAN), Wireless-Fidelity (Wi-Fi), Wireless Fidelity (Wi-Fi) Direct, Digital Living Network Alliance (DLNA), Wireless Broadband (WiBro), and WiMAX ( There may be World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., from the above. It may also include Internet technologies not listed. And data can be transmitted and received according to at least one wireless Internet technology in a range not listed above.
  • modules included in the communication module 500 may include a short-distance communication module.
  • the short-range communication module is for short-range communication and includes BluetoothTM, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, and NFC (Near Field). Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology can be used to support short-distance communication.
  • This short-range communication module may support wireless communication between the interaction pool system 10 and at least one other peripheral device through wireless area networks.
  • the plurality of sensors 111 to 116 provided in the first sensor module 110 may be disposed on the water surface to sense parts of the swimmer's body protruding above the water surface, but the sensor is not limited thereto.
  • the first sensor module 110 disposed on the water surface is referred to as a 'sleep sensor module', and the plurality of sensors provided in the sleep sensor module 110 are referred to as 'sleep sensors'. .
  • FIG. 4 is a conceptual diagram showing a partial expansion of area A of FIG. 3.
  • the plurality of sensors 121 to 126 provided in the second sensor module 120 are used to sense parts of the swimmer's body located below the water surface. It can be placed below the water surface.
  • the second sensor module 120 may be located above or below the transparent acrylic located below the pool depending on the type of sensor provided in the second sensor module 120, but is not limited to this. no.
  • the second sensor module 120 disposed below the water surface is referred to as an 'underwater sensor module', and the plurality of sensors provided in the underwater sensor module 120 are referred to as 'underwater sensors'. do.
  • the display 320 may include a plurality of display panels 321 to 324, but is not limited thereto.
  • the plurality of underwater sensors 121 to 126 provided in the underwater sensor module 120 are connected to the plurality of display panels 321 to 324 so as not to obscure the plurality of display panels 321 to 324. ) may be arranged side by side, forming one or more lines in the horizontal or vertical direction, but are not limited to this. A more specific arrangement method of the underwater sensor module 120 described above will be described in detail in FIGS. 8A to 8C.
  • the plurality of water surface sensors 111 to 116 provided in the water surface sensor module 110 can sense one or more body parts of a swimmer protruding above the water surface.
  • the first water sensor 111 can sense the head among the body parts of the first swimmer 21, and the second water sensor 112 can sense the left arm among the body parts of the second swimmer 22.
  • the body and head area can be sensed.
  • the plurality of water surface sensors 111 to 116 may detect a response signal (echo signal) reflected from one or more sensed body parts of the swimmer.
  • a response signal echo signal
  • the sleep sensor module 110 collects one or more response signals (echo signals) detected by the plurality of sleep sensors 111 to 116 and provides coordinate information (X) where each sensed body part of the swimmer is located. , Y), first information about the swimmer's body part including distance information from the water surface to the sensed body part and body part identification information identifying the sensed body part can be obtained.
  • the body part identification information may be predefined as head, right arm, left arm, etc., but is not limited thereto. A specific method of obtaining first information about a swimmer's body part by the above-described water surface sensor module 110 will be described in detail with reference to FIG. 9.
  • a plurality of underwater sensors 121 to 126 provided in the underwater sensor module 120 can sense one or more body parts of a swimmer located below the water surface.
  • the first underwater sensor 121 can sense the head, left arm, and left leg of the body parts of the third swimmer 23, and the third underwater sensor 123 can sense the body parts of the fourth swimmer (23). 24)
  • the right leg and left leg can be sensed.
  • the plurality of underwater sensors 121 to 126 may detect a response signal (echo signal) reflected from the sensed one or more body parts of the swimmer.
  • a response signal echo signal
  • the underwater sensor module 120 collects one or more response signals (echo signals) detected by the plurality of underwater sensors 121 to 126 and provides coordinate information (X) where each sensed swimmer's body part is located. , Y) and second information about the swimmer's body part, including distance information from the pool floor to the sensed body part, can be obtained.
  • a specific method of acquiring second information about a swimmer's body part using the underwater sensor module 120 described above will be described in detail with reference to FIG. 10.
  • the plurality of sensors provided in the sleep sensor module 110 may be a LiDAR (Light Detection And Ranging) sensor or a Radar (RAdio Detection And Ranging) sensor. It is not limited to this.
  • a LiDAR sensor may refer to a sensor that detects an object by firing a laser and sensing a reflected echo signal.
  • a radar sensor may refer to a sensor that detects an object by emitting electromagnetic waves and detecting the reflected electromagnetic waves.
  • LiDAR sensors or radar sensors have relatively low data resolution and low sampling rate compared to cameras, but have the advantage of low privacy issues because they are difficult to distinguish specific people.
  • it has the advantage of being able to detect multiple objects at the same time, having a relatively long detection area compared to a camera, and being relatively less affected by bad external weather and illumination environments.
  • the plurality of sensors provided in the underwater sensor module 120 may be an optical sensor or an ultrasonic sensor, but are not limited thereto.
  • the optical sensor may be a LiDAR (Light Detection And Ranging) sensor or a ToF (Time of Flight) infrared proximity sensor, but is not limited thereto.
  • a ToF infrared proximity sensor transmits an infrared signal modulated into a signal of a specific frequency from the sensor's transmitter, detects the infrared signal reflected by the object and returns from the sensor's receiver, and then calculates the round-trip time of the infrared signal to the object. It may refer to a sensor that detects an object using phase change.
  • optical sensors have the advantage of being easy to maintain because they can be placed at the bottom of a medium such as acrylic with high optical transmittance.
  • an ultrasonic sensor generally refers to a sensor that detects an object using the time difference between the sound transmitted from the transmitter and the reflected response sound (echo sound).
  • ultrasonic sensors have the advantage of having a high object recognition rate because they are not subject to environmental influences such as external illumination, and being able to detect a wide range of objects due to their large Field of View (FoV).
  • FoV Field of View
  • FIGS. 7(a) to 7(b) are cross-sectional views showing the sleep sensor module 110 of FIG. 3 from above.
  • the number and arrangement method of a plurality of water sensors provided in the water sensor module 110 may be determined based on the size of the swimming pool and the sensing range of the water sensor. .
  • a blind spot may occur outside the sensing range sensed by the first and nth sleep sensors 111 to 11n.
  • the blind spot refers to an area not covered by the first to nth sensing ranges sensed by the first and nth sleep sensors 111 to 11n.
  • the sleep sensor module 110 shown in FIG. 7(b) it can be arranged so that no blind spot occurs within the range sensed by the first and mth sleep sensors 111 to 11m.
  • the entire detection target area by the first and m sleep sensors 111 to 11m is measured by the first sleep sensor 111. It may be covered by at least one of the first sensing range to the mth sensing range by the mth sleep sensor 11m.
  • the number m of sleep sensors in FIG. 7(b) may be determined to be larger than the number n of sleep sensors in FIG. 7(a).
  • FIGS. 8A to 8C are cross-sectional views showing the underwater sensor module 120 of FIG. 2 from above.
  • the number and arrangement method of a plurality of underwater sensors provided in the underwater sensor module 120 are determined by the bezel spacing (D1, D2) of the display 820 disposed on the bottom of the swimming pool and the underwater It can be determined based on the sensing range of the sensor.
  • the plurality of underwater sensors according to an embodiment of the present invention is located between the display panels 821 to 829 in the horizontal direction or It is preferably arranged side by side, forming a plurality of rows and columns in the vertical direction, but is not limited to this.
  • Figure 8a(a) shows an embodiment in which a plurality of underwater sensors are arranged side by side between a plurality of display panels 821 to 829 to form a grid-shaped line inside the display 820.
  • Figure 8a(d) is a conceptual diagram showing a partial expansion of area A shown in Figure 8a(a), where a plurality of underwater sensors 8201 to 8205 are positioned vertically between the display panels 821 and 822.
  • An example in which the lines are arranged side by side to form a line in a specific direction is shown in detail.
  • the display 300 when the display 300 according to an embodiment of the present invention is oriented bezel-less, it displays in the horizontal direction or vertical direction as shown in FIGS. 8A(b) to 8A(C). They may be arranged side by side forming one or more lines in a vertical direction or may be placed only in some areas of the line, but are not limited to this.
  • Figure 8b(a) shows an embodiment in which a plurality of underwater sensors according to an embodiment of the present invention are arranged side by side, forming one or more lines in the vertical direction between display panels 821 to 829.
  • Figure 8b(b) is a conceptual diagram showing a partial expansion of area B shown in Figure 8b(a), and Figure 8b(c) shows the first and third underwater sensors shown in Figure 8b(b) ( This is a conceptual diagram showing the sensing range (8201 to 8203).
  • FIG. 8b(d) is a conceptual diagram showing the first and third underwater sensors 8201 to 8203 of FIG. 8b(c) from the front, and shows the overall detection by the first and third underwater sensors 8201 to 8203. It shows a target area 8300 and a sensing range 8400 sensed by the first and third underwater sensors 8201 to 8203.
  • the Field of View (FoV) of the first to third underwater sensors 8201 to 8203 provided in the underwater sensor module 120 may be defined as ⁇ .
  • the first to third underwater sensors (8201 to 8203) are all arranged in a direction perpendicular to the display panel, the first to third underwater sensors (8201 to 8203) as shown in FIG. 8B (d) Blind spots that are outside the sensing range may occur.
  • the blind spot is detected by the first to third underwater sensors 8201 to 8203 among the entire detection target area 8300 by the first and third underwater sensors 8201 to 8203 below the water surface. This refers to the area that is not covered by the sensing range being sensed.
  • the underwater sensor module 120 arrangement method shown in FIG. 8C it can be placed so that no blind spot occurs within the sensing range sensed by the first and third underwater sensors 8201 to 8203 below the water surface. there is.
  • Figure 8c(a) shows an embodiment in which a plurality of underwater sensors according to an embodiment of the present invention are arranged side by side, forming one or more lines in the vertical direction between display panels 821 to 829.
  • Figure 8c (b) is a conceptual diagram showing a partial expansion of area C shown in Figure 8c (a), and Figure 8c (c) shows the first and third underwater sensors 8201 shown in Figure 8c (b).
  • to 8203) is a conceptual diagram illustrating an embodiment in which at least one underwater sensor is disposed inclined by a predefined inclination angle based on the vertical direction of the display panel.
  • Figure 8c(d) is a conceptual diagram showing the first and third underwater sensors 8201 to 8203 of Figure 8c(c) from the front, and shows the overall detection by the first and third underwater sensors 8201 to 8203. It shows a target area 8300 and a sensing range 8400 sensed by the first and third underwater sensors 8201 to 8203.
  • the Field of View (FoV) of the plurality of underwater sensors 8201 to 8203 may be defined as ⁇ .
  • the first underwater sensor 8201 is disposed in the vertical direction of the display panel
  • the second underwater sensor 8202 has a first inclination angle ⁇ in the vertical direction of the display panel.
  • the third underwater sensor 8203 may be disposed inclined by a second inclination angle ( ⁇ ) in the vertical direction of the display panel.
  • the entire detection target area 8300 will be covered by at least one of the first to third sensing ranges by the first to third underwater sensors 8201 to 8203. You can.
  • the first underwater sensor disposed in the vertical direction of the display panel is referred to as a 'vertical measurement underwater sensor 8201', and is spaced apart from the vertical measurement underwater sensor and has a first inclination angle ( ⁇ ) in the vertical direction of the display panel.
  • the second underwater sensor disposed at an inclination is called a 'first inclination measurement underwater sensor 8202', and the second inclination measurement underwater sensor is spaced apart from the second inclination measurement underwater sensor and is disposed at an angle as much as a second inclination angle ( ⁇ ) in the vertical direction of the display panel.
  • the third underwater sensor is named 'second tilt measurement underwater sensor 8203'.
  • the tilt angle range of the tilt measuring underwater sensor disposed at an inclination angle with the vertical direction of the display panel is configured to be more diverse, such as the above-described first to second tilt measuring underwater sensors 8202 to 8203, the above-mentioned blind angle The rent may be further reduced.
  • the arrangement method of the underwater sensor module 120 according to an embodiment of the present invention may be determined, but is not limited thereto.
  • the water surface sensor module collects one or more response signals (echo signals) reflected from the one or more sensed body parts of the swimmer and provides coordinate information (x, y) of the sensed body parts and the sensing
  • An image 901 including the body part can be extracted.
  • the coordinate information (X, Y) of the sensed body part may be information indicating where the body part is located inside the pool.
  • the image 901 shown in FIG. 9 may illustrate an image extracted by a plurality of lidar sensors provided in a sleep sensor module according to an embodiment of the present invention.
  • the body part identification information may be predefined as, for example, a head, chest, right arm, or right leg, but is not limited thereto.
  • the distance from the water surface to the swimmer's head can be obtained.
  • the extracted distance will be referred to as 'swimmer's head height ( Sh )'.
  • the distance from the water surface to the body part at the highest position can be obtained.
  • the extracted distance will be referred to as 'swimmer's highest height ( Sp )'.
  • the swimmer's head height ( Sh ) and the swimmer's maximum height ( Sp ) obtained by the above-described method may be included in the distance information from the water surface to the sensed body part, but are not limited to this.
  • one or more response signals reflected from one or more sensed body parts of the swimmer may be converted into a spectral image to extract the location of the swimmer's body part and an image including the swimmer's body part.
  • the location of the swimmer's body part and an image including the swimmer's body part can be extracted through preprocessing for ambient noise and spectral image conversion for response signals from a plurality of directions, but the method is not limited to this.
  • a response signal reflecting object characteristic information in space can be received.
  • the underwater sensor module collects one or more response signals (echo signals) reflected from the one or more sensed body parts of the swimmer and provides coordinate information (X, Y) of the sensed body parts and the bottom of the swimming pool. Distance information from the surface can be obtained.
  • response signals echo signals
  • X, Y coordinate information
  • the vertical measurement underwater sensor 8201 can sense the right leg of the fifth swimmer 25.
  • the distance ( Sf ) between the bottom of the pool and the right leg of the fifth swimmer 25 is the distance to the right leg of the fifth swimmer 25 measured by the vertical measurement underwater sensor 8201. It can be calculated as distance ( Sm ).
  • the first tilt measurement underwater sensor 8202 shown in FIG. 10(b) can sense the left leg of the sixth swimmer 26, and the second tilt measurement underwater sensor 8203 can sense the sixth swimmer 26.
  • the left shoulder area of the swimmer (26) can be sensed.
  • the distance ( Sfl ) between the bottom of the pool and the left leg of the sixth swimmer 26 is the distance to the left leg of the sixth swimmer 26 measured by the first inclination measurement underwater sensor 8202. It can be calculated as in [Equation 1] using the distance ( Sml) and the first inclination angle ( l ) of the first inclination measurement underwater sensor 8202.
  • the distance ( Sfu ) between the pool floor and the left shoulder area of the sixth swimmer 26 is the left shoulder area of the sixth swimmer 26 measured by the second inclination measurement underwater sensor 8203. It can be calculated as in [Equation 2] using the distance to ( Smu ) and the second inclination angle ( u ) of the second inclination measurement underwater sensor 8203.
  • FIGS. 11 to 17 the processor 200, one of the components of the interaction pool system according to an embodiment of the present invention, will be described in detail.
  • Figure 11 is an internal block diagram of the processor 200 according to an embodiment of the present invention
  • Figure 12 shows the processor 200 including a water sensor module 110, an underwater sensor module 120, a display 300, and a memory.
  • This is a configuration diagram showing the process of linking with (400).
  • the processor 200 includes a swimmer information generation module 210, a swimmer position monitoring module 220, a swimmer state detection module 230, and an application control module ( 240), but is not limited thereto.
  • the swimmer information generation module 210 provides first and first information about the swimmer's body parts input from the surface sensor module 110 and the underwater sensor module 120.
  • the second information can be synthesized to generate swimmer information about the swimmer including the swimmer's body parts, and the generated swimmer information can be stored in the memory 400 operably coupled to the processor 200. .
  • the swimmer information stored in the memory 400 includes swimmer identification information (1, 2,,,,N), swimmer's position information, height information, and posture (Gesture) that identify the swimmer. ) may include one or more of information and motion information, but is not limited thereto. In addition, the swimmer information may further include first and second information about the swimmer's body parts input from the surface sensor module 110 and the underwater sensor module 120, but is not limited thereto.
  • the algorithm for generating swimmer information about the swimmer by combining the received first and second information according to an embodiment of the present invention is called a ‘swimming sensor fusion algorithm.’
  • the swimmer position monitoring module 220 refers to one or more swimmer information generated by the swimmer information generation module 210, and stores the information inside the pool.
  • the location (x, y) of one or more swimmers located in can be monitored, and the location information (x, y) of the swimmer information stored in the memory 400 can be updated based on the monitoring results. .
  • the swimmer status detection module 230 determines the status of one or more swimmers based on the monitoring results by the swimmer position monitoring module 220 and the swimming pool information stored in the memory 400. may be detected, and one or more preset events corresponding to the detection results may be generated.
  • a specific method by which the above-described swimmer state detection module 230 detects the swimmer's state will be described in detail with reference to FIG. 15.
  • the application control module 240 included in the processor 200 can detect the generated event and control the execution of the application corresponding to the event, and also execute the application.
  • the screen can be controlled to be output on the display 300.
  • the application control module 240 can detect the generated event and control the notification information included in the event to be transmitted to the peripheral device 700 through the communication module 500. , but is not limited to this.
  • the swimmer creation module 210 calculates swimmer information about a swimmer through a swimming sensor fusion algorithm.
  • the swimmer information generation module 210 generates swimmer identification information (1, 2,,,,N) that can be uniquely assigned to each swimmer in order to identify the swimmer including the sensed body part. can do.
  • an object that is not a part of the swimmer's body may be included.
  • a deep learning-based overlapping detection algorithm may be applied to distinguish objects that are not part of the swimmer's body from the swimmer's body part.
  • the deep learning-based overlapping detection algorithm includes coordinate information (x, y), posture information (Gesture), and swimmer's head height of one or more objects sensed by the water sensor module 110 and the underwater sensor module 120. and may be performed using the swimmer's highest height, but are not limited thereto.
  • the swimmer information generation module 210 receives the coordinate information (x, y) of the body part sensed above the water and the coordinate information (x, y) of the body part sensed below the water and performs swimming sensor fusion. Through an algorithm, location information (x, y) where the identified swimmer is located can be generated.
  • the swimmer information generation module 210 includes the swimmer's head height obtained by the water sensor module 110 and the distance information and coordinates from the water surface to the sensed body part obtained by the underwater sensor module 120.
  • Information (x, y) can be input to generate height information (Height) of the identified swimmer.
  • FIGS. 13(a) to 13(b) a method of generating height information of a swimmer through a swimming sensor fusion algorithm according to an embodiment of the present invention will be described in detail, but is not limited thereto.
  • the swimmer's height information ( Sheight ) includes the swimmer's head height ( Sh ) obtained from the water sensor module 110, the height from the bottom of the pool to the water surface ( Hs ), and the first Using the distance ( Sf ) from the bottom of the pool to the swimmer's body part obtained from the underwater sensor 8201, it can be calculated as shown in [Equation 3] below.
  • posture information can be generated by inferring the posture of the swimmer.
  • one or more body parts of the swimmer corresponding to the upper body part of the swimmer are sensed, and both the swimmer's head height ( Sh ) and the swimmer's highest height ( Sp ) are measured. If the swimmer's upper body is longer than the length that can be calculated in proportion to the swimmer's height, it can be determined that the swimmer's upper body is exposed above the water. At this time, as shown in Figure 14(b), if the swimmer's highest height ( Sp ) is higher than the swimmer's head height ( Sh ) and the body part corresponding to the swimmer's highest height ( Sp ) is determined to be the arm, swimming It can be inferred that the person is in a posture with his arms raised above the water.
  • the swimmer's upper body length that can be calculated in proportion to the swimmer's height information may be calculated in a range of 1/3 to 1/2 of the swimmer's height, but is not limited thereto.
  • the swimmer's head and arm areas are sensed, and the swimmer's head height ( Sh ) is less than or equal to the swimmer's upper body length that can be calculated in proportion to the swimmer's height (Height), If it is determined that the body part corresponding to the swimmer's highest height ( Sp ) is the arm area, it can be inferred that the swimmer is lying on the water's surface with his arms raised.
  • the swimmer information generation module 210 receives first and second information about the swimmer's body parts and uses a swimming sensor fusion algorithm to determine the identified swimmer's movement pattern (Motion Pattern). ) can generate motion information including.
  • the above-mentioned swimmer's movement pattern is (1) the swimmer's movement speed, (2) the swimmer's up-down and left-right movement pattern, (3) the up-down and left-right movement pattern of the swimmer's specific body part, and (4) swimming. It may include, but is not limited to, the head height and the swimmer's highest height movement pattern.
  • the swimmer's movement speed may be calculated based on changes in the swimmer's position information (x, y) included in the swimmer information.
  • the swimmer's vertical movement pattern can be calculated based on changes in distance information from the pool floor obtained by the underwater sensor module 120, and the swimmer's left and right movement pattern is determined by the underwater sensor module ( 120) can be calculated based on changes in the value of x among the coordinate information (x, y) of the body part obtained.
  • the up-down and left-right movement patterns of specific body parts exposed on the surface of the water may be calculated based on changes in body part identification information and body part coordinate information (x, y) obtained by the sleep sensor module 110.
  • the vertical and left-right movement patterns of specific body parts located below the water surface may be coordinate information (x, y) of one or more swimmer body parts sensed within a specific area of the swimming pool acquired by the underwater sensor module 120. It can be calculated based on changes in , but is not limited to this.
  • the swimmer's head height movement pattern can be calculated based on a change in the swimmer's head height obtained by the water surface sensor module 110, and the swimmer's maximum height motion pattern information is stored in the water surface sensor module 110. It may be calculated based on body part identification information obtained by the user and changes in the swimmer's maximum height, but is not limited to this.
  • the above-described movement pattern information of the swimmer may be generated by learning using a generally known deep learning-based image processing algorithm, but is not limited to this.
  • the swimmer's movement pattern information may be information used to detect whether the swimmer intentionally moves with a specific movement pattern or whether the swimmer unintentionally moves with an abnormal movement pattern, but is not limited to this. no.
  • the swimmer position monitoring module 220 is located inside the pool based on the swimmer information generated by the swimmer information generation module 210 described above. The position of the swimmer can be monitored.
  • the swimmer's current position (x, y) included in the swimming pool information is compared with the swimmer's previous position (x, y) stored in the memory 400, and the swimmer's position inside the pool is compared. It is possible to detect whether has changed. Additionally, based on the detection result, the swimmer's location information stored in the memory 400 can be updated to the swimmer's current location (x, y) to monitor the swimmer's location.
  • the swimmer state detection module 230 determines the state of one or more swimmers by referring to the swimmer position monitoring result and the swimmer information stored in the memory 400. It can be detected.
  • the swimmer state detection 230 detects the swimmer's state and generates a preset event based on the detection result will be described in detail.
  • the swimmer status detection module 230 can count the number of swimmers in the pool based on the above-described swimmer position monitoring results and swimmer information stored in the memory 400.
  • the complexity of the pool is set to 'HIGH', 'MIDDLE', or 'LOW' based on the number of swimmers and the predefined pool capacity range. It can be calculated. Additionally, if the number of swimmers located inside the pool is undetectable, the complexity of the pool may be further calculated as 'VERY HIGH', but is not limited to this.
  • notification information including location information of the swimmer and swimming pool complexity may be generated to generate a predefined event.
  • the swimmer status detection module 230 determines whether one or more swimmers will be able to identify a pool with a depth appropriate for the swimmer's height. It is possible to detect whether it is located in an area.
  • notification information including the swimmer's identification information, location information, and a warning message can be generated to generate a predefined event.
  • the swimmer status detection module 230 detects the time that one or more swimmers stay in the pool based on the above-described swimmer position monitoring results and the swimmer information stored in the memory 400. You can.
  • notification information including the swimmer's identification information, location information, and a rest guidance message is generated and predefined. event can occur.
  • the swimmer state detection module 230 refers to the swimmer position monitoring result and the swimmer information stored in the memory 400, and determines the swimmer's movement pattern information included in the swimmer information in advance. It can be determined whether it matches the defined abnormal movement pattern of the swimmer.
  • Figure 16(a) shows an abnormal state in which a swimmer is struggling in a pool.
  • the swimmer's movement pattern shown in FIG. 16(a) is referred to as the 'floundering movement pattern'.
  • the swimmer's vertical movement pattern included in the swimmer's movement information matches the vertical movement pattern included in the predefined 'swimmer's floundering movement pattern', and the vertical movement pattern is set for a preset time. By detecting whether the swimmer is repeating a preset number of times or more, it can be determined that the swimmer is performing a 'floundering movement pattern'.
  • the swimmer's arm may be repeatedly exposed to the surface of the water or the arm may repeatedly move in the up and down directions.
  • the vertical movement pattern of the arm exposed to the surface of the water included in the swimmer's movement information matches the vertical movement pattern of the arm included in the predefined 'swimmer's floundering movement pattern', and By detecting whether the vertical movement pattern of the arm is repeated more than a preset number of times during a preset time, it can be determined that the swimmer is performing a 'floundering movement pattern'.
  • Figure 16(b) shows an abnormal state in which a swimmer's head is slowly submerged or repeatedly submerged in a pool.
  • the swimmer's movement pattern shown in Figure 16(b) is referred to as the 'head locked movement pattern'.
  • the swimmer's head may generally repeat the motion of being positioned below the water surface or protruding above the water surface by a predefined length, and the swimmer's hand region may repeat the motion of protruding above the water surface.
  • the swimmer's head height included in the swimmer's movement pattern information is maintained at 0 for more than a certain period of time predefined in the 'head locked movement pattern', or is repeatedly changed within a predefined predetermined length range.
  • it detects whether or not, it can be determined that the swimmer is performing a 'head locked motion pattern'.
  • Figure 16(c) shows an abnormal state in which the swimmer's head sinks to the bottom of the pool.
  • an embodiment of repeating the 'whole body locked movement pattern' of the swimmer's movement pattern shown in FIG. 16(c) is shown.
  • the swimmer's head height and the swimmer's maximum height are maintained at 0 for more than a predetermined time predefined in the 'head locked movement pattern', and the swimmer's water surface included in the swimmer's movement pattern information is moved in the up-down or left-right direction If the movement pattern gradually decreases, it can be determined that the swimmer is performing a 'whole heart locked movement pattern'.
  • Figure 16(d) shows a swimmer in progress of drowning.
  • the swimmer's movement pattern shown in FIG. 16(d) is referred to as the 'drowning state movement pattern'.
  • the swimmer may generally be in a floating position without movement on the water surface, and the back of the swimmer's head, part of the back, or part of the leg may protrude above the water surface.
  • the swimmer's body parts sensed above the water based on the body part identification information included in the swimmer's movement information include the back of the swimmer's head, etc. region, or in the case of the leg region, it may be determined that the swimmer is performing a 'drowning state movement pattern'.
  • the swimmer's head height and the swimmer's highest height are maintained within a predetermined range predefined in the 'head submerged movement pattern', it may be determined that the swimmer is 'moving in a drowning state'.
  • the swimmer status detection module 230 When the above-described abnormal movement pattern of the swimmer is detected, the swimmer status detection module 230 according to an embodiment of the present invention generates notification information including the swimmer's identification information, location information, and a risk information message, and predefines event can occur.
  • the swimmer status detection module 230 based on the above-described swimmer position monitoring results and the swimmer information stored in the memory 400, transmits the swimmer's movement pattern information included in the swimmer information to the swimming pool system. It can be determined whether it matches a predefined operation pattern in a plurality of installed game applications.
  • FIG. 17(a) to 17(c) show execution screens of one or more game applications according to an embodiment of the present invention.
  • FIG. 17(a) is an exemplary diagram illustrating the Aqua DDR game according to an embodiment
  • FIG. 17(b) is an exemplary diagram illustrating the Aqua Piano game.
  • Figure 17(c) is an example diagram showing Aqua Mole (mole game).
  • the swimmer state detection module 230 when one or more predefined game applications are activated, the swimmer's movement pattern information included in the swimmer information is predefined in the specific game application. It can be determined whether it matches the movement pattern.
  • Predefined movement patterns in the specific game application may include Stand, Jump, Waving L/R Hand, Region Pressing by foot, etc., but are not limited thereto.
  • the stand pattern means that the swimmer is detected standing in a portion (331 to 333) of the area where the game screen shown in FIGS. 17(a) to 17(c) is displayed.
  • the jump pattern means that the swimmer is detected in a jumping state in a portion (331 to 333) of the area where the game screen is displayed.
  • the Waving L/R Hand pattern means that the swimmer is detected to be waving his or her left or right hand.
  • Region Pressing by foot means that the swimmer is detected pressing a specific area where the game screen is displayed with his or her foot.
  • the swimmer state detection module 230 When one or more game application movement patterns described above are detected, the swimmer state detection module 230 according to an embodiment of the present invention sends notification information including the swimmer's identification information and location information and the game application movement pattern information. You can create a preset event.
  • the display 300 included in the swimming pool system 10 may include one or more displays, at least one of the one or more displays is arranged in the form of a rooftop signage display, and at least another one can be placed on the bottom of the swimming pool in the form of a flow signage display.
  • an application execution screen may be displayed on one or more of the displays described above, but the application is not limited to this.
  • the processor when one or more body parts of a swimmer are detected in an area where one or more game application execution screens are displayed, the processor outputs the initial screen of a launcher application that executes the game application to the display. You can.
  • the application control module may execute the corresponding application based on the detected game-related movement pattern. Additionally, the application control module can control the executed application game screen to be output on the display.
  • the swimmer status detection module determines whether the movement information included in the swimmer information matches the movement pattern related to the running application, such as Stand, Jump, Waving L/R Hand, and Region Pressing by foot, and controls the running application. can do. Also, based on this, the newly created application game screen can be controlled to be output on the display.
  • the movement pattern related to the running application such as Stand, Jump, Waving L/R Hand, and Region Pressing by foot
  • an embodiment in which the Aqua DDR application of FIG. 17(a) is executed may be considered.
  • the initial screen of the launcher application that runs the Aqua DDR application may be displayed on the display.
  • the swimmer state detection module can determine whether the movement information included in the swimmer information matches the jump motion used in the Aqua DDR application. Additionally, based on the judgment result, the newly created Aqua DDR application execution screen can be controlled to be output on the display, but is not limited to this.
  • the control method of the interaction swimming pool system 10 includes obtaining first and second information (S11), generating swimmer information (S12), and event It may include a step of generating (S13) and a step of controlling to be output on the display (S14).
  • the swimmer's body part is sensed through the first sensor module above the water and the second sensor module below the water, and the first and second information related to the swimmer's body part are detected. 2 Information can be obtained.
  • the first sensor module above the water is provided with a plurality of water sensors above the water, and can detect one or more response signals (echo signals) reflected from one or more body parts of the swimmer protruding above the water.
  • one or more detected response signals (echo signals) are collected to provide coordinate information (X, Y) where each sensed swimmer's body part is located, distance information from the water surface to the sensed body part, and identification of the sensed body part.
  • First information about the swimmer's body part including body part identification information may be obtained.
  • the second sensor module below the water surface includes a plurality of underwater sensors and can detect one or more response signals (echo signals) reflected from the swimmer's body part located below the water surface. Additionally, by collecting one or more detected response signals (echo signals), coordinate information (X, Y) of the sensed body part and distance information from the bottom of the swimming pool can be obtained.
  • echo signals response signals reflected from the swimmer's body part located below the water surface. Additionally, by collecting one or more detected response signals (echo signals), coordinate information (X, Y) of the sensed body part and distance information from the bottom of the swimming pool can be obtained.
  • the first and second information input from the first and second sensor modules are synthesized to determine the swimmer's position, height, and posture ( Gesture and motion information and swimmer identification information (1, 2,,,,N) that identifies the swimmer can be generated.
  • swimmer identification information and the first and second information input from the first and second sensor modules may be further included and stored in the memory.
  • the swimmer's state is detected based on the generated swimmer information, and notification information related to the detected swimmer's state is generated to generate an event.
  • the above-mentioned notification information related to the swimmer's condition includes swimming pool complexity notification, warning notification based on detection of suitability of the swimmer's height, notification of the swimmer's elapsed time in the pool and rest guide notification, and risk due to detection of the swimmer's abnormal movement condition. It may include, but is not limited to, warning notifications and notification information related to specific game applications.
  • the step of controlling output to the display may include executing one or more applications installed in the swimming pool system or a specific operation of the application corresponding to the generated event. Additionally, the step of controlling the application execution screen to be output on one or more display screens included in the display may include, but is not limited to this.
  • Computer-readable media includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include HDD (Hard Disk Drive), SSD (Solid State Disk), SDD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. It also includes those implemented in the form of carrier waves (e.g., transmission via the Internet). Additionally, the computer may include a terminal control unit. Accordingly, the above detailed description should not be construed as restrictive in all respects and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Electromagnetism (AREA)
  • Architecture (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Structural Engineering (AREA)
  • Civil Engineering (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

La présente invention concerne un système de piscine à interaction comprenant : des modules de capteur, qui détectent une ou plusieurs parties du corps d'un nageur par l'intermédiaire d'un module de capteur de surface d'eau disposé sur la surface d'eau et un module de capteur subaquatique disposé sous l'eau, de façon à acquérir des premières informations et des secondes informations concernant les parties du corps du nageur ; et un processeur qui génère des informations de position, de hauteur, de geste et de mouvement concernant un nageur par fusion, par l'intermédiaire d'un algorithme de fusion de capteur de natation, des premières informations et des secondes informations qui sont entrées par des premier et second modules de capteur, et qui génère un événement sur la base des informations générées, le processeur contrôlant le fait qu'un écran d'exécution d'application correspondant à l'événement généré est délivré à un dispositif d'affichage.
PCT/KR2022/014775 2022-09-30 2022-09-30 Système d'interaction intelligent basé sur une surveillance d'état de nageur WO2024071486A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2022/014775 WO2024071486A1 (fr) 2022-09-30 2022-09-30 Système d'interaction intelligent basé sur une surveillance d'état de nageur

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2022/014775 WO2024071486A1 (fr) 2022-09-30 2022-09-30 Système d'interaction intelligent basé sur une surveillance d'état de nageur

Publications (1)

Publication Number Publication Date
WO2024071486A1 true WO2024071486A1 (fr) 2024-04-04

Family

ID=90478250

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2022/014775 WO2024071486A1 (fr) 2022-09-30 2022-09-30 Système d'interaction intelligent basé sur une surveillance d'état de nageur

Country Status (1)

Country Link
WO (1) WO2024071486A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20000024295A (ko) * 2000-02-03 2000-05-06 박동수 수영장 익사방지 감지 시스템
JP2010534514A (ja) * 2007-07-23 2010-11-11 アクアティック セイフティ コンセプツ エルエルシー 遊泳者電子監視システム
KR20170032740A (ko) * 2015-09-15 2017-03-23 임태현 다기능 부이봇 시스템
JP2020173751A (ja) * 2019-04-08 2020-10-22 株式会社ショウエイ 遊泳者又は入浴者の安全監視警報システム
KR20220102048A (ko) * 2021-01-12 2022-07-19 고두균 인공지능을 이용한 적응적 인지영역 설정 기반의 cctv 시스템 및 그 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20000024295A (ko) * 2000-02-03 2000-05-06 박동수 수영장 익사방지 감지 시스템
JP2010534514A (ja) * 2007-07-23 2010-11-11 アクアティック セイフティ コンセプツ エルエルシー 遊泳者電子監視システム
KR20170032740A (ko) * 2015-09-15 2017-03-23 임태현 다기능 부이봇 시스템
JP2020173751A (ja) * 2019-04-08 2020-10-22 株式会社ショウエイ 遊泳者又は入浴者の安全監視警報システム
KR20220102048A (ko) * 2021-01-12 2022-07-19 고두균 인공지능을 이용한 적응적 인지영역 설정 기반의 cctv 시스템 및 그 방법

Similar Documents

Publication Publication Date Title
WO2020071839A1 (fr) Dispositif et procédé de surveillance de port et de navires
WO2018151368A1 (fr) Robot domestique modulaire
WO2018097558A1 (fr) Dispositif électronique, serveur et procédé pour déterminer la présence ou l'absence d'un utilisateur dans un espace spécifique
WO2016074169A1 (fr) Procédé de détection de cible, dispositif détecteur, et robot
WO2017008224A1 (fr) Procédé de détection de distance à un objet mobile, dispositif et aéronef
WO2018105842A1 (fr) Système de détection d'incident à haute précision basé sur un radar
WO2017183920A1 (fr) Dispositif de commande destiné à un véhicule
WO2020175786A1 (fr) Procédés et appareils de détection de présence d'objet et d'estimation de distance
WO2014051362A1 (fr) Capteur de proximité et procédé de détection de proximité utilisant un capteur de vision fondé sur des évènements
WO2015182956A1 (fr) Procédé et dispositif permettant de générer des données représentant la structure d'une pièce
WO2016140394A1 (fr) Dispositif de prévention d'un accident de véhicule et son procédé d'exploitation
WO2022245189A1 (fr) Estimation conjointe de fréquences respiratoires et cardiaques au moyen d'un radar à ultra-large bande
WO2020059939A1 (fr) Dispositif d'intelligence artificielle
WO2020171561A1 (fr) Appareil électronique et procédé de commande correspondant
WO2019231042A1 (fr) Dispositif d'authentification biométrique
WO2019172642A1 (fr) Dispositif électronique et procédé pour mesurer la fréquence cardiaque
WO2020262737A1 (fr) Robot de nettoyage intelligent
WO2018151504A1 (fr) Procédé et dispositif de reconnaissance d'emplacement de pointage à l'aide d'un radar
WO2024071486A1 (fr) Système d'interaction intelligent basé sur une surveillance d'état de nageur
WO2018135745A1 (fr) Procédé et dispositif pour générer une image pour indiquer un objet sur la périphérie d'un véhicule
WO2020246639A1 (fr) Procédé de commande de dispositif électronique de réalité augmentée
WO2021107709A1 (fr) Procédé et dispositif pour calculer la probabilité d'être infecté par ou d'avoir une maladie, et procédé et dispositif pour délivrer en sortie un sujet à tester pour une maladie
WO2015080498A1 (fr) Procédé de détection de corps humain par l'analyse d'informations de profondeur et appareil d'analyse d'informations de profondeur pour la détection de corps d'utilisateur
WO2020171572A1 (fr) Appareil électronique et procédé de commande de celui-ci
WO2020204355A1 (fr) Dispositif électronique et son procédé de commande

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22961087

Country of ref document: EP

Kind code of ref document: A1