WO2024054090A1 - Electronic device and system for controlling plurality of speakers in order to test auditory response speed and directionality - Google Patents

Electronic device and system for controlling plurality of speakers in order to test auditory response speed and directionality Download PDF

Info

Publication number
WO2024054090A1
WO2024054090A1 PCT/KR2023/013503 KR2023013503W WO2024054090A1 WO 2024054090 A1 WO2024054090 A1 WO 2024054090A1 KR 2023013503 W KR2023013503 W KR 2023013503W WO 2024054090 A1 WO2024054090 A1 WO 2024054090A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
speakers
audio output
reaction
electronic device
Prior art date
Application number
PCT/KR2023/013503
Other languages
French (fr)
Korean (ko)
Inventor
강민호
Original Assignee
강민호
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 강민호 filed Critical 강민호
Publication of WO2024054090A1 publication Critical patent/WO2024054090A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/12Audiometering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/12Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers

Definitions

  • the present invention relates to an electronic device and system that controls a plurality of speakers to test auditory response speed and directionality. Specifically, the present invention relates to an electronic device and system that output audio from at least four directions and up to infinite directions to target the subject in various directions. This is a technology that can improve the ability to recognize the direction of sound by testing the auditory response speed and directionality.
  • hearing aids are worn for daily life, but in the case of early wearers, the ability to recognize the direction of sounds coming from various directions is poor, and the ability to perceive the direction of sounds coming from various directions is poor. There are issues that are difficult to talk about.
  • Spatial listening ability improvement training equipment has been designed and used to help users of hearing aids learn direction in the early stages of wearing them, and various research equipment is being designed accordingly.
  • the problem to be solved by the present invention is to obtain accurate auditory reaction speed and directionality test results for the subject by applying various audio output orders to perform auditory reaction speed and directionality tests according to unpredictable audio output orders, and to provide test results to the examiner.
  • An electronic device and system for controlling a plurality of speakers are provided to test possible auditory response speed and directionality.
  • the electronic device includes location information for each of the plurality of speakers, and the subject It includes a memory containing location information, a communication unit that communicates with a plurality of speakers, and a processor connected to the memory and the communication unit, where the processor obtains a user command from the first terminal of the examiner through the communication unit, and 1 Based on the user command obtained from the terminal, the audio output order for each of the plurality of speakers is identified, and through the communication unit, based on the audio output order, at least one speaker among the plurality of speakers outputs audio in one order.
  • the audio output for each of the plurality of speakers can be controlled so that the audio is output according to a certain period and a certain number of repetitions.
  • the memory may include a speaker located in front of the subject, audio data, and audio output order.
  • the memory includes channel numbers for each of the plurality of speakers
  • the audio output order includes an audio output order according to the order of the channel numbers, a random audio output order, an audio output order obtained from the first terminal, and It may be any one of the audio output orders according to user commands.
  • the processor obtains response data from the subject's second terminal through the communication unit, and when audio output to the plurality of speakers according to the audio output order is terminated, location information for each of the plurality of speakers, and audio output Auditory directional reaction speed data for the subject is generated based on the order, and the auditory directional reaction speed data is determined by the time when the audio is output and when the user input corresponding to the direction in which the audio is heard is performed through the second terminal.
  • the processor when the processor obtains the first response data for the first audio from the second terminal exceeding the threshold time from when the first audio is output, the processor transmits the first response data to the first audio through the first speaker that output the first audio.
  • 1 Re-output the first audio within a certain sequence from the turn in which the audio was output, obtain second reaction data for the re-output first audio from the second terminal, and obtain a first reaction speed and first response to the first reaction data.
  • a second reaction rate is calculated for the reaction data, and if the difference between the first reaction rate and the second reaction rate exceeds the threshold, but the second reaction rate is faster than the first reaction rate, the first reaction data is calculated as a second reaction rate.
  • the processor controls a plurality of speakers to output audio for the next turn according to the audio output order, and the response data is determined at the time when the response data is generated and when the subject hears the audio. It may include at least one of a user input for selecting a channel number for at least one audible direction, and a user input for the absence of an audible direction.
  • At least one speaker among the plurality of speakers outputs audio in one order.
  • An electronic device that controls audio output from each of a plurality of speakers to output according to a certain period and a certain number of repetitions, and each of the plurality of speakers is connected, and a control command to control the audio output from the electronic device to each of the plurality of speakers. It includes a controller that acquires and controls audio output for each of the plurality of speakers based on control commands.
  • the plurality of speakers are arranged at a uniform angle around the subject's position and at a certain distance from the center, and the angle may be 45 degrees or less.
  • the electronic device and system for controlling a plurality of speakers in order to test the auditory reaction speed and direction of the present invention deviates from the conventional simple manual speaker control method and obtains the test results through a separate terminal, thereby providing accurate numerical values. Confirmation is possible, and by arranging multiple speakers to form an arc centered on the subject, it can help improve reaction speed and directionality in various directions.
  • FIG. 1 is a system configuration diagram according to an embodiment of the present disclosure.
  • FIG. 2 is a basic flowchart according to an embodiment of the present disclosure.
  • Figure 3 is a layout diagram of a plurality of speakers according to an embodiment of the present disclosure.
  • Figure 4 is a system configuration diagram including a controller according to an embodiment of the present disclosure.
  • the term “unit” or “module” refers to a hardware component such as software, FPGA, or ASIC, and the “unit” or “module” performs certain roles.
  • “part” or “module” is not limited to software or hardware.
  • a “unit” or “module” may be configured to reside on an addressable storage medium and may be configured to run on one or more processors.
  • a “part” or “module” refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, Includes procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.
  • the functionality provided within components and “parts” or “modules” can be combined into smaller components and “parts” or “modules” or into additional components and “parts” or “modules”. could be further separated.
  • Spatially relative terms such as “below”, “beneath”, “lower”, “above”, “upper”, etc. are used as a single term as shown in the drawing. It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms that include different directions of components during use or operation in addition to the directions shown in the drawings. For example, if you flip a component shown in a drawing, a component described as “below” or “beneath” another component will be placed “above” the other component. You can. Accordingly, the illustrative term “down” may include both downward and upward directions. Components can also be oriented in other directions, so spatially relative terms can be interpreted according to orientation.
  • a computer refers to all types of hardware devices including at least one processor, and depending on the embodiment, it may be understood as encompassing software configurations that operate on the hardware device.
  • a computer can be understood to include, but is not limited to, a smartphone, tablet PC, desktop, laptop, and user clients and applications running on each device.
  • FIG. 1 is a system configuration diagram according to an embodiment of the present disclosure.
  • an electronic device 100 that controls a plurality of speakers (10-1 to 10-8...10-n, n is an integer), And in the system, the electronic device 100 includes location information for each of the plurality of speakers (10-1 to 10-8...10-n), location information for the subject, a speaker located in front of the subject, and audio.
  • a memory 110 containing data, audio output order, and channel numbers for each of the plurality of speakers 10-1 to 10-8...10-n, a plurality of speakers 10-1 to 10-8. It includes a communication unit 120 that communicates with ..10-n), and a processor 130 connected to the memory 110 and the communication unit 120.
  • the electronic device 100 includes a server, a smartphone, a tablet personal computer, a mobile phone, a video phone, a laptop PC, and a netbook computer. ), a laptop computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a wearable device, or an audiometer.
  • a server a smartphone, a tablet personal computer, a mobile phone, a video phone, a laptop PC, and a netbook computer.
  • PDA personal digital assistant
  • PMP portable multimedia player
  • wearable device or an audiometer.
  • the memory 110 can store various programs and data necessary for the operation of the server 100.
  • the memory 110 may be implemented as a non-volatile memory 110, a volatile memory 110, a flash-memory 110, a hard disk drive (HDD), or a solid state drive (SSD).
  • the communication unit 120 can communicate with an external device.
  • the communication unit 120 may include various communication chips such as USB, Wi-Fi chip, Bluetooth chip, wireless communication chip, NFC chip, and low-energy Bluetooth chip (BLE chip).
  • USB, WiFi chip, Bluetooth chip, and NFC chip communicate in LAN method, WiFi method, Bluetooth method, and NFC method, respectively.
  • Wi-Fi chip or Bluetooth chip various connection information such as SSID and session key are first transmitted and received, and various information can be transmitted and received after establishing a communication connection using this.
  • a wireless communication chip refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), and 5G (5th Generation).
  • the processor 130 can control the overall operation of the server 100 using various programs stored in the memory 110.
  • the processor 130 may be comprised of RAM, ROM, a graphics processing unit, a main CPU, first to n interfaces, and a bus. At this time, RAM, ROM, graphics processing unit, main CPU, first to n interfaces, etc. may be connected to each other through a bus.
  • RAM stores O/S and application programs. Specifically, when the server 100 is booted, the O/S is stored in RAM, and various application data selected by the user may be stored in RAM.
  • ROM stores a set of instructions for booting the system.
  • the main CPU copies the O/S stored in the memory 110 to RAM according to the command stored in the ROM, executes the O/S, and boots the system.
  • the main CPU copies various application programs stored in the memory 110 to RAM and executes the application programs copied to RAM to perform various operations.
  • the graphics processing unit uses a calculation unit (not shown) and a rendering unit (not shown) to create a screen containing various objects such as items, images, and text.
  • the calculation unit may be configured to calculate attribute values such as coordinate values, shape, size, color, etc. for each object to be displayed according to the layout of the screen using a control command received from the input unit.
  • the rendering unit may be configured to generate screens of various layouts including objects based on attribute values calculated by the calculation unit. The screen generated by this rendering unit may be displayed within the display area of the display.
  • the main CPU accesses the memory 110 and performs booting using the OS stored in the memory 110. And, the main CPU performs various operations using various programs, contents, data, etc. stored in the memory 110.
  • the first to n interfaces are connected to the various components described above.
  • One of the first to n interfaces may be a network interface connected to an external device through a network.
  • the processor 130 may include one or more cores (not shown) and a graphics processing unit (not shown) and/or a connection path (e.g., bus, etc.) for transmitting and receiving signals with other components. You can.
  • Processor 130 performs the method described in connection with the present invention by executing one or more instructions stored in memory 110.
  • the processor 130 acquires new training data by executing one or more instructions stored in the memory 110, performs a test on the acquired new training data using a learned model, and performs the test.
  • first learning data in which labeled information is obtained with an accuracy greater than a predetermined first reference value is extracted, the extracted first learning data is deleted from the new learning data, and the new learning data from which the extracted learning data is deleted is extracted.
  • the learned model can be retrained using training data.
  • the processor 130 includes random access memory (RAM) (not shown) and read-only memory (ROM) that temporarily and/or permanently store signals (or data) processed within the processor 130. , not shown) may be further included. Additionally, the processor 130 may be implemented in the form of a system on chip (SoC) that includes at least one of a graphics processing unit, RAM, and ROM.
  • SoC system on chip
  • the memory 110 may store programs (one or more instructions) for processing and control of the processor 130. Programs stored in the memory 110 may be divided into a plurality of modules according to their functions.
  • a first terminal 200 is an electronic device of the examinee
  • a second terminal is the electronic device of the subject.
  • (300) includes a communication module for communicating with the electronic device 100, an input/output module that performs at least one of obtaining a user command and outputting an image including a channel to a speaker, and each of the communication module and the input/output module. It is connected and includes a control module that controls the overall operation of the terminals 200 and 300.
  • the terminals 200 and 300 include a joystick, a remote control, a smartphone, a tablet personal computer, a mobile phone, a video phone, a laptop PC, and a netbook computer. It may include at least one of a netbook computer, a laptop computer, a personal digital assistant (PDA), a portable multimedia player (PMP), and a wearable device.
  • PDA personal digital assistant
  • PMP portable multimedia player
  • the input/output module may include a display, keypad, joystick, remote control, keyboard, mouse, etc.
  • a display is a configuration for visually outputting various information.
  • Display Liquid Crystal Display
  • PDP Plasma Display Panel
  • OLED Organic Light Emitting Diodes
  • TOLED Transparent OLED
  • Micro LED etc., but are not limited to these and various other conventionally known devices. It may include a display in the form of a display.
  • the display may be implemented in the form of a touch screen capable of detecting a user's touch operation, or may be implemented as a flexible display that can be folded or bent.
  • FIG. 2 is a basic flowchart according to an embodiment of the present disclosure.
  • the electronic device 100 that controls a plurality of speakers obtains a user command from the tester's first terminal 200 (S210) , Based on the user command obtained from the first terminal 200, the audio output order for each of the plurality of speakers 10-1 to 10-8...10-n can be identified (S220).
  • At least one speaker among the plurality of speakers 10-1 to 10-8...10-n transmits audio at a certain period in one order.
  • the audio output for each of the plurality of speakers 10-1 to 10-8...10-n can be controlled (S230) to output according to a certain number of repetitions.
  • Audio may be a pre-registered sound source (audio data).
  • the audio output order may be any one of the following: an audio output order according to channel numbers, a random audio output order, an audio output order obtained from the first terminal 200, and an audio output order according to a user command.
  • the audio output order according to the channel number is as shown in Figure 3, the speaker (10-1) corresponding to channel 1, the speaker (10-2) corresponding to channel 2, and the speaker (10-2) corresponding to channel 3.
  • Speaker (10-3) corresponding to channel 4 speaker corresponding to channel 4 (10-4), speaker corresponding to channel 5 (10-5), speaker corresponding to channel 6 (10-6), speaker corresponding to channel 7 (10-7), the speaker (10-8) corresponding to channel 8 outputs audio sequentially in the order of channel numbers 1 to 8.
  • the random audio output order is to randomly select at least one speaker outputting audio according to their order.
  • the audio output order obtained from the first terminal 200 is the order of at least one speaker for each order obtained through the first terminal 200 and designated according to the examiner's intention.
  • the electronic device 100 outputs audio through the speaker 10-4 corresponding to channel 4 and the speaker 10-5 corresponding to channel 5 in the first order. Ensure that audio is output, and in the next turn, audio is output through the speaker (10-8) corresponding to channel 8, and in the next turn, the speaker (10-3) corresponding to channel 3 and the speaker (10-3) corresponding to channel 5. Audio can be controlled to be output through the speaker 10-5.
  • the audio output order according to the user command is for a manual mode in which the electronic device 100 acquires at least one speaker selected in real time through the first terminal 200 and outputs audio through the selected speaker.
  • the electronic device 100 when performing step S230, outputs audio to each of the plurality of speakers 10-1 to 10-8...10-n according to the audio output order according to the user command.
  • a group including at least one speaker that simultaneously outputs audio for at least one turn can be identified according to the audio output order.
  • a first group including at least one speaker that simultaneously outputs audio for the first turn and a second group including at least one speaker that simultaneously outputs audio for the second turn, which is a sequence after the first turn.
  • the electronic device 100 selects at least one of the speakers included in the second group, a plurality of speakers 10-1 to 10-8. .10-n), audio can be output by changing to at least one speaker not included in the second group.
  • the first group and the second group include a speaker 10-4 corresponding to channel 4 and a speaker 10-5 corresponding to channel 5, the electronic device 100 , the speaker (10-5) corresponding to channel 5 is changed to the speaker (10-3) corresponding to channel 3, and the speaker (10-8) corresponding to channel 8, so that the second group is the speaker corresponding to channel 4. (10-4), the speaker (10-3) corresponding to channel 3, and the speaker (10-8) corresponding to channel 8, so that for the configuration of the speakers included in the group according to each order, the audio
  • the output By controlling the output to be carried out in various directions without overlapping with groups according to different orders, the accuracy of the test results can be improved and the reaction speed for the overall direction can be obtained.
  • the electronic device 100 selects at least one of the speakers included in the second group. You can change the second group by excluding one from the second group.
  • the plurality of speakers 10-1 to 10-8...10-n are an even number (n is In the case of an even number), one speaker located in a direction of 180 degrees with respect to any one of the speakers remaining included in the second group is added to the second group to change the configuration of the speakers included in the second group to enable two-way An auditory directionality test can be performed.
  • the electronic device 100 may obtain reaction data from the subject's second terminal 300.
  • the reaction data may include the channel number of the speaker corresponding to the direction in which the subject recognized the audio as being heard, and the time when the reaction data was generated.
  • the electronic device 100 outputs the audio to the plurality of speakers (10-1 to 10-n).
  • Auditory directional reaction speed data for the subject is generated based on the location information and audio output order for each, and the generated auditory directional reaction speed data is sent to the examiner through the first terminal 200. can be provided to.
  • the auditory directionality reaction speed data may include the time when audio is output and the time when a user input corresponding to the direction in which the audio is heard is performed through the second terminal 300.
  • the output time is obtained as the time when the audio was output, and at least one channel number included in the one response data is used to determine the audio. It can be obtained in an audible direction, and the point in time when one response data is generated can be obtained as the point in time when the user input is performed through the second terminal 300.
  • the electronic device 100 obtains the first response data to the first audio from the second terminal 300 beyond the threshold time from when the first audio is output, the electronic device 100 Through one speaker, the first audio can be re-outputted within a certain sequence from the turn in which the first audio was output, and second response data for the re-outputted first audio can be obtained from the second terminal 300.
  • the electronic device 100 calculates a first reaction rate for the first reaction data and a second reaction rate for the second reaction data, and the difference between the first reaction rate and the second reaction rate exceeds the threshold. , if the second reaction speed is faster than the first reaction speed, the first reaction data is changed to the second reaction data and stored.
  • the electronic device 100 operates at an average rate of the first reaction rate and the second reaction rate. is calculated, the first reaction rate is changed to the average rate and stored.
  • the reaction speed may be the time taken from the time when the last audio output was output to the time when the single reaction data was acquired, before the time when the single reaction data was acquired.
  • the electronic device 100 adds a turn number to the audio output sequence, and immediately after the second response speed is acquired, the first speaker is switched to the turn number.
  • the second terminal 300 is controlled to output a second audio that has a shorter output time than the first audio or has a lower volume than the first audio at the same time through the second speaker and the third speaker disposed between them.
  • Third reaction data can be obtained through.
  • the electronic device 100 determines that the subject's hearing directionality with respect to the first speaker has improved, and generates a plurality of audio signals according to the audio output order.
  • audio may be output except for the first speaker.
  • the electronic device 100 uses a plurality of speakers 10-1 to 10-8...10-n to output audio for the next turn according to the audio output order. can be controlled.
  • the response data may include at least one of the time point at which the response data was generated, a user input for selecting a channel number for at least one direction in which the subject heard audio, and a user input in response to the absence of an audible direction. .
  • FIG. 3 is a layout diagram of a plurality of speakers according to an embodiment of the present disclosure
  • FIG. 4 is a system configuration diagram including a controller according to an embodiment of the present disclosure.
  • a system for controlling a plurality of speakers (10-1 to 10-8...10-n) to test auditory response speed and directionality Based on the audio output order, among the plurality of speakers (10-1 to 10-8...10-n), at least one speaker outputs audio according to a certain period and a certain number of repetitions for one sequence.
  • An electronic device 100 that controls audio output for each of the speakers 10-1 to 10-8...10-n, and a plurality of speakers 10-1 to 10-8...10-n. Each is connected, and a control command for controlling the audio output for each of the plurality of speakers (10-1 to 10-8...10-n) is obtained from the electronic device 100, and a plurality of speakers are connected based on the control command.
  • the controller 400 includes a speaker connection terminal where a plurality of speakers are connected one to one, a main terminal connected by wire through the electronic device 100 and the communication unit 120, and the electronic device 100 and the communication unit 120. It includes a communicator that communicates wirelessly, and can control audio output for each of the plurality of speakers based on control commands obtained through the electronic device 100.
  • the plurality of speakers (10-1 to 10-8...10-n) are arranged at a uniform angle around the subject's position, but are arranged at a certain distance from the center. And the angle may be 45 degrees or less.
  • the plurality of speakers is composed of 8 speakers, so that auditory directionality according to 8 directions can be obtained for the subject.
  • the steps of the method or algorithm described in connection with embodiments of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or a combination thereof.
  • the software module may be RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, hard disk, removable disk, CD-ROM, or It may reside on any type of computer-readable recording medium well known in the art to which the present invention pertains.
  • the components of the present invention may be implemented as a program (or application) and stored in a medium in order to be executed in conjunction with a hardware computer.
  • Components of the invention may be implemented as software programming or software elements, and similarly, embodiments may include various algorithms implemented as combinations of data structures, processes, routines or other programming constructs, such as C, C++, , it can be implemented in a programming or scripting language such as Java, assembler, Python, etc.
  • Functional aspects may be implemented as algorithms running on one or more processors.

Abstract

The present invention relates to an electronic device and a system for controlling a plurality of speakers in order to test auditory response speed and directionality, the device and the system acquiring a user command from a first terminal of a tester, identifying an audio output order for each of a plurality of speakers on the basis of the user command acquired from the first terminal; and controlling the audio output for each of the plurality of speakers such that at least one from among the plurality of speakers outputs, on the basis of the audio output order, audio in one order according to a certain period of time and a certain number of repetitions.

Description

청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커를 제어하는 전자 장치, 및 시스템Electronic device and system for controlling a plurality of speakers to test auditory response speed and directionality
본 발명은 청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커를 제어하는 전자 장치, 및 시스템에 관한 것으로, 상세하게는, 최소 4개 방향 최대 무한대 방향으로부터 오디오를 출력하여 피검자를 대상으로 다양한 방향에 대한 청각 반응 속도 및 방향성을 검사하여, 소리의 방향인지 능력을 향상시킬 수 있는 기술이다.The present invention relates to an electronic device and system that controls a plurality of speakers to test auditory response speed and directionality. Specifically, the present invention relates to an electronic device and system that output audio from at least four directions and up to infinite directions to target the subject in various directions. This is a technology that can improve the ability to recognize the direction of sound by testing the auditory response speed and directionality.
청력검사에서 청각 능력이 정상 범위보다 낮은 사람들의 경우, 일상생활을 위해 청력보조기구를 착용하디만, 초기 착용자의 경우, 다양한 방향에서 발생하는 소리에 대하여 방향인지 능력이 떨어지며, 여러 소음 속에서 상대방과 대화가 어려운 문제가 존재한다.In the case of people whose hearing ability is lower than the normal range in a hearing test, hearing aids are worn for daily life, but in the case of early wearers, the ability to recognize the direction of sounds coming from various directions is poor, and the ability to perceive the direction of sounds coming from various directions is poor. There are issues that are difficult to talk about.
이러한 청력보조기구 사용자가 착용 초기에 방향성을 익히기 위해 공간청취능력향상 훈련 장비가 고안되어 사용되어지고 있으며, 이에 따른 여러 연구장비가 고안되고 있다.Spatial listening ability improvement training equipment has been designed and used to help users of hearing aids learn direction in the early stages of wearing them, and various research equipment is being designed accordingly.
하지만, 다양한 방향에서 소리가 나오는 제품들은 수동으로 소리를 조절하거나 단순하게 소리를 검사자가 ON/OFF를 반복하는 과정을 통한 동작법만이 존재할 뿐이다.However, for products that emit sounds from various directions, the only way to operate them is to manually control the sound or simply have the sound inspector turn the sound on and off repeatedly.
한편, 상기의 배경기술로서 설명된 사항들은 본 발명의 배경에 대한 이해 증진을 위한 것일 뿐, 이 기술분야에서 통상의 지식을 가진 자에게 이미 알려진 종래기술에 해당함을 인정하는 것으로 받아들여져서는 안 될 것이다.Meanwhile, the matters described as background technology above are only for the purpose of improving understanding of the background of the present invention, and should not be taken as recognition that they correspond to prior art already known to those skilled in the art. will be.
본 발명이 해결하고자 하는 과제는 다양한 오디오 출력 순서를 적용하여 예측 불가한 오디오 출력 순서에 따른 청각 반응 속도 및 방향성 검사를 수행하여 피검자에 대해 정확한 청각 반응 속도 및 방향성에 대한 검사 결과를 획득하여 검사자에게 제공하는 것이 가능한 청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커를 제어하는 전자 장치, 및 시스템을 제공하는 것이다.The problem to be solved by the present invention is to obtain accurate auditory reaction speed and directionality test results for the subject by applying various audio output orders to perform auditory reaction speed and directionality tests according to unpredictable audio output orders, and to provide test results to the examiner. An electronic device and system for controlling a plurality of speakers are provided to test possible auditory response speed and directionality.
본 발명이 해결하고자 하는 과제들은 이상에서 언급된 과제로 제한되지 않으며, 언급되지 않은 또 다른 과제들은 아래의 기재로부터 통상의 기술자에게 명확하게 이해될 수 있을 것이다.The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below.
상술한 과제를 해결하기 위한 본 발명의 일 면에 따른 청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커를 제어하는 전자 장치에 있어서, 전자 장치는, 복수의 스피커 각각에 대한 위치 정보, 및 피검자에 대한 위치 정보를 포함하는 메모리, 복수의 스피커와 통신하는 통신부, 및 메모리 및 통신부와 연결된 프로세서를 포함하고, 이때, 프로세서는, 통신부를 통해, 검사자의 제1 단말로부터 사용자 명령을 획득하고, 제1 단말로부터 획득된 사용자 명령을 바탕으로, 복수의 스피커 각각에 대한 오디오 출력 순서를 식별하고, 통신부를 통해, 오디오 출력 순서를 바탕으로, 복수의 스피커 중, 적어도 하나 이상의 스피커가 일 순서에 대해 오디오를 일정 주기 및 일정 반복 횟수에 따라 출력하도록, 복수의 스피커 각각에 대한 오디오 출력을 제어할 수 있다.In an electronic device that controls a plurality of speakers to test auditory reaction speed and directionality according to an aspect of the present invention for solving the above-described problem, the electronic device includes location information for each of the plurality of speakers, and the subject It includes a memory containing location information, a communication unit that communicates with a plurality of speakers, and a processor connected to the memory and the communication unit, where the processor obtains a user command from the first terminal of the examiner through the communication unit, and 1 Based on the user command obtained from the terminal, the audio output order for each of the plurality of speakers is identified, and through the communication unit, based on the audio output order, at least one speaker among the plurality of speakers outputs audio in one order. The audio output for each of the plurality of speakers can be controlled so that the audio is output according to a certain period and a certain number of repetitions.
추가로, 메모리는, 피검자의 정면에 위치하는 스피커, 오디오 데이터 및 오디오 출력 순서를 포함할 수 있다.Additionally, the memory may include a speaker located in front of the subject, audio data, and audio output order.
추가로, 메모리는, 복수의 스피커 각각에 대한 채널 번호를 포함하고, 오디오 출력 순서는, 채널 번호에 대한 순번에 따른 오디오 출력 순서, 무작위 오디오 출력 순서, 제1 단말로부터 획득된 오디오 출력 순서, 및 사용자 명령에 따른 오디오 출력 순서 중 어느 하나일 수 있다.Additionally, the memory includes channel numbers for each of the plurality of speakers, and the audio output order includes an audio output order according to the order of the channel numbers, a random audio output order, an audio output order obtained from the first terminal, and It may be any one of the audio output orders according to user commands.
추가로, 프로세서는, 통신부를 통해, 피검자의 제2 단말로부터 반응 데이터를 획득하고, 오디오 출력 순서에 따른 복수의 스피커에 대한 오디오 출력이 종료되면, 복수의 스피커 각각에 대한 위치 정보, 및 오디오 출력 순서를 바탕으로 피검자에 대한 청각 방향성 반응속도 데이터를 생성하고, 청각 방향성 반응속도 데이터는, 일 오디오가 출력된 시점, 및 일 오디오를 가청한 방향에 해당하는 사용자 입력이 제2 단말을 통해 수행된 시점을 포함할 수 있다.Additionally, the processor obtains response data from the subject's second terminal through the communication unit, and when audio output to the plurality of speakers according to the audio output order is terminated, location information for each of the plurality of speakers, and audio output Auditory directional reaction speed data for the subject is generated based on the order, and the auditory directional reaction speed data is determined by the time when the audio is output and when the user input corresponding to the direction in which the audio is heard is performed through the second terminal. Can include point of view.
추가로, 프로세서는, 제1 오디오에 대한 제1 반응 데이터를, 제1 오디오가 출력된 시점으로부터 임계 시간을 초과하여 제2 단말로부터 획득하면, 제1 오디오를 출력한 제1 스피커를 통해, 제1 오디오가 출력된 순번으로부터 일정 순서 내에 제1 오디오를 재출력하여, 재출력된 제1 오디오에 대한 제2 반응 데이터를 제2 단말로부터 획득하고, 제1 반응 데이터에 대한 제1 반응 속도 및 제2 반응 데이터에 대한 제2 반응 속도를 산출하고, 제1 반응 속도 및 제2 반응 속도의 차값이 임계값을 초과하되, 제2 반응 속도가 제1 반응 속도보다 빠른 경우, 제1 반응 데이터를 제2 반응 데이터로 변경하여 저장하고, 제1 반응 속도 및 제2 반응 속도의 차값이 임계값 이하이거나, 제2 반응 속도가 제1 반응 속도보다 느린 경우, 제1 반응 속도 및 제2 반응 속도의 평균 속도를 산출하여, 제1 반응 속도를 평균 속도로 변경하여 저장하고, 반응 속도는, 일 반응 데이터가 획득된 시점 이전에, 가장 마지막으로 출력된 오디오가 출력된 시점으로부터 일 반응 데이터가 획득된 시점까지 소요된 시간일 수 있다.Additionally, when the processor obtains the first response data for the first audio from the second terminal exceeding the threshold time from when the first audio is output, the processor transmits the first response data to the first audio through the first speaker that output the first audio. 1 Re-output the first audio within a certain sequence from the turn in which the audio was output, obtain second reaction data for the re-output first audio from the second terminal, and obtain a first reaction speed and first response to the first reaction data. 2 A second reaction rate is calculated for the reaction data, and if the difference between the first reaction rate and the second reaction rate exceeds the threshold, but the second reaction rate is faster than the first reaction rate, the first reaction data is calculated as a second reaction rate. 2 Change to reaction data and save, and if the difference between the first reaction rate and the second reaction rate is less than or equal to the threshold or the second reaction rate is slower than the first reaction rate, the average of the first reaction rate and the second reaction rate The speed is calculated, the first reaction speed is changed to an average speed and stored, and the reaction speed is from the time when the last output audio is output to the time when the reaction data is acquired, before the time when the reaction data is acquired. It may be the time taken to
추가로, 프로세서는, 일 순번에 대해 반응 데이터가 획득되면, 오디오 출력 순서에 따른 다음 순번에 대한 오디오가 출력되도록 복수의 스피커를 제어하고, 반응 데이터는, 반응 데이터가 생성된 시점, 피검자가 오디오를 가청한 적어도 하나의 방향에 대한 채널 번호를 선택하는 사용자 입력, 및 가청한 방향이 미존재함에 따른 사용자 입력 중 적어도 하나를 포함할 수 있다.Additionally, when response data for one turn is obtained, the processor controls a plurality of speakers to output audio for the next turn according to the audio output order, and the response data is determined at the time when the response data is generated and when the subject hears the audio. It may include at least one of a user input for selecting a channel number for at least one audible direction, and a user input for the absence of an audible direction.
본 발명의 일 면에 따른 청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커를 제어하는 시스템에 있어서, 오디오 출력 순서를 바탕으로, 복수의 스피커 중, 적어도 하나 이상의 스피커가 일 순서에 대해 오디오를 일정 주기 및 일정 반복 횟수에 따라 출력하도록, 복수의 스피커 각각에 대한 오디오 출력을 제어하는 전자 장치, 및 복수의 스피커 각각이 연결되며, 전자 장치로부터 복수의 스피커 각각에 대한 오디오 출력을 제어하는 컨트롤 명령을 획득하고, 컨트롤 명령을 바탕으로 복수의 스피커 각각에 대한 오디오 출력을 제어하는 컨트롤러를 포함한다.In a system for controlling a plurality of speakers to test auditory response speed and directionality according to one aspect of the present invention, based on the audio output order, at least one speaker among the plurality of speakers outputs audio in one order. An electronic device that controls audio output from each of a plurality of speakers to output according to a certain period and a certain number of repetitions, and each of the plurality of speakers is connected, and a control command to control the audio output from the electronic device to each of the plurality of speakers. It includes a controller that acquires and controls audio output for each of the plurality of speakers based on control commands.
추가로, 복수의 스피커는, 피검자의 위치를 중심으로 균일한 각도로 배치되되, 중심으로부터 일정 거리를 갖도록 배치되고, 각도는, 45도 이하일 수 있다.Additionally, the plurality of speakers are arranged at a uniform angle around the subject's position and at a certain distance from the center, and the angle may be 45 degrees or less.
본 발명의 기타 구체적인 사항들은 상세한 설명 및 도면들에 포함되어 있다.Other specific details of the invention are included in the detailed description and drawings.
본 발명의 청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커를 제어하는 전자 장치, 및 시스템에 의하면, 종래의 단순한 수동에 의한 스피커 컨트롤 방식에서 벗어나며 검사 결과를 별도의 단말을 통해 획득함으로써 정확한 수치 확인이 가능하고, 복수의 스피커를 피검자를 중심으로 하는 원호를 형성하도록 배치함으로써 다양한 방향에서의 반응속도 및 방향성 개선에 도움을 줄 수 있다.According to the electronic device and system for controlling a plurality of speakers in order to test the auditory reaction speed and direction of the present invention, it deviates from the conventional simple manual speaker control method and obtains the test results through a separate terminal, thereby providing accurate numerical values. Confirmation is possible, and by arranging multiple speakers to form an arc centered on the subject, it can help improve reaction speed and directionality in various directions.
본 발명의 효과들은 이상에서 언급된 효과로 제한되지 않으며, 언급되지 않은 또 다른 효과들은 아래의 기재로부터 통상의 기술자에게 명확하게 이해될 수 있을 것이다.The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.
도 1은 본 개시의 일 실시예에 따른 시스템 구성도이다.1 is a system configuration diagram according to an embodiment of the present disclosure.
도 2는 본 개시의 일 실시예에 따른 기본 흐름도이다.Figure 2 is a basic flowchart according to an embodiment of the present disclosure.
도 3은 본 개시의 일 실시예에 따른 복수의 스피커 배치도이다.Figure 3 is a layout diagram of a plurality of speakers according to an embodiment of the present disclosure.
도 4는 본 개시의 일 실시예에 따른 컨트롤러를 포함하는 시스템 구성도이다.Figure 4 is a system configuration diagram including a controller according to an embodiment of the present disclosure.
본 발명의 이점 및 특징, 그리고 그것들을 달성하는 방법은 첨부되는 도면과 함께 상세하게 후술되어 있는 실시예들을 참조하면 명확해질 것이다. 그러나, 본 발명은 이하에서 개시되는 실시예들에 제한되는 것이 아니라 서로 다른 다양한 형태로 구현될 수 있으며, 단지 본 실시예들은 본 발명의 개시가 완전하도록 하고, 본 발명이 속하는 기술 분야의 통상의 기술자에게 본 발명의 범주를 완전하게 알려주기 위해 제공되는 것이며, 본 발명은 청구항의 범주에 의해 정의될 뿐이다.The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the disclosure of the present invention is complete and to provide a general understanding of the technical field to which the present invention pertains. It is provided to fully inform the skilled person of the scope of the present invention, and the present invention is only defined by the scope of the claims.
본 명세서에서 사용된 용어는 실시예들을 설명하기 위한 것이며 본 발명을 제한하고자 하는 것은 아니다. 본 명세서에서, 단수형은 문구에서 특별히 언급하지 않는 한 복수형도 포함한다. 명세서에서 사용되는 "포함한다(comprises)" 및/또는 "포함하는(comprising)"은 언급된 구성요소 외에 하나 이상의 다른 구성요소의 존재 또는 추가를 배제하지 않는다. 명세서 전체에 걸쳐 동일한 도면 부호는 동일한 구성 요소를 지칭하며, "및/또는"은 언급된 구성요소들의 각각 및 하나 이상의 모든 조합을 포함한다. 비록 "제1", "제2" 등이 다양한 구성요소들을 서술하기 위해서 사용되나, 이들 구성요소들은 이들 용어에 의해 제한되지 않음은 물론이다. 이들 용어들은 단지 하나의 구성요소를 다른 구성요소와 구별하기 위하여 사용하는 것이다. 따라서, 이하에서 언급되는 제1 구성요소는 본 발명의 기술적 사상 내에서 제2 구성요소일 수도 있음은 물론이다.The terminology used herein is for describing embodiments and is not intended to limit the invention. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used in the specification, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other elements in addition to the mentioned elements. Like reference numerals refer to like elements throughout the specification, and “and/or” includes each and every combination of one or more of the referenced elements. Although “first”, “second”, etc. are used to describe various components, these components are of course not limited by these terms. These terms are merely used to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may also be a second component within the technical spirit of the present invention.
다른 정의가 없다면, 본 명세서에서 사용되는 모든 용어(기술 및 과학적 용어를 포함)는 본 발명이 속하는 기술분야의 통상의 기술자에게 공통적으로 이해될 수 있는 의미로 사용될 수 있을 것이다. 또한, 일반적으로 사용되는 사전에 정의되어 있는 용어들은 명백하게 특별히 정의되어 있지 않는 한 이상적으로 또는 과도하게 해석되지 않는다.Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.
명세서에서 사용되는 "부" 또는 “모듈”이라는 용어는 소프트웨어, FPGA 또는 ASIC과 같은 하드웨어 구성요소를 의미하며, "부" 또는 “모듈”은 어떤 역할들을 수행한다. 그렇지만 "부" 또는 “모듈”은 소프트웨어 또는 하드웨어에 한정되는 의미는 아니다. "부" 또는 “모듈”은 어드레싱할 수 있는 저장 매체에 있도록 구성될 수도 있고 하나 또는 그 이상의 프로세서들을 재생시키도록 구성될 수도 있다. 따라서, 일 예로서 "부" 또는 “모듈”은 소프트웨어 구성요소들, 객체지향 소프트웨어 구성요소들, 클래스 구성요소들 및 태스크 구성요소들과 같은 구성요소들과, 프로세스들, 함수들, 속성들, 프로시저들, 서브루틴들, 프로그램 코드의 세그먼트들, 드라이버들, 펌웨어, 마이크로 코드, 회로, 데이터, 데이터베이스, 데이터 구조들, 테이블들, 어레이들 및 변수들을 포함한다. 구성요소들과 "부" 또는 “모듈”들 안에서 제공되는 기능은 더 작은 수의 구성요소들 및 "부" 또는 “모듈”들로 결합되거나 추가적인 구성요소들과 "부" 또는 “모듈”들로 더 분리될 수 있다.As used in the specification, the term “unit” or “module” refers to a hardware component such as software, FPGA, or ASIC, and the “unit” or “module” performs certain roles. However, “part” or “module” is not limited to software or hardware. A “unit” or “module” may be configured to reside on an addressable storage medium and may be configured to run on one or more processors. Thus, as an example, a “part” or “module” refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, Includes procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within components and “parts” or “modules” can be combined into smaller components and “parts” or “modules” or into additional components and “parts” or “modules”. Could be further separated.
공간적으로 상대적인 용어인 "아래(below)", "아래(beneath)", "하부(lower)", "위(above)", "상부(upper)" 등은 도면에 도시되어 있는 바와 같이 하나의 구성요소와 다른 구성요소들과의 상관관계를 용이하게 기술하기 위해 사용될 수 있다. 공간적으로 상대적인 용어는 도면에 도시되어 있는 방향에 더하여 사용시 또는 동작시 구성요소들의 서로 다른 방향을 포함하는 용어로 이해되어야 한다. 예를 들어, 도면에 도시되어 있는 구성요소를 뒤집을 경우, 다른 구성요소의 "아래(below)"또는 "아래(beneath)"로 기술된 구성요소는 다른 구성요소의 "위(above)"에 놓일 수 있다. 따라서, 예시적인 용어인 "아래"는 아래와 위의 방향을 모두 포함할 수 있다. 구성요소는 다른 방향으로도 배향될 수 있으며, 이에 따라 공간적으로 상대적인 용어들은 배향에 따라 해석될 수 있다.Spatially relative terms such as “below”, “beneath”, “lower”, “above”, “upper”, etc. are used as a single term as shown in the drawing. It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms that include different directions of components during use or operation in addition to the directions shown in the drawings. For example, if you flip a component shown in a drawing, a component described as "below" or "beneath" another component will be placed "above" the other component. You can. Accordingly, the illustrative term “down” may include both downward and upward directions. Components can also be oriented in other directions, so spatially relative terms can be interpreted according to orientation.
본 명세서에서, 컴퓨터는 적어도 하나의 프로세서를 포함하는 모든 종류의 하드웨어 장치를 의미하는 것이고, 실시 예에 따라 해당 하드웨어 장치에서 동작하는 소프트웨어적 구성도 포괄하는 의미로서 이해될 수 있다. 예를 들어, 컴퓨터는 스마트폰, 태블릿 PC, 데스크톱, 노트북 및 각 장치에서 구동되는 사용자 클라이언트 및 애플리케이션을 모두 포함하는 의미로서 이해될 수 있으며, 또한 이에 제한되는 것은 아니다.In this specification, a computer refers to all types of hardware devices including at least one processor, and depending on the embodiment, it may be understood as encompassing software configurations that operate on the hardware device. For example, a computer can be understood to include, but is not limited to, a smartphone, tablet PC, desktop, laptop, and user clients and applications running on each device.
이하, 첨부된 도면을 참조하여 본 발명의 실시예를 상세하게 설명한다.Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.
도 1은 본 개시의 일 실시예에 따른 시스템 구성도이다.1 is a system configuration diagram according to an embodiment of the present disclosure.
도 1에 도시된 바와 같이, 본 발명의 청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커(10-1 내지 10-8…10-n, n은 정수)를 제어하는 전자 장치(100), 및 시스템에 있어서, 전자 장치(100)는 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 위치 정보, 피검자에 대한 위치 정보, 피검자의 정면에 위치하는 스피커, 오디오 데이터, 오디오 출력 순서, 및 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 채널 번호를 포함하는 메모리(110), 복수의 스피커(10-1 내지 10-8...10-n)와 통신하는 통신부(120), 및 메모리(110) 및 통신부(120)와 연결된 프로세서(130)를 포함한다.As shown in Figure 1, in order to test the auditory response speed and directionality of the present invention, an electronic device 100 that controls a plurality of speakers (10-1 to 10-8...10-n, n is an integer), And in the system, the electronic device 100 includes location information for each of the plurality of speakers (10-1 to 10-8...10-n), location information for the subject, a speaker located in front of the subject, and audio. A memory 110 containing data, audio output order, and channel numbers for each of the plurality of speakers 10-1 to 10-8...10-n, a plurality of speakers 10-1 to 10-8. It includes a communication unit 120 that communicates with ..10-n), and a processor 130 connected to the memory 110 and the communication unit 120.
일 실시예로, 전자 장치(100)는, 서버, 스마트폰(smartphone), 태블릿 PC(tablet personal computer), 이동 전화기(mobile phone), 영상 전화기, 랩탑 PC(laptop PC), 넷북 컴퓨터(netbook computer), 노트북 컴퓨터(notebook computer), PDA(personal digital assistant), PMP(portable multimedia player), 웨어러블 장치(wearable device), 청력검사기(audiometer) 중 적어도 하나를 포함할 수 있다.In one embodiment, the electronic device 100 includes a server, a smartphone, a tablet personal computer, a mobile phone, a video phone, a laptop PC, and a netbook computer. ), a laptop computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a wearable device, or an audiometer.
한편, 메모리(110)는 서버(100)의 동작에 필요한 각종 프로그램 및 데이터를 저장할 수 있다. 메모리(110)는 비휘발성 메모리(110), 휘발성 메모리(110), 플래시메모리(110)(flash-memory), 하드디스크 드라이브(HDD) 또는 솔리드 스테이트 드라이브(SSD) 등으로 구현될 수 있다.Meanwhile, the memory 110 can store various programs and data necessary for the operation of the server 100. The memory 110 may be implemented as a non-volatile memory 110, a volatile memory 110, a flash-memory 110, a hard disk drive (HDD), or a solid state drive (SSD).
통신부(120)는 외부 장치와 통신을 수행할 수 있다. 특히, 통신부(120)는 USB, 와이파이 칩, 블루투스 칩, 무선 통신 칩, NFC칩, 저전력 블루투스 칩(BLE 칩) 등과 같은 다양한 통신 칩을 포함할 수 있다. 이때, USB, 와이파이 칩, 블루투스 칩, NFC 칩은 각각 LAN 방식, WiFi 방식, 블루투스 방식, NFC 방식으로 통신을 수행한다. 와이파이 칩이나 블루투스칩을 이용하는 경우에는 SSID 및 세션 키 등과 같은 각종 연결 정보를 먼저 송수신 하여, 이를 이용하여 통신 연결한 후 각종 정보들을 송수신할 수 있다. 무선 통신칩은 IEEE, 지그비, 3G(3rd Generation), 3GPP(3rd Generation Partnership Project), LTE(Long Term Evolution), 5G(5th Generation) 등과 같은 다양한 통신 규격에 따라 통신을 수행하는 칩을 의미한다.The communication unit 120 can communicate with an external device. In particular, the communication unit 120 may include various communication chips such as USB, Wi-Fi chip, Bluetooth chip, wireless communication chip, NFC chip, and low-energy Bluetooth chip (BLE chip). At this time, USB, WiFi chip, Bluetooth chip, and NFC chip communicate in LAN method, WiFi method, Bluetooth method, and NFC method, respectively. When using a Wi-Fi chip or Bluetooth chip, various connection information such as SSID and session key are first transmitted and received, and various information can be transmitted and received after establishing a communication connection using this. A wireless communication chip refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), and 5G (5th Generation).
프로세서(130)는 메모리(110)에 저장된 각종 프로그램을 이용하여 서버(100)의 전반적인 동작을 제어할 수 있다. 프로세서(130)는 RAM, ROM, 그래픽 처리부, 메인 CPU, 제1 내지 n 인터페이스 및 버스로 구성될 수 있다. 이때, RAM, ROM, 그래픽 처리부, 메인 CPU, 제1 내지 n 인터페이스 등은 버스를 통해 서로 연결될 수 있다.The processor 130 can control the overall operation of the server 100 using various programs stored in the memory 110. The processor 130 may be comprised of RAM, ROM, a graphics processing unit, a main CPU, first to n interfaces, and a bus. At this time, RAM, ROM, graphics processing unit, main CPU, first to n interfaces, etc. may be connected to each other through a bus.
RAM은 O/S 및 어플리케이션 프로그램을 저장한다. 구체적으로, 서버(100)가 부팅되면 O/S가 RAM에 저장되고, 사용자가 선택한 각종 어플리케이션 데이터가 RAM에 저장될 수 있다.RAM stores O/S and application programs. Specifically, when the server 100 is booted, the O/S is stored in RAM, and various application data selected by the user may be stored in RAM.
ROM에는 시스템 부팅을 위한 명령어 세트 등이 저장된다. 턴 온 명령이 입력되어 전원이 공급되면, 메인 CPU는 ROM에 저장된 명령어에 따라 메모리(110)에 저장된 O/S를 RAM에 복사하고, O/S를 실행시켜 시스템을 부팅시킨다. 부팅이 완료되면, 메인 CPU는 메모리(110)에 저장된 각종 어플리케이션 프로그램을 RAM에 복사하고, RAM에 복사된 어플리케이션 프로그램을 실행시켜 각종 동작을 수행한다.ROM stores a set of instructions for booting the system. When a turn-on command is input and power is supplied, the main CPU copies the O/S stored in the memory 110 to RAM according to the command stored in the ROM, executes the O/S, and boots the system. When booting is complete, the main CPU copies various application programs stored in the memory 110 to RAM and executes the application programs copied to RAM to perform various operations.
그래픽 처리부는 연산부(미도시) 및 렌더링부(미도시)를 이용하여 아이템, 이미지, 텍스트 등과 같은 다양한 객체를 포함하는 화면을 생성한다. 여기서, 연산부는 입력부로부터 수신된 제어 명령을 이용하여 화면의 레이아웃에 따라 각 객체들이 표시될 좌표값, 형태, 크기, 컬러 등과 같은 속성값을 연산하는 구성일 수 있다. 그리고, 렌더링부는 연산부에서 연산한 속성값에 기초하여 객체를 포함하는 다양한 레이아웃의 화면을 생성하는 구성이 일 수 있다. 이러한 렌더링부에서 생성된 화면은 디스플레이의 디스플레이 영역 내에 표시될 수 있다.The graphics processing unit uses a calculation unit (not shown) and a rendering unit (not shown) to create a screen containing various objects such as items, images, and text. Here, the calculation unit may be configured to calculate attribute values such as coordinate values, shape, size, color, etc. for each object to be displayed according to the layout of the screen using a control command received from the input unit. Additionally, the rendering unit may be configured to generate screens of various layouts including objects based on attribute values calculated by the calculation unit. The screen generated by this rendering unit may be displayed within the display area of the display.
메인 CPU는 메모리(110)에 액세스하여, 메모리(110)에 저장된 OS를 이용하여 부팅을 수행한다. 그리고, 메인 CPU는 메모리(110)에 저장된 각종 프로그램, 컨텐츠, 데이터 등을 이용하여 다양한 동작을 수행한다.The main CPU accesses the memory 110 and performs booting using the OS stored in the memory 110. And, the main CPU performs various operations using various programs, contents, data, etc. stored in the memory 110.
제1 내지 n 인터페이스는 상술한 각종 구성요소들과 연결된다. 제1 내지 n 인터페이스 중 하나는 네트워크를 통해 외부 장치와 연결되는 네트워크 인터페이스가 될 수도 있다.The first to n interfaces are connected to the various components described above. One of the first to n interfaces may be a network interface connected to an external device through a network.
한편, 프로세서(130)는 하나 이상의 코어(core, 미도시) 및 그래픽 처리부(미도시) 및/또는 다른 구성 요소와 신호를 송수신하는 연결 통로(예를 들어, 버스(bus) 등)를 포함할 수 있다.Meanwhile, the processor 130 may include one or more cores (not shown) and a graphics processing unit (not shown) and/or a connection path (e.g., bus, etc.) for transmitting and receiving signals with other components. You can.
일 실시예에 따른 프로세서(130)는 메모리(110)에 저장된 하나 이상의 인스트럭션을 실행함으로써, 본 발명과 관련하여 설명된 방법을 수행한다. Processor 130 according to one embodiment performs the method described in connection with the present invention by executing one or more instructions stored in memory 110.
예를 들어, 프로세서(130)는 메모리(110)에 저장된 하나 이상의 인스트럭션을 실행함으로써 신규 학습용 데이터를 획득하고, 학습된 모델을 이용하여, 상기 획득된 신규 학습용 데이터에 대한 테스트를 수행하고, 상기 테스트 결과, 라벨링된 정보가 소정의 제1 기준값 이상의 정확도로 획득되는 제1 학습용 데이터를 추출하고, 상기 추출된 제1 학습용 데이터를 상기 신규 학습용 데이터로부터 삭제하고, 상기 추출된 학습용 데이터가 삭제된 상기 신규 학습용 데이터를 이용하여 상기 학습된 모델을 다시 학습시킬 수 있다.For example, the processor 130 acquires new training data by executing one or more instructions stored in the memory 110, performs a test on the acquired new training data using a learned model, and performs the test. As a result, first learning data in which labeled information is obtained with an accuracy greater than a predetermined first reference value is extracted, the extracted first learning data is deleted from the new learning data, and the new learning data from which the extracted learning data is deleted is extracted. The learned model can be retrained using training data.
한편, 프로세서(130)는 프로세서(130) 내부에서 처리되는 신호(또는, 데이터)를 일시적 및/또는 영구적으로 저장하는 램(RAM: Random Access Memory, 미도시) 및 롬(ROM: Read-Only Memory, 미도시)을 더 포함할 수 있다. 또한, 프로세서(130)는 그래픽 처리부, 램 및 롬 중 적어도 하나를 포함하는 시스템온칩(SoC: system on chip) 형태로 구현될 수 있다.Meanwhile, the processor 130 includes random access memory (RAM) (not shown) and read-only memory (ROM) that temporarily and/or permanently store signals (or data) processed within the processor 130. , not shown) may be further included. Additionally, the processor 130 may be implemented in the form of a system on chip (SoC) that includes at least one of a graphics processing unit, RAM, and ROM.
메모리(110)에는 프로세서(130)의 처리 및 제어를 위한 프로그램들(하나 이상의 인스트럭션들)을 저장할 수 있다. 메모리(110)에 저장된 프로그램들은 기능에 따라 복수 개의 모듈들로 구분될 수 있다.The memory 110 may store programs (one or more instructions) for processing and control of the processor 130. Programs stored in the memory 110 may be divided into a plurality of modules according to their functions.
한편, 본 발명의 청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커를 제어하는 전자 장치, 및 시스템에 있어서, 검사자의 전자 장치인 제1 단말(200), 및 피검자의 전자 장치인 제2 단말(300)은 각각 전자 장치(100)와 통신하기 위한 통신 모듈, 사용자 명령의 획득 및 스피커에 대한 채널 등을 포함하는 이미지의 출력 중 적어도 하나를 수행하는 입출력 모듈, 및 통신 모듈 및 입출력 모듈 각각에 연결되며, 단말(200, 300)의 전반적인 동작을 제어하는 제어 모듈을 포함한다.Meanwhile, in the electronic device and system for controlling a plurality of speakers to test auditory reaction speed and directionality of the present invention, a first terminal 200 is an electronic device of the examinee, and a second terminal is the electronic device of the subject. (300) includes a communication module for communicating with the electronic device 100, an input/output module that performs at least one of obtaining a user command and outputting an image including a channel to a speaker, and each of the communication module and the input/output module. It is connected and includes a control module that controls the overall operation of the terminals 200 and 300.
일 실시예로, 단말(200, 300)은, 조이스틱, 리모컨, 스마트폰(smartphone), 태블릿 PC(tablet personal computer), 이동 전화기(mobile phone), 영상 전화기, 랩탑 PC(laptop PC), 넷북 컴퓨터(netbook computer), 노트북 컴퓨터(notebook computer), PDA(personal digital assistant), PMP(portable multimedia player), 웨어러블 장치(wearable device) 중 적어도 하나를 포함할 수 있다.In one embodiment, the terminals 200 and 300 include a joystick, a remote control, a smartphone, a tablet personal computer, a mobile phone, a video phone, a laptop PC, and a netbook computer. It may include at least one of a netbook computer, a laptop computer, a personal digital assistant (PDA), a portable multimedia player (PMP), and a wearable device.
한편, 입출력 모듈을 디스플레이, 키패드, 조이스틱, 리모컨, 키보드, 마우스 등을 포함할 수 있다.Meanwhile, the input/output module may include a display, keypad, joystick, remote control, keyboard, mouse, etc.
디스플레이는 다양한 정보를 시각적으로 출력하기 위한 구성이다. A display is a configuration for visually outputting various information.
*디스플레이는 LCD(Liquid Crystal Display), PDP(Plasma Display Panel), OLED(Organic Light Emitting Diodes), TOLED(Transparent OLED), Micro LED 등으로 구현될 수 있으나, 이에 한정되는 것은 아니고 이밖에 종래 알려진 다양한 형태의 디스플레이를 포함할 수 있다.*Displays can be implemented with LCD (Liquid Crystal Display), PDP (Plasma Display Panel), OLED (Organic Light Emitting Diodes), TOLED (Transparent OLED), Micro LED, etc., but are not limited to these and various other conventionally known devices. It may include a display in the form of a display.
디스플레이는, 사용자의 터치 조작을 감지할 수 있는 터치스크린 형태로 구현될 수 있으며, 접히거나 구부러질 수 있는 플렉서블 디스플레이로 구현될 수도 있다.The display may be implemented in the form of a touch screen capable of detecting a user's touch operation, or may be implemented as a flexible display that can be folded or bent.
도 2는 본 개시의 일 실시예에 따른 기본 흐름도이다.Figure 2 is a basic flowchart according to an embodiment of the present disclosure.
도 2에 도시된 바와 같이, 본 발명의 청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커를 제어하는 전자 장치(100)는 검사자의 제1 단말(200)로부터 사용자 명령을 획득(S210)하고, 제1 단말(200)로부터 획득된 사용자 명령을 바탕으로, 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 오디오 출력 순서를 식별(S220)할 수 있다.As shown in FIG. 2, in order to test the auditory reaction speed and directionality of the present invention, the electronic device 100 that controls a plurality of speakers obtains a user command from the tester's first terminal 200 (S210) , Based on the user command obtained from the first terminal 200, the audio output order for each of the plurality of speakers 10-1 to 10-8...10-n can be identified (S220).
이에 따라, 전자 장치(100)는, 오디오 출력 순서를 바탕으로, 복수의 스피커(10-1 내지 10-8...10-n) 중, 적어도 하나 이상의 스피커가 일 순서에 대해 오디오를 일정 주기 및 일정 반복 횟수에 따라 출력하도록, 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 오디오 출력을 제어(S230)할 수 있다.Accordingly, based on the audio output order, at least one speaker among the plurality of speakers 10-1 to 10-8...10-n transmits audio at a certain period in one order. And the audio output for each of the plurality of speakers 10-1 to 10-8...10-n can be controlled (S230) to output according to a certain number of repetitions.
오디오는, 기 등록된 음원(오디오 데이터)일 수 있다.Audio may be a pre-registered sound source (audio data).
오디오 출력 순서는, 채널 번호에 대한 순번에 따른 오디오 출력 순서, 무작위 오디오 출력 순서, 제1 단말(200)로부터 획득된 오디오 출력 순서, 및 사용자 명령에 따른 오디오 출력 순서 중 어느 하나일 수 있다.The audio output order may be any one of the following: an audio output order according to channel numbers, a random audio output order, an audio output order obtained from the first terminal 200, and an audio output order according to a user command.
구체적으로, 채널 번호에 대한 순번에 따른 오디오 출력 순서는 도 3에 도시된 바와 같이, 채널 1에 해당하는 스피커(10-1), 채널 2에 해당하는 스피커(10-2), 채널 3에 해당하는 스피커(10-3), 채널 4에 해당하는 스피커(10-4), 채널 5에 해당하는 스피커(10-5), 채널 6에 해당하는 스피커(10-6), 채널 7에 해당하는 스피커(10-7), 채널 8에 해당하는 스피커(10-8)이 채널 번호 1 내지 8 순서대로 순차적으로 오디오를 출력하도록 하는 것이다.Specifically, the audio output order according to the channel number is as shown in Figure 3, the speaker (10-1) corresponding to channel 1, the speaker (10-2) corresponding to channel 2, and the speaker (10-2) corresponding to channel 3. Speaker (10-3) corresponding to channel 4, speaker corresponding to channel 4 (10-4), speaker corresponding to channel 5 (10-5), speaker corresponding to channel 6 (10-6), speaker corresponding to channel 7 (10-7), the speaker (10-8) corresponding to channel 8 outputs audio sequentially in the order of channel numbers 1 to 8.
무작위 오디오 출력 순서는 오디오를 출력하는 스피커를 순번에 따라 적어도 하나 이상 무작위로 선택하는 것이다.The random audio output order is to randomly select at least one speaker outputting audio according to their order.
제1 단말(200)로부터 획득된 오디오 출력 순서는 제1 단말(200)을 통해 획득된, 검사자의 의도에 따라 지정된 순번 별 적어도 하나의 스피커에 대한 순서이다.The audio output order obtained from the first terminal 200 is the order of at least one speaker for each order obtained through the first terminal 200 and designated according to the examiner's intention.
예컨대, 제1 단말(200)로부터 획득된 오디오 출력 순서에 따라 전자 장치(100)는 첫번째 순번에서 채널 4에 해당하는 스피커(10-4), 채널 5에 해당하는 스피커(10-5)를 통해 오디오가 출력되도록 하고, 그 다음 순번에서 채널 8에 해당하는 스피커(10-8)를 통해 오디오가 출력되도록 하고, 그 다음 순번에서 채널 3에 해당하는 스피커(10-3), 채널 5에 해당하는 스피커(10-5)를 통해 오디오가 출력되도록 제어할 수 있다.For example, according to the audio output order obtained from the first terminal 200, the electronic device 100 outputs audio through the speaker 10-4 corresponding to channel 4 and the speaker 10-5 corresponding to channel 5 in the first order. Ensure that audio is output, and in the next turn, audio is output through the speaker (10-8) corresponding to channel 8, and in the next turn, the speaker (10-3) corresponding to channel 3 and the speaker (10-3) corresponding to channel 5. Audio can be controlled to be output through the speaker 10-5.
사용자 명령에 따른 오디오 출력 순서는 제1 단말(200)을 통해 실시간으로 선택된 적어도 하나의 스피커를 전자 장치(100)가 실시간으로 획득하여, 선택된 스피커를 통해 오디오가 출력되도록 하는 수동 모드에 대한 것이다.The audio output order according to the user command is for a manual mode in which the electronic device 100 acquires at least one speaker selected in real time through the first terminal 200 and outputs audio through the selected speaker.
실시예로, 단계 S230을 수행함에 있어서, 전자 장치(100)는 사용자 명령에 따른 오디오 출력 순서에 따라, 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 오디오 출력을 제어하는 경우, 적어도 하나의 순번에 대해 동시에 오디오를 출력하는 적어도 하나의 스피커를 포함하는 그룹을 오디오 출력 순서에 따라 식별할 수 있다.In an embodiment, when performing step S230, the electronic device 100 outputs audio to each of the plurality of speakers 10-1 to 10-8...10-n according to the audio output order according to the user command. When controlling, a group including at least one speaker that simultaneously outputs audio for at least one turn can be identified according to the audio output order.
이때, 제1 순번에 대해 동시에 오디오를 출력하는 적어도 하나의 스피커를 포함하는 제1 그룹, 및 제1 순번 이후 순서인, 제2 순번에 대해 동시에 오디오를 출력하는 적어도 하나의 스피커를 포함하는 제2 그룹에 대해, 제1 그룹과 제2 그룹이 동일한 그룹인 것으로 식별되면, 전자 장치(100)는 제2 그룹에 포함된 스피커 중 적어도 하나를, 복수의 스피커(10-1 내지 10-8...10-n) 중 제2 그룹에 미포함된 적어도 하나의 스피커로 변경하여 오디오를 출력할 수 있다.At this time, a first group including at least one speaker that simultaneously outputs audio for the first turn, and a second group including at least one speaker that simultaneously outputs audio for the second turn, which is a sequence after the first turn. For a group, if the first group and the second group are identified as being the same group, the electronic device 100 selects at least one of the speakers included in the second group, a plurality of speakers 10-1 to 10-8. .10-n), audio can be output by changing to at least one speaker not included in the second group.
예컨대, 제1 그룹 및 제2 그룹이 각각 채널 4에 해당하는 스피커(10-4), 채널 5에 해당하는 스피커(10-5)를 포함하는 경우, 전자 장치(100)는 제2 그룹에 대하여, 채널 5에 해당하는 스피커(10-5)를 채널 3에 해당하는 스피커(10-3), 채널 8에 해당하는 스피커(10-8)로 변경하여, 제2 그룹이 채널 4에 해당하는 스피커(10-4), 채널 3에 해당하는 스피커(10-3), 및 채널 8에 해당하는 스피커(10-8)를 포함하도록 함으로써, 각 순번에 따른 그룹에 포함된 스피커의 구성에 대해, 오디오 출력이 다른 순번에 따른 그룹과의 중복 없이 다양한 방향에 대해 실시되도록 제어하여 검사 결과의 정확도를 향상시키고 전체적인 방향에 대한 반응 속도를 획득할 수 있다.For example, when the first group and the second group include a speaker 10-4 corresponding to channel 4 and a speaker 10-5 corresponding to channel 5, the electronic device 100 , the speaker (10-5) corresponding to channel 5 is changed to the speaker (10-3) corresponding to channel 3, and the speaker (10-8) corresponding to channel 8, so that the second group is the speaker corresponding to channel 4. (10-4), the speaker (10-3) corresponding to channel 3, and the speaker (10-8) corresponding to channel 8, so that for the configuration of the speakers included in the group according to each order, the audio By controlling the output to be carried out in various directions without overlapping with groups according to different orders, the accuracy of the test results can be improved and the reaction speed for the overall direction can be obtained.
이때, 제1 그룹 및 제2 그룹 각각이 복수의 스피커(10-1 내지 10-8...10-n)를 모두 포함하는 경우, 전자 장치(100)는 제2 그룹에 포함된 스피커 중 적어도 하나를 제2 그룹에서 제외하여 제2 그룹을 변경할 수 있다.At this time, when each of the first group and the second group includes a plurality of speakers (10-1 to 10-8...10-n), the electronic device 100 selects at least one of the speakers included in the second group. You can change the second group by excluding one from the second group.
또한, 실시예로, 전자 장치(100)가 제2 그룹에 포함된 스피커의 구성을 변경함에 있어서, 복수의 스피커(10-1 내지 10-8...10-n)가 짝수개(n은 짝수)인 경우, 제2 그룹에 포함된 상태를 유지하는 스피커 중 어느 하나에 대해 180도 방향에 위치하는 일 스피커를 제2 그룹에 추가하여 제2 그룹에 포함된 스피커의 구성을 변경하여 양 방향에 대한 청각 방향성 검사를 수행할 수 있다.In addition, in an embodiment, when the electronic device 100 changes the configuration of the speakers included in the second group, the plurality of speakers 10-1 to 10-8...10-n are an even number (n is In the case of an even number), one speaker located in a direction of 180 degrees with respect to any one of the speakers remaining included in the second group is added to the second group to change the configuration of the speakers included in the second group to enable two-way An auditory directionality test can be performed.
단계 S230을 수행한 이후, 전자 장치(100)는, 피검자의 제2 단말(300)로부터 반응 데이터를 획득할 수 있다.After performing step S230, the electronic device 100 may obtain reaction data from the subject's second terminal 300.
반응 데이터는 피검자가 오디오를 가청한 것으로 인식한 방향에 해당하는 스피커의 채널 번호, 및 반응 데이터가 생성된 시점을 포함할 수 있다.The reaction data may include the channel number of the speaker corresponding to the direction in which the subject recognized the audio as being heard, and the time when the reaction data was generated.
이에 따라, 오디오 출력 순서에 따른 복수의 스피커(10-1 내지 10-8...10-n)에 대한 오디오 출력이 종료되면, 전자 장치(100)는 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 위치 정보, 및 오디오 출력 순서를 바탕으로 피검자에 대한 청각 방향성 반응속도 데이터를 생성하며, 생성된 청각 방향성 반응속도 데이터를 제1 단말(200)을 통해 검사자에게 제공할 수 있다.Accordingly, when audio output to the plurality of speakers (10-1 to 10-8...10-n) according to the audio output order is terminated, the electronic device 100 outputs the audio to the plurality of speakers (10-1 to 10-n). 8...10-n) Auditory directional reaction speed data for the subject is generated based on the location information and audio output order for each, and the generated auditory directional reaction speed data is sent to the examiner through the first terminal 200. can be provided to.
청각 방향성 반응속도 데이터는, 일 오디오가 출력된 시점, 및 일 오디오를 가청한 방향에 해당하는 사용자 입력이 제2 단말(300)을 통해 수행된 시점을 포함할 수 있다.The auditory directionality reaction speed data may include the time when audio is output and the time when a user input corresponding to the direction in which the audio is heard is performed through the second terminal 300.
예컨대, 일 반응 데이터가 생성된 시점 이전에 마지막으로 오디오를 출력한 적어도 하나의 스피커에 대해, 출력 시점을 오디오가 출력된 시점으로 획득하고, 일 반응 데이터에 포함된 적어도 하나의 채널 번호를 오디오를 가청한 방향으로 획득하고, 일 반응 데이터가 생성된 시점을 사용자 입력이 제2 단말(300)을 통해 수행된 시점으로 획득될 수 있다.For example, for at least one speaker that last output audio before the time when one response data was generated, the output time is obtained as the time when the audio was output, and at least one channel number included in the one response data is used to determine the audio. It can be obtained in an audible direction, and the point in time when one response data is generated can be obtained as the point in time when the user input is performed through the second terminal 300.
한편, 전자 장치(100)는, 제1 오디오에 대한 제1 반응 데이터를, 제1 오디오가 출력된 시점으로부터 임계 시간을 초과하여 제2 단말(300)로부터 획득하면, 제1 오디오를 출력한 제1 스피커를 통해, 제1 오디오가 출력된 순번으로부터 일정 순서 내에 제1 오디오를 재출력하여, 재출력된 제1 오디오에 대한 제2 반응 데이터를 제2 단말(300)로부터 획득할 수 있다.Meanwhile, when the electronic device 100 obtains the first response data to the first audio from the second terminal 300 beyond the threshold time from when the first audio is output, the electronic device 100 Through one speaker, the first audio can be re-outputted within a certain sequence from the turn in which the first audio was output, and second response data for the re-outputted first audio can be obtained from the second terminal 300.
이어서, 전자 장치(100)는 제1 반응 데이터에 대한 제1 반응 속도 및 제2 반응 데이터에 대한 제2 반응 속도를 산출하고, 제1 반응 속도 및 제2 반응 속도의 차값이 임계값을 초과하되, 제2 반응 속도가 제1 반응 속도보다 빠른 경우, 제1 반응 데이터를 제2 반응 데이터로 변경하여 저장한다.Next, the electronic device 100 calculates a first reaction rate for the first reaction data and a second reaction rate for the second reaction data, and the difference between the first reaction rate and the second reaction rate exceeds the threshold. , if the second reaction speed is faster than the first reaction speed, the first reaction data is changed to the second reaction data and stored.
반면, 제1 반응 속도 및 제2 반응 속도의 차값이 임계값 이하이거나, 제2 반응 속도가 제1 반응 속도보다 느린 경우, 전자 장치(100)는 제1 반응 속도 및 제2 반응 속도의 평균 속도를 산출하여, 제1 반응 속도를 평균 속도로 변경하여 저장한다.On the other hand, when the difference between the first reaction rate and the second reaction rate is less than or equal to the threshold or the second reaction rate is slower than the first reaction rate, the electronic device 100 operates at an average rate of the first reaction rate and the second reaction rate. is calculated, the first reaction rate is changed to the average rate and stored.
반응 속도는, 일 반응 데이터가 획득된 시점 이전에, 가장 마지막으로 출력된 오디오가 출력된 시점으로부터 일 반응 데이터가 획득된 시점까지 소요된 시간일 수 있다.The reaction speed may be the time taken from the time when the last audio output was output to the time when the single reaction data was acquired, before the time when the single reaction data was acquired.
실시예로, 제1 반응 데이터를 제2 반응 데이터로 변경하여 저장한 경우, 전자 장치(100)는 오디오 출력 순서 중, 일 순번을 추가하여, 제2 반응 속도가 획득된 직후 순번에 제1 스피커를 사이에 두고 배치된 제2 스피커 및 제3 스피커를 통해 동시에, 제1 오디오보다 출력 시간이 짧거나, 제1 오디오보다 볼륨이 낮은 제2 오디오를 출력하도록 제어하여, 제2 단말(300)을 통해 제3 반응 데이터를 획득할 수 있다.As an example, when the first response data is changed into second response data and stored, the electronic device 100 adds a turn number to the audio output sequence, and immediately after the second response speed is acquired, the first speaker is switched to the turn number. The second terminal 300 is controlled to output a second audio that has a shorter output time than the first audio or has a lower volume than the first audio at the same time through the second speaker and the third speaker disposed between them. Third reaction data can be obtained through.
이때, 제3 반응 데이터에 대한 제3 반응 속도가 제2 반응 속도를 초과하는 경우, 전자 장치(100)는 피검자의 제1 스피커에 대한 청각 방향성이 향상된 것으로 판단하여, 오디오 출력 순서에 따라 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 제어에 있어서, 제1 스피커를 제외하여 오디오가 출력되도록 동작할 수 있다.At this time, when the third reaction speed for the third reaction data exceeds the second reaction speed, the electronic device 100 determines that the subject's hearing directionality with respect to the first speaker has improved, and generates a plurality of audio signals according to the audio output order. In controlling each of the speakers 10-1 to 10-8...10-n, audio may be output except for the first speaker.
한편, 전자 장치(100)는, 일 순번에 대해 반응 데이터가 획득되면, 오디오 출력 순서에 따른 다음 순번에 대한 오디오가 출력되도록 복수의 스피커(10-1 내지 10-8...10-n)를 제어할 수 있다.Meanwhile, when response data is obtained for one turn, the electronic device 100 uses a plurality of speakers 10-1 to 10-8...10-n to output audio for the next turn according to the audio output order. can be controlled.
반응 데이터는, 반응 데이터가 생성된 시점, 피검자가 오디오를 가청한 적어도 하나의 방향에 대한 채널 번호를 선택하는 사용자 입력, 및 가청한 방향이 미존재함에 따른 사용자 입력 중 적어도 하나를 포함할 수 있다.The response data may include at least one of the time point at which the response data was generated, a user input for selecting a channel number for at least one direction in which the subject heard audio, and a user input in response to the absence of an audible direction. .
도 3은 본 개시의 일 실시예에 따른 복수의 스피커 배치도이고, 도 4는 본 개시의 일 실시예에 따른 컨트롤러를 포함하는 시스템 구성도이다.FIG. 3 is a layout diagram of a plurality of speakers according to an embodiment of the present disclosure, and FIG. 4 is a system configuration diagram including a controller according to an embodiment of the present disclosure.
도 4에 도시된 바와 같이, 본 발명의 일 면에 따른 청각 반응 속도 및 방향성을 검사하기 위해, 복수의 스피커(10-1 내지 10-8...10-n)를 제어하는 시스템에 있어서, 오디오 출력 순서를 바탕으로, 복수의 스피커(10-1 내지 10-8...10-n) 중, 적어도 하나 이상의 스피커가 일 순서에 대해 오디오를 일정 주기 및 일정 반복 횟수에 따라 출력하도록, 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 오디오 출력을 제어하는 전자 장치(100), 및 복수의 스피커(10-1 내지 10-8...10-n) 각각이 연결되며, 전자 장치(100)로부터 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 오디오 출력을 제어하는 컨트롤 명령을 획득하고, 컨트롤 명령을 바탕으로 복수의 스피커(10-1 내지 10-8...10-n) 각각에 대한 오디오 출력을 제어하는 컨트롤러(400)를 포함한다.As shown in FIG. 4, in a system for controlling a plurality of speakers (10-1 to 10-8...10-n) to test auditory response speed and directionality according to one aspect of the present invention, Based on the audio output order, among the plurality of speakers (10-1 to 10-8...10-n), at least one speaker outputs audio according to a certain period and a certain number of repetitions for one sequence. An electronic device 100 that controls audio output for each of the speakers 10-1 to 10-8...10-n, and a plurality of speakers 10-1 to 10-8...10-n. Each is connected, and a control command for controlling the audio output for each of the plurality of speakers (10-1 to 10-8...10-n) is obtained from the electronic device 100, and a plurality of speakers are connected based on the control command. It includes a controller 400 that controls audio output for each of the speakers 10-1 to 10-8...10-n.
컨트롤러(400)는 복수의 스피커가 각각이 1 대 1로 연결되는 스피커 연결 단자, 전자 장치(100)와 통신부(120)를 통해 유선 연결되는 메인 단자, 전자 장치(100)와 통신부(120)를 통해 무선 통신하는 통신기를 포함하며, 전자 장치(100)를 통해 획득된 컨트롤 명령을 바탕으로 복수의 스피커 각각에 대해 오디오 출력을 제어할 수 있다.The controller 400 includes a speaker connection terminal where a plurality of speakers are connected one to one, a main terminal connected by wire through the electronic device 100 and the communication unit 120, and the electronic device 100 and the communication unit 120. It includes a communicator that communicates wirelessly, and can control audio output for each of the plurality of speakers based on control commands obtained through the electronic device 100.
이때, 도 3에 도시된 바와 같이, 복수의 스피커(10-1 내지 10-8...10-n)는, 피검자의 위치를 중심으로 균일한 각도로 배치되되, 중심으로부터 일정 거리를 갖도록 배치되고, 각도는, 45도 이하일 수 있으며, 이에 따른 일 예로, 복수의 스피커는, 8개의 스피커로 구성됨으로써, 피검자에 대해 8개의 방향에 따른 청각 방향성을 획득할 수 있다.At this time, as shown in FIG. 3, the plurality of speakers (10-1 to 10-8...10-n) are arranged at a uniform angle around the subject's position, but are arranged at a certain distance from the center. And the angle may be 45 degrees or less. As an example, the plurality of speakers is composed of 8 speakers, so that auditory directionality according to 8 directions can be obtained for the subject.
본 발명의 실시예와 관련하여 설명된 방법 또는 알고리즘의 단계들은 하드웨어로 직접 구현되거나, 하드웨어에 의해 실행되는 소프트웨어 모듈로 구현되거나, 또는 이들의 결합에 의해 구현될 수 있다. 소프트웨어 모듈은 RAM(Random Access Memory), ROM(Read Only Memory), EPROM(Erasable Programmable ROM), EEPROM(Electrically Erasable Programmable ROM), 플래시 메모리(Flash Memory), 하드 디스크, 착탈형 디스크, CD-ROM, 또는 본 발명이 속하는 기술 분야에서 잘 알려진 임의의 형태의 컴퓨터 판독가능 기록매체에 상주할 수도 있다.The steps of the method or algorithm described in connection with embodiments of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or a combination thereof. The software module may be RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, hard disk, removable disk, CD-ROM, or It may reside on any type of computer-readable recording medium well known in the art to which the present invention pertains.
또한, 본 발명의 서로 다른 실시예들은 상호 보완되거나 결합될 수 있다.Additionally, different embodiments of the present invention may complement or be combined with each other.
본 발명의 구성 요소들은 하드웨어인 컴퓨터와 결합되어 실행되기 위해 프로그램(또는 애플리케이션)으로 구현되어 매체에 저장될 수 있다. 본 발명의 구성 요소들은 소프트웨어 프로그래밍 또는 소프트웨어 요소들로 실행될 수 있으며, 이와 유사하게, 실시 예는 데이터 구조, 프로세스들, 루틴들 또는 다른 프로그래밍 구성들의 조합으로 구현되는 다양한 알고리즘을 포함하여, C, C++, 자바(Java), 어셈블러(assembler), 파이썬(Python) 등과 같은 프로그래밍 또는 스크립팅 언어로 구현될 수 있다. 기능적인 측면들은 하나 이상의 프로세서들에서 실행되는 알고리즘으로 구현될 수 있다.The components of the present invention may be implemented as a program (or application) and stored in a medium in order to be executed in conjunction with a hardware computer. Components of the invention may be implemented as software programming or software elements, and similarly, embodiments may include various algorithms implemented as combinations of data structures, processes, routines or other programming constructs, such as C, C++, , it can be implemented in a programming or scripting language such as Java, assembler, Python, etc. Functional aspects may be implemented as algorithms running on one or more processors.
이상, 첨부된 도면을 참조로 하여 본 발명의 실시예를 설명하였지만, 본 발명이 속하는 기술분야의 통상의 기술자는 본 발명이 그 기술적 사상이나 필수적인 특징을 변경하지 않고서 다른 구체적인 형태로 실시될 수 있다는 것을 이해할 수 있을 것이다. 그러므로, 이상에서 기술한 실시예들은 모든 면에서 예시적인 것이며, 제한적이 아닌 것으로 이해해야만 한다.Above, embodiments of the present invention have been described with reference to the attached drawings, but those skilled in the art will understand that the present invention can be implemented in other specific forms without changing its technical idea or essential features. You will be able to understand it. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive.

Claims (8)

  1. 복수의 스피커를 제어하는 전자 장치에 있어서,In an electronic device that controls a plurality of speakers,
    상기 복수의 스피커 각각에 대한 위치 정보, 및 피검자에 대한 위치 정보를 포함하는 메모리;a memory including location information for each of the plurality of speakers and location information for the subject;
    상기 복수의 스피커와 통신하는 통신부; 및a communication unit that communicates with the plurality of speakers; and
    상기 메모리 및 상기 통신부와 연결된 프로세서;를 포함하고,Includes a processor connected to the memory and the communication unit,
    상기 프로세서는,The processor,
    상기 통신부를 통해, 검사자의 제1 단말로부터 사용자 명령을 획득하고,Obtaining a user command from the examiner's first terminal through the communication unit,
    상기 제1 단말로부터 획득된 사용자 명령을 바탕으로, 상기 복수의 스피커 각각에 대한 오디오 출력 순서를 식별하고,Based on the user command obtained from the first terminal, identify the audio output order for each of the plurality of speakers,
    상기 통신부를 통해, 상기 오디오 출력 순서를 바탕으로, 상기 복수의 스피커 각각에 대한 오디오 출력을 제어하는 것을 특징으로 하는, 전자 장치.An electronic device, characterized in that, through the communication unit, audio output for each of the plurality of speakers is controlled based on the audio output order.
  2. 제1 항에 있어서,According to claim 1,
    상기 메모리는,The memory is,
    상기 피검자의 정면에 위치하는 스피커, 오디오 데이터 및 오디오 출력 순서를 포함하고,Includes a speaker located in front of the subject, audio data, and audio output order,
    상기 프로세서는,The processor,
    상기 오디오 출력 순서를 바탕으로, 상기 복수의 스피커 중, 적어도 하나 이상의 스피커가 일 순서에 대해 오디오를 일정 주기 및 일정 반복 횟수에 따라 출력하도록 제어하는 것을 특징으로 하는, 전자 장치.An electronic device, characterized in that, based on the audio output order, at least one speaker among the plurality of speakers is controlled to output audio according to a certain period and a certain number of repetitions for one order.
  3. 제1 항에 있어서,According to claim 1,
    상기 메모리는,The memory is,
    상기 복수의 스피커 각각에 대한 채널 번호를 포함하고,Contains a channel number for each of the plurality of speakers,
    상기 오디오 출력 순서는,The audio output order is,
    채널 번호에 대한 순번에 따른 오디오 출력 순서, 무작위 오디오 출력 순서, 상기 제1 단말로부터 획득된 오디오 출력 순서, 및 상기 사용자 명령에 따른 오디오 출력 순서 중 어느 하나인 것을 특징으로 하는, 전자 장치.An electronic device, characterized in that one of the following: an audio output order according to the sequence of channel numbers, a random audio output order, an audio output order obtained from the first terminal, and an audio output order according to the user command.
  4. 제1 항에 있어서,According to claim 1,
    상기 프로세서는,The processor,
    상기 통신부를 통해, 상기 피검자의 제2 단말로부터 반응 데이터를 획득하고,Obtaining reaction data from the subject's second terminal through the communication unit,
    상기 오디오 출력 순서에 따른 상기 복수의 스피커에 대한 오디오 출력이 종료되면, 상기 복수의 스피커 각각에 대한 위치 정보, 및 상기 오디오 출력 순서를 바탕으로 상기 피검자에 대한 청각 방향성 반응속도 데이터를 생성하고,When audio output to the plurality of speakers according to the audio output order is terminated, auditory directional reaction speed data for the subject is generated based on location information for each of the plurality of speakers and the audio output order,
    상기 청각 방향성 반응속도 데이터는,The auditory directional reaction speed data is,
    일 오디오가 출력된 시점, 및 상기 일 오디오를 가청한 방향에 해당하는 사용자 입력이 상기 제2 단말을 통해 수행된 시점을 포함하는 것을 특징으로 하는, 전자 장치.An electronic device comprising a time when audio is output, and a time when a user input corresponding to a direction in which the audio is heard is performed through the second terminal.
  5. 제4 항에 있어서,According to clause 4,
    상기 프로세서는,The processor,
    제1 오디오에 대한 제1 반응 데이터를, 상기 제1 오디오가 출력된 시점으로부터 임계 시간을 초과하여 상기 제2 단말로부터 획득하면, 상기 제1 오디오를 출력한 제1 스피커를 통해, 상기 제1 오디오가 출력된 순번으로부터 일정 순서 내에 상기 제1 오디오를 재출력하여, 상기 재출력된 제1 오디오에 대한 제2 반응 데이터를 상기 제2 단말로부터 획득하고,When first response data to the first audio is obtained from the second terminal exceeding a threshold time from when the first audio is output, the first audio is transmitted through the first speaker that outputs the first audio. Re-output the first audio within a certain order from the output sequence, and obtain second response data for the re-output first audio from the second terminal,
    상기 제1 반응 데이터에 대한 제1 반응 속도 및 상기 제2 반응 데이터에 대한 제2 반응 속도를 산출하고,Calculate a first reaction rate for the first reaction data and a second reaction rate for the second reaction data,
    상기 제1 반응 속도 및 상기 제2 반응 속도의 차값이 임계값을 초과하되, 상기 제2 반응 속도가 상기 제1 반응 속도보다 빠른 경우, 상기 제1 반응 데이터를 상기 제2 반응 데이터로 변경하여 저장하고,If the difference between the first reaction speed and the second reaction speed exceeds the threshold, but the second reaction speed is faster than the first reaction speed, the first reaction data is changed to the second reaction data and stored. do,
    상기 제1 반응 속도 및 상기 제2 반응 속도의 차값이 상기 임계값 이하이거나, 상기 제2 반응 속도가 상기 제1 반응 속도보다 느린 경우, 상기 제1 반응 속도 및 상기 제2 반응 속도의 평균 속도를 산출하여, 상기 제1 반응 속도를 상기 평균 속도로 변경하여 저장하고,If the difference between the first reaction rate and the second reaction rate is less than or equal to the threshold or the second reaction rate is slower than the first reaction rate, the average rate of the first reaction rate and the second reaction rate is Calculate, change the first reaction rate to the average rate and store it,
    반응 속도는,The reaction speed is,
    일 반응 데이터가 획득된 시점 이전에, 가장 마지막으로 출력된 오디오가 출력된 시점으로부터 상기 일 반응 데이터가 획득된 시점까지 소요된 시간인 것을 특징으로 하는, 전자 장치.An electronic device, characterized in that the time elapsed from the time when the last output audio was output before the time when the work response data was acquired to the time when the work response data was acquired.
  6. 제4 항에 있어서,According to clause 4,
    상기 프로세서는,The processor,
    일 순번에 대해 반응 데이터가 획득되면, 상기 오디오 출력 순서에 따른 다음 순번에 대한 오디오가 출력되도록 상기 복수의 스피커를 제어하고,When response data is obtained for one turn, control the plurality of speakers to output audio for the next turn according to the audio output order,
    상기 반응 데이터는,The reaction data is,
    상기 반응 데이터가 생성된 시점, 상기 피검자가 오디오를 가청한 적어도 하나의 방향에 대한 채널 번호를 선택하는 사용자 입력, 및 가청한 방향이 미존재함에 따른 사용자 입력 중 적어도 하나를 포함하는 것을 특징으로 하는, 전자 장치.Characterized in that it includes at least one of a time point at which the response data was generated, a user input for selecting a channel number for at least one direction in which the subject heard audio, and a user input according to the absence of an audible direction. , electronic devices.
  7. 복수의 스피커를 제어하는 시스템에 있어서,In a system for controlling multiple speakers,
    오디오 출력 순서를 바탕으로, 상기 복수의 스피커 중, 적어도 하나 이상의 스피커가 일 순서에 대해 오디오를 일정 주기 및 일정 반복 횟수에 따라 출력하도록, 상기 복수의 스피커 각각에 대한 오디오 출력을 제어하는 전자 장치; 및Based on the audio output order, an electronic device that controls audio output for each of the plurality of speakers so that at least one speaker among the plurality of speakers outputs audio according to a certain period and a certain number of repetitions for one order; and
    상기 복수의 스피커 각각이 연결되며, 상기 전자 장치로부터 상기 복수의 스피커 각각에 대한 오디오 출력을 제어하는 컨트롤 명령을 획득하고, 상기 컨트롤 명령을 바탕으로 상기 복수의 스피커 각각에 대한 오디오 출력을 제어하는 컨트롤러;를 포함하는, 시스템.A controller to which each of the plurality of speakers is connected, obtains a control command for controlling audio output for each of the plurality of speakers from the electronic device, and controls audio output for each of the plurality of speakers based on the control command. system, including ;
  8. 제7 항에 있어서,According to clause 7,
    상기 복수의 스피커는,The plurality of speakers are,
    피검자의 위치를 중심으로 균일한 각도로 배치되되, 상기 중심으로부터 일정 거리를 갖도록 배치되고,It is arranged at a uniform angle around the subject's position, but is arranged at a certain distance from the center,
    상기 각도는,The angle is,
    45도 이하인 것을 특징으로 하는, 시스템.A system characterized in that it is less than 45 degrees.
PCT/KR2023/013503 2022-09-08 2023-09-08 Electronic device and system for controlling plurality of speakers in order to test auditory response speed and directionality WO2024054090A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020220114269A KR102499559B1 (en) 2022-09-08 2022-09-08 Electronic device and system for control plurality of speaker to check about audible response speed and directionality
KR10-2022-0114269 2022-09-08

Publications (1)

Publication Number Publication Date
WO2024054090A1 true WO2024054090A1 (en) 2024-03-14

Family

ID=85202912

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2023/013503 WO2024054090A1 (en) 2022-09-08 2023-09-08 Electronic device and system for controlling plurality of speakers in order to test auditory response speed and directionality

Country Status (2)

Country Link
KR (2) KR102499559B1 (en)
WO (1) WO2024054090A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102499559B1 (en) * 2022-09-08 2023-02-13 강민호 Electronic device and system for control plurality of speaker to check about audible response speed and directionality

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190027820A (en) * 2016-07-07 2019-03-15 고스호크 통신 리미티드 Hearing tests and modification of audio signals
KR20210029756A (en) * 2021-03-08 2021-03-16 한림대학교 산학협력단 Inspection method and apparatus for sound direction discrimination ability
KR20210061810A (en) * 2019-11-20 2021-05-28 에스케이브로드밴드주식회사 Automatic test apparatus, and control method thereof
KR20220057212A (en) * 2020-10-29 2022-05-09 한림대학교 산학협력단 Auditory directional discrimination training system and method
US20220183593A1 (en) * 2019-04-18 2022-06-16 Hearing Diagnostics Limited Hearing test system
KR102499559B1 (en) * 2022-09-08 2023-02-13 강민호 Electronic device and system for control plurality of speaker to check about audible response speed and directionality

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190027820A (en) * 2016-07-07 2019-03-15 고스호크 통신 리미티드 Hearing tests and modification of audio signals
US20220183593A1 (en) * 2019-04-18 2022-06-16 Hearing Diagnostics Limited Hearing test system
KR20210061810A (en) * 2019-11-20 2021-05-28 에스케이브로드밴드주식회사 Automatic test apparatus, and control method thereof
KR20220057212A (en) * 2020-10-29 2022-05-09 한림대학교 산학협력단 Auditory directional discrimination training system and method
KR20210029756A (en) * 2021-03-08 2021-03-16 한림대학교 산학협력단 Inspection method and apparatus for sound direction discrimination ability
KR102499559B1 (en) * 2022-09-08 2023-02-13 강민호 Electronic device and system for control plurality of speaker to check about audible response speed and directionality

Also Published As

Publication number Publication date
KR102499559B1 (en) 2023-02-13
KR102581096B1 (en) 2023-09-20

Similar Documents

Publication Publication Date Title
WO2024054090A1 (en) Electronic device and system for controlling plurality of speakers in order to test auditory response speed and directionality
WO2016208808A1 (en) Display device
WO2017073959A1 (en) Smart watch having display, color of which changes according to state of user
EP3639538A1 (en) Method for wirelessly communicating with external device and electronic device supporting the same
WO2015174597A1 (en) Voice-controllable image display device and voice control method for image display device
WO2017175997A1 (en) Electronic apparatus and control method therefor
WO2019177373A1 (en) Electronic device for controlling predefined function based on response time of external electronic device on user input, and method thereof
WO2014148714A1 (en) Portable device and visual sensation detecting alarm control method thereof
WO2011108837A2 (en) Apparatus and method for producing user-defined golf course, server for producing user-defined golf course and virtual golf simulation method using the golf course
WO2019164145A1 (en) Electronic device and posture correction method thereof
WO2023120974A1 (en) Method of controlling server for providing block puzzle solution
WO2016129773A1 (en) Method, device and system for providing feedback, and non-transitory computer readable recording medium
US20040063086A1 (en) Interactive learning computer system
WO2017065324A1 (en) Sign language education system, method and program
WO2018101589A1 (en) Hearing test system and method
WO2023224433A1 (en) Information generation method and device
WO2023033469A1 (en) Method for 3d-cropping medical image and device therefor
WO2023022406A1 (en) Learning ability evaluation method, learning ability evaluation device, and learning ability evaluation system
WO2016159622A1 (en) Method and system for providing word learning content according to user's learning level, and recording medium
WO2021118184A1 (en) User terminal and control method therefor
WO2022139327A1 (en) Method and apparatus for detecting unsupported utterances in natural language understanding
WO2017188470A1 (en) Method and system for drawing picture by using smart pen
WO2016182360A1 (en) User device, server, and system having function of managing body fat or glucose, and method for managing body fat or glucose using same
WO2024014633A1 (en) Electronic device, control method, and computer program for evaluating and analyzing spiral drawing for diagnostic measurement of movement ability
WO2023234511A1 (en) Electronic device, control method and computer program for automatically measuring font size, space between letters, and height of center point