JP2020042799A - Ear set control method and system - Google Patents

Abstract

To provide an ear set control method and system capable of more easily controlling various functions by a limited input interface included in an ear set.SOLUTION: An ear set control method includes: a step 510 for recognizing a touch gesture to a touch area of a first ear set in an ear set pair; a step 520 for confirming whether a second type of a touch gesture is further recognized within a preset time in response to the recognition of a first type of a touch gesture; a step 530 for generating a first control signal to the recognized first type of a touch gesture if the second type of a touch gesture is not recognized within the preset time; and a step 540 for generating a second control signal to the recognized first type of a touch gesture if the second type of a touch gesture is further recognized within the preset time.SELECTED DRAWING: Figure 5

Description

  The following description relates to an earset control method and system, and a computer program recorded on a computer-readable recording medium for causing a computer to execute the earset control method according to an embodiment of the present invention in combination with a computer, and a computer program therefor. It relates to a recording medium.

  An earset is a device equipped with an earphone and a microphone that can be connected without using a hand by connecting to a telephone. For example, when connected to a smartphone, it can be used not only for telephone calls but also for music. It receives and outputs various types of audio, and provides various control signals to control the smartphone using physical buttons and sensors or voice. For example, Patent Document 1 discloses a Bluetooth (registered trademark) earset having a built-in ear kernel microphone.

Korean Published Patent No. 10-2017-0030375

  Perform an earset control method and an earset control method in which various functions can be more easily controlled by a limited input interface included in the earset (for example, a touch interface of a touch sensor included in the earset). Provided are a computer device, a computer program recorded on a computer-readable recording medium for causing a computer to execute the earset control method, and the recording medium.

  An earset control method capable of controlling transmission of an audio signal according to a user's earset wearing situation, a computer device for executing the earset control method, and a computer-readable recording for causing a computer to execute the earset control method A computer program recorded on a medium and a recording medium thereof are provided.

  Earset control method capable of quickly returning earset setting values to basic setting values, computer device for executing earset control method, and recording on computer-readable recording medium for causing computer to execute earset control method And a recording medium for the computer program.

  Recognizing a touch gesture for a touch area of the first earset of the earset pair, responding to the recognition of the first type of touch gesture, and further recognizing a second type of touch gesture within a preset time. Determining whether the touch gesture of the second type is not further recognized within the preset time, a first control signal for the recognized touch gesture of the first type. Generating a second control signal for the recognized first type of touch gesture if the second type of touch gesture is further recognized within the preset time. An earset control method is provided.

  Transmitting an audio signal to a first earset and a second earset, wherein the first earset and the second ear are based on output values of proximity sensors included in the first earset and the second earset, respectively. Determining whether both sets are off the user's ear, and if it is determined that both the first earset and the second earset are off the user's ear, An earset control method is provided that includes stopping transmission of an audio signal.

  Recording basic settings of a first earset and a second earset, recording current settings of the first earset and the second earset, respectively, the first earset and the second earset Recognizing a touch gesture for the touch area, and if a preset touch gesture for each of the first earset and the second earset is continuously recognized within a preset time range, An earset control method includes a step of changing a current setting value of the first earset and the second earset based on the basic setting value.

  A computer program recorded on a computer-readable recording medium for causing the computer to execute the earset control method in combination with the computer.

  There is provided a computer-readable recording medium in which a program for causing a computer to execute the earset control method is recorded.

  A computer device, comprising at least one processor implemented to execute instructions readable by the computer device, wherein the at least one processor touches a touch area of a first earset of an earset pair. Recognizing the gesture, responding to the recognition of the first type of touch gesture, checking whether or not the second type of touch gesture is further recognized within a preset time; If the second type of touch gesture is not further recognized, a first control signal is generated for the recognized first type of touch gesture, and the second type of touch gesture is generated within the preset time. If the touch gesture is further recognized, the recognized first type touch gesture Generating a first control signal to the turbocharger over, provides a computer apparatus.

  A computer device, comprising at least one processor implemented to execute instructions readable by the computer device, wherein the at least one processor transmits audio signals to a first earset and a second earset. Then, it is determined whether both the first earset and the second earset have been removed from the user's ear based on the output values of the proximity sensors included in the first earset and the second earset, respectively. A computer device that, upon determining, stops transmitting the audio signal when it is determined that both the first earset and the second earset are off the user's ear.

  A computing device, comprising at least one processor implemented to execute instructions readable by the computing device, wherein the at least one processor sets a base setting for a first earset and a second earset. Recording, recording a current setting value of the first ear set and the second ear set, recognizing a touch gesture for a touch area of each of the first ear set and the second ear set, When a preset touch gesture for each of the second ear sets is continuously recognized within a preset time range, the current setting values of the first ear set and the second ear set are used as the basic values. A computer device that changes based on a setting value is provided.

  Various functions can be more easily controlled by a limited input interface included in the earset (for example, a touch interface of a touch sensor included in the earset). For example, even for the same touch gesture, different control of sound source control and volume control can be performed according to the subsequent touch gesture.

  Transmission of an audio signal can be controlled according to the user's earset wearing status. For example, when both earsets are removed from the user's ear, it is possible to automatically stop the reproduction of the sound source or stop the transmission of the audio signal for the telephone call.

  The set value of the earset can be quickly returned to the basic set value. For example, if the audio volume suddenly increases or the audio volume suddenly decreases in the situation of operating the audio volume, the audio volume can be quickly brought to the basic level by a simple touch operation of the user. It is possible to return.

FIG. 2 is a block diagram illustrating an example of a computer device according to an embodiment of the present invention. FIG. 4 is a diagram illustrating an example of communication between an earset pair and an electronic device according to an embodiment of the present invention. FIG. 8 is a diagram illustrating another example of communication of an earset pair and an electronic device according to an embodiment of the present invention. 5 is a flowchart illustrating an example of an earset control method according to an embodiment of the present invention. 5 is a flowchart illustrating an example of an earset control method according to an embodiment of the present invention. 9 is a flowchart illustrating another example of an earset control method according to an embodiment of the present invention. 5 is a flowchart illustrating an example of an earset control method using an earset according to an embodiment of the present invention. 11 is a flowchart illustrating an example of an earset control method according to another embodiment of the present invention. 11 is a flowchart illustrating an example of an earset control method according to still another embodiment of the present invention.

  Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

  The earset control method according to the embodiment of the present invention may be realized by a computer device described below. At this time, the computer program according to the embodiment of the present invention may be installed and executed in the computer device, and the computer device may control the earset control method according to the embodiment of the present invention according to the control of the computer program to be executed. May be performed. The above-described computer program may be recorded on a computer-readable recording medium for causing a computer to execute the earset control method in combination with a computer device.

  FIG. 1 is a block diagram illustrating an example of a computer device according to an embodiment of the present invention. The electronic devices and / or earset pairs described below may be implemented by the computer device 100 illustrated in FIG. 1, and the earset control method according to one embodiment may be implemented as illustrated in FIG. May be executed by an electronic device and / or an earset pair realized by the implemented computer device 100.

  Such a computing device 100 may include a memory 110, a processor 120, a communication interface 130, and an input / output interface 140, as shown in FIG. The memory 110 is a computer-readable storage medium, and may include a permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), and a disk drive. Here, a permanent large-capacity recording device such as a ROM or a disk drive may be included in the computer device 100 as another permanent recording device separated from the memory 110. The memory 110 may store an operating system and at least one program code. Such software components may be loaded into the memory 110 from a computer-readable recording medium other than the memory 110. Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD / CD-ROM drive, memory card, and the like. In other embodiments, the software components may be loaded into the memory 110 through a communication interface 130 that is not a computer-readable storage medium. For example, the software components may be loaded into the memory 110 of the computer device 100 based on a computer program installed by a file received via the network 160.

  Processor 120 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processor 120 by the memory 110 or the communication interface 130. For example, the processor 120 may be configured to execute instructions received according to program codes recorded on a recording device such as the memory 110.

  The communication interface 130 may provide a function for the computer device 100 to communicate with another electronic device (for example, the above-described recording device) via the network 160. As an example, a request, command, data, file, or the like generated by the processor 120 of the computer device 100 according to a program code recorded in a recording device such as the memory 110 is transmitted to another device via the network 160 under the control of the communication interface 130. May be communicated to Conversely, signals, commands, data, files, and the like from other devices may be received by the computer device 100 via the communication interface 130 of the computer device 100 via the network 160. The signals, commands, data, and the like received through the communication interface 130 may be transmitted to the processor 120 and the memory 110, and the files and the like may be stored in a recording medium (the permanent recording device described above) that the computer device 100 may further include. May be recorded.

  The input / output interface 140 may be a means for interfacing with the input / output device 150. For example, the input device may include a device such as a microphone, a keyboard, or a mouse, and the output device may include a device such as a display, a speaker, and the like. As another example, the input / output interface 140 may be a means for interfacing with a device in which input and output functions are integrated into one, such as a touch screen. The input / output device 150 may be composed of the computer device 100 and one device.

  Also, in other embodiments, the computing device 100 may include fewer or more components than the components of FIG. However, most prior art components need not be clearly shown in the figures. For example, the computer device 100 may be implemented to include at least a part of the input / output devices 150 described above, and further include other components such as a transceiver and a global positioning system (GPS). May be.

  The communication method is not limited, and may include not only a communication method using a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network 160 can include, but also a Bluetooth (Bluetooth) ( (Registered trademark) and near field communication such as NFC (Near Field Communication). For example, the network 160 includes a PAN (personal area network), a LAN (local area network), a CAN (campus area network), a MAN (metropolitan area network, a WAN (wide area network), WAN (wide area network), and the like). It may include any one or more of the networks. Further, network 160 may include any one or more of a network topology, including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, and the like. It will not be done.

  On the other hand, in some embodiments, at least one of the earset pairs may include components different from those in FIG. For example, as described below with reference to FIG. 4, the earset device 400 may be implemented to include the components 410 to 470 of FIG.

  FIG. 2 is a diagram illustrating an example of communication between an earset pair and an electronic device according to an embodiment of the present invention. In general, a smart phone uses a short-range wireless communication protocol such as Bluetooth (registered trademark), Zigbee (registered trademark), Wi-Fi, or the like, and transmits signals to a peripheral such as an earset or a wireless speaker. Communicate with equipment. The embodiment of FIG. 2 also describes an example in which the electronic device 210 communicates with the earset pair using such a short-range wireless communication protocol. However, the electronic device 210 can only communicate with one device (the first earset device 220 in the embodiment of FIG. 2) at a time by using one short-range wireless communication protocol (for example, Bluetooth 4.1). There are cases. In other words, the electronic device 210 may not be able to simultaneously communicate with two or more devices using one short-range wireless communication protocol. In this embodiment, the electronic device 210 may communicate with one device, the first earset device 220, using one short-range wireless communication protocol, and the second earset device 230 may communicate with the first earset device 230. Communication may be performed by relay with the device 220. Therefore, the first earset device 220 and the second earset device 230 may perform short-range wireless communication with each other. For example, the second earset device 230 may transmit the sound input to the microphone included in the second earset device 230 to the electronic device 210 via the first earset device 220. Conversely, the control signal transmitted from the electronic device 210 may be transmitted to the second earset device 230 via the first earset device 220. For such voice relay communication, for example, a TWS (True Wireless Stereo) system may be used.

  FIG. 3 is a diagram illustrating another communication example of the earset pair and the electronic device according to the embodiment of the present invention. Unlike the embodiment of FIG. 2, the electronic device 210 may simultaneously communicate with both the first earset device 220 and the second earset device 230 using one short-range wireless communication protocol. For example, short-range wireless communication protocols, such as Bluetooth 5.0, provide a technology that allows a smartphone to connect and communicate with two devices at the same time. The embodiment of FIG. 3 may simultaneously communicate with both the first earset device 220 and the second earset device 230 using the short-range wireless communication protocol capable of simultaneously communicating with a plurality of devices.

  FIG. 4 is a block diagram illustrating an example of an internal configuration of the earset device according to the embodiment of the present invention. The earset device 400 according to the present embodiment may correspond to the first earset device 220 and / or the second earset device 230 described with reference to FIGS. 2 and 3 described above. Such an earset device 400 may include a control unit 410, a speaker 420, a microphone 430, a touch sensor 440, a proximity sensor 450, an LED 460, and a communication unit 470. Depending on the embodiment, the earset device 400 may not include at least one of the components 410 to 470 described with reference to FIG. 4 (for example, the LED 460), or may include other components (for example, the LED 460). , An acceleration sensor or a gravity sensor).

  The control unit 410 may be implemented in the form of an electronic circuit and / or a chip set for controlling the speaker 420, the microphone 430, the touch sensor 440, the proximity sensor 450, the LED 460, and the communication unit 470.

  The speaker 420 may be a component for outputting an audio signal. For example, an audio signal transmitted by the electronic device 210 may be output from the speaker 420 of the earset device 400.

  The microphone 430 may be a component for receiving an input of a surrounding audio signal. For example, a voice command of the user may be input to the microphone 430 and transmitted to the electronic device 210 via the communication unit 470.

  The touch sensor 440 may be a component for receiving an input of a user's touch command. For example, according to various touch gestures recognized in a touch area provided outside the earset device 400 for the touch sensor 440, control of the earset device 400, sound source reproduction, sound source stop, calling of an assistant, Various controls, such as invoking a translation function, volume control, etc., may be processed. For example, various touch gestures may be configured by touch gestures classified into tap, hold, very long, and the like, and combinations thereof. Such touch gestures may be classified according to a touch time, for example. As a more specific example, the tap touch gesture may be recognized when the touch is released within less than one second after the touch occurs in the touch area. The hold touch gesture may be recognized when the touch is released within a predetermined time (for example, 3 seconds) after the touch occurs in the touch area. A very long touch gesture may be recognized if a touch is maintained for more than a certain amount of time (eg, 5 seconds).

  The proximity sensor 450 may be a component for detecting whether the earset device 400 is worn on a user's ear. For example, disposing the proximity sensor 450 between the body of the earset device 400 and the portion inserted into the user's ear effectively senses whether the earset device 400 is worn on the user's ear. May do it.

  The LED (Light Emitting Diode) 460 may be a component for providing various notifications regarding the earset device 400. For example, the earset device 400 may provide various notifications to the user based on the color of the light output from the LED 460, the output time, the cycle, and the like.

  The communication unit 470 may be a component for communication with the electronic device 210 or another earset device (for example, the second earset device 230), as described above.

  FIG. 5 is a flowchart illustrating an example of an earset control method according to an embodiment of the present invention. The earset control method according to the present embodiment may be executed by, for example, the computer device 100 that implements the electronic device 210 described above. For example, the processor 120 of the computer device 100 may be implemented to execute a control instruction based on an operating system code and at least one program code included in the memory 110. Here, the processor 120 may control the computer device 100 such that the computer device 100 performs steps 510 to 540 included in the method of FIG. 5 according to control instructions provided by the code recorded in the computer device 100. . Here, the at least one program may be an application installed on the computer device 100 for controlling the earset.

  In operation 510, the computing device 100 may recognize a touch gesture on the touch area of the first earset of the earset pair. As an example, an earset pair may correspond to the first earset device 220 and the second earset device 230 described with reference to FIGS. 2 and 3, where the first earset is, for example, the first earset. It may correspond to the set device 220. The recognition of the touch gesture may be processed using the touch sensor included in the first earset, as described above. For example, the sensing value recognized by the touch sensor of the first earset may be transmitted to the computer device 100, and the computer device 100 may perform a touch gesture on the touch area of the first earset based on the transmitted sensing value. May be recognized. In some embodiments, the first earset may recognize the touch gesture based on the sensing value recognized by the touch sensor, and transmit information on the type of the recognized touch gesture to the computer device 100. Such recognition of touch gestures may be applied to other embodiments described below in the same or similar manner.

  In operation 520, the computing device 100 may respond to the recognition of the first type of touch gesture and determine whether the second type of touch gesture is further recognized within a preset time. At this time, if the second type of touch gesture is not recognized within a predetermined time, step 530 is performed, and if the second type of touch gesture is recognized within a predetermined time, step 540 is performed. May be executed respectively. For example, the first type of touch gesture may be a tap touch gesture described above, and the second type of touch gesture may be a hold touch gesture, but is not limited thereto.

  In operation 530, the computing device 100 may generate a first control signal for the recognized first type of touch gesture. As an example, the first control signal may include a first sound source control signal related to sound source control.

  In operation 540, the computing device 100 may generate a second control signal for the recognized first type of touch gesture. As an example, the second control signal may include a first volume control signal related to audio volume control.

  For example, when only the tap touch gesture is recognized, the computer device 100 may generate a first sound source control signal (for example, a control signal for starting music playback) as a response to the recognition of the tap touch gesture. If the hold touch gesture is input within a predetermined time after the tap touch gesture is input, a first volume control signal (for example, the audio volume level is increased by 1 as a response to the recognition of the tap touch gesture). May be generated. In this case, the same tap touch gesture is used to generate one of the different control signals, such as starting music playback and increasing volume, depending on whether an additional hold touch gesture is input. May be. In this case, the type of the touch gesture may be classified based on the time of the touch continuously recognized in the touch area. The tap touch gesture is recognized when the touch is released within less than 1 second after the touch area is touched, and the hold touch gesture is the time less than 3 seconds after the touch area is touched. As described in the corresponding embodiment, it is recognized when the touch is released within a period, and the very long touch gesture is recognized when the touch is maintained for 5 seconds or more.

  At this time, the computer device 100 may further generate a second volume control signal for the recognized second type of touch gesture in operation 540. For example, the first volume control signal may include a signal for increasing or decreasing the audio volume level by one level from the current level, and the second volume control signal may include increasing the audio volume level by a second level from the current level. A signal for gradually increasing or decreasing according to the touch time recognized by the type of touch gesture may be included. As a more specific example, if a hold touch gesture is recognized within a preset time after a tap touch gesture is recognized, the audio volume level may be increased or decreased by one level from the current level, and The audio volume level may be gradually increased (for example, increased by one level per 200 ms) or decreased according to the time at which the touch is recognized by maintaining the touch gesture.

  On the other hand, different ear sets of a pair of two ear sets may be realized to perform different ear set controls even with the same touch gesture. For example, a tap touch gesture for the left earset is used to control the start of playback of a sound source (eg, music), and a same tap touch gesture for the right earset is used to control the end of playback of a sound source. May be. As another example, a tap touch gesture and a hold touch gesture for the left earset are used to control a decrease in audio volume, and a tap touch gesture and a hold touch gesture for the right earset control an increase in audio volume. May be used for As another example, the hold touch gesture for the right earset is used to control the invocation of an assistant for voice recognition, and the hold touch gesture for the left earset recognized during voice recognition is used for voice recognition. It may be used to control termination. As yet another example, the hold touch gesture for the left ear set is used to control the invocation of the translation function, and the hold touch gesture for the right ear set recognized during the provision of the translation function is used for the translation function being provided. May be used to control the termination of

  If the electronic device 210 is receiving a telephone call price, a tap touch gesture for the left earset or the right earset may be used to control a call connection for the incoming telephone call, and a hold touch gesture It may be used for call rejection control for an incoming telephone call. In addition, when a call is connected to the electronic device 210, two consecutive tap touch gestures on the left earset or the right earset may be used to control the end of the call during connection. As another example, when the sound source is being reproduced, successive two or three tap touch gestures for the left earset or the right earset may be used for controlling the change of the sound source to be reproduced.

  As still another embodiment, when the electronic device 210 is playing a sound source, the very long touch gesture recognized by the left earset or the right earset may be used for control to listen to an external sound together with the sound source. For example, hearing the external sound may be a function of outputting the peripheral sound input to the microphone 430 described above together with the audio of the sound source being reproduced from the speaker 420.

  FIG. 6 is a flowchart illustrating another example of the earset control method according to the embodiment of the present invention. The steps 610 to 640 included in the method of FIG. 6 may be performed by the computing device 100 in parallel with the steps 510 to 540 of FIG.

  In operation 610, the computing device 100 may recognize a touch gesture on the touch area of the second earset of the earset pair. In operation 510 of FIG. 5, the computer device 100 recognizes the touch gesture on the touch area of the first earset, but the computer device 100 also performs the touch gesture on the touch area of the second earset in parallel with the above operation. May be recognized.

  In step 620, the computing device 100 responds to the recognition of the first type of touch gesture with respect to the touch area of the second ear set, and the second type of touch gesture is set to the second ear set within a preset time. It may be confirmed whether the touch area is further recognized. As described above with reference to FIG. 5, the computer device 100 may further utilize the touch gesture recognized in the second earset as well as the first earset. For example, the first type of touch gesture may be a tap touch gesture, and the second type of touch gesture may be a hold touch gesture, but is not limited thereto.

  In operation 630, the computing device 100 may generate a third control signal for the first type of touch gesture recognized for the touch area of the second earset. As an example, the third control signal may include a second sound source control signal related to sound source control.

  In operation 640, the computing device 100 may generate a fourth control signal for the first type of touch gesture recognized for the touch area of the second earset. As an example, the fourth control signal may include a third volume control signal related to audio volume control.

  As described with reference to FIG. 5, when only the tap touch gesture is recognized in the touch area of the second earset, the computer apparatus 100 transmits a second sound source control signal (for example, music May be generated. If the hold touch gesture is recognized within a predetermined time after the tap touch gesture is recognized, a third volume control signal (for example, the audio volume level is reduced by 1 as a response to the recognition of the tap touch gesture). May be generated. In this case, the same tap touch gesture is used to generate one of the different control signals, such as end of music playback and volume reduction, depending on whether the additional hold touch gesture is recognized. Good. As described above, the types of touch gestures may be classified based on the times of touches that are continuously recognized in the touch area. A tap touch gesture may be recognized if a touch is released within less than one second after a touch occurs in the touch area, and a hold touch gesture may be less than three seconds after a touch occurs in the touch area The touch may be recognized when the touch is released within the time, and the very long touch gesture may be recognized when the touch is maintained for 5 seconds or more, as described in the corresponding embodiment.

  At this time, the computer apparatus 100 may further generate a fourth volume control signal for the recognized second type of touch gesture in operation 640. For example, the first volume control signal described with reference to FIG. 5 may include a signal for increasing an audio volume level by one level from a current level, and the second volume control signal may include an audio volume level. The signal may include a signal for gradually increasing the current level according to a touch time recognized by the second type of touch gesture. Conversely, the third volume control signal described with reference to FIG. 6 may include a signal for decreasing the audio volume level by one level from the current level, and the fourth volume control signal may include the audio volume level. A signal may be included for gradually decreasing the volume level from the current level according to a touch time recognized by the second type of touch gesture. As a more specific example, if the hold touch gesture is recognized within a preset time after the tap touch gesture is recognized in the second earset, the audio volume level is reduced by one level from the current level. In some cases, the audio volume level may be gradually reduced (for example, one level per 200 ms) according to the time at which a touch is recognized by maintaining the hold touch gesture.

  As described above, different ear sets of a pair of two ear sets may be implemented to perform different ear set controls even with the same touch gesture. For example, a tap touch gesture for the left earset is used to control the start of playback of a sound source (eg, music), and a same tap touch gesture for the right earset is used to control the end of playback of a sound source. May be. As another example, a tap touch gesture and a hold touch gesture for the left earset are used to control a decrease in audio volume, and a tap touch gesture and a hold touch gesture for the right earset control an increase in audio volume. May be used for As another example, the hold touch gesture for the right earset is used to control the invocation of an assistant for voice recognition, and the hold touch gesture for the left earset recognized during voice recognition is used for voice recognition. It may be used to control termination. As yet another example, the hold touch gesture for the left earset is used to control the invocation of the translation function, and the hold touch gesture for the right earset recognized during the provision of the translation function is used for the translation function being provided. May be used to control the termination of

  FIG. 7 is a flowchart illustrating an example of an earset control method for an earset according to an embodiment of the present invention. The earset control method according to the present embodiment may be executed by the above-described earset device 400, for example. For example, the control unit 410 of the earset device 400 is included in the method of FIG. 7 according to the control of an electronic circuit constituting the control unit 410 and / or a program embedded in a chipset included in the control unit 410. The earset device 400 may be controlled to perform steps 710 to 740.

  In operation 710, the earset device 400 may recognize a touch gesture on a touch area included in the earset device 400. For example, the earset device 400 may recognize a touch gesture on a touch area by a touch sensor 440 included in the earset device 400.

  In operation 720, the earset device 400 may respond to the recognition of the first type of touch gesture and determine whether the second type of touch gesture is further recognized within a preset time. At this time, if the second type of touch gesture is not recognized within the preset time, step 730 is performed. If the second type of touch gesture is recognized within the preset time, step 740 is performed. May be executed respectively. For example, the first type of touch gesture may be a tap touch gesture described above, and the second type of touch gesture may be a hold touch gesture, but is not limited thereto.

  In operation 730, the earset device 400 may generate a first control signal for the recognized first type of touch gesture. As an example, the first control signal may include a first sound source control signal related to sound source control. In the embodiment of FIG. 5, the first control signal is generated by the computer device 100 that realizes the electronic device 210 such as a smartphone, but in the embodiment of FIG. 7, the first control signal is generated by the earset device 400. And may be transmitted to the electronic device 210 via the communication unit 470 included in the earset device 400. For example, the electronic device 210 may control the currently reproduced sound source according to the first sound source control signal transmitted from the earset device 400.

  In operation 740, the earset device 400 may generate a second control signal for the recognized first type of touch gesture. As an example, the second control signal may include a first volume control signal related to audio volume control. In the embodiment of FIG. 5, the second control signal is generated by the computer device 100 that realizes the electronic device 210 such as a smartphone, but in the embodiment of FIG. 7, the second control signal is generated by the earset device 400. And may be transmitted to the electronic device 210 via the communication unit 470 included in the earset device 400. For example, the electronic device 210 may control the volume of the audio currently provided by the earset device 400 according to the first volume control signal transmitted from the earset device 400. As another embodiment, the earset device 400 may control the audio volume of the earset device 400 itself according to the generated first volume control signal.

  When only the tap touch gesture is recognized, the earset device 400 may generate a first sound source control signal (for example, a control signal for starting music playback) as a response to the recognition of the tap touch gesture. If the hold touch gesture is input within a predetermined time after the tap touch gesture is input, a first volume control signal (for example, the audio volume level is increased by 1 as a response to the recognition of the tap touch gesture). May be generated. In this case, the same tap touch gesture is used to generate one of the different control signals, such as music playback start and volume increase, depending on whether an additional hold touch gesture is input. Good. In this case, the type of the touch gesture may be classified based on the time of the touch continuously recognized in the touch area. The tap touch gesture is recognized when the touch is released within less than 1 second after the touch area is touched, and the hold touch gesture is the time less than 3 seconds after the touch area is touched. As described in the corresponding embodiment, it is recognized when the touch is released within a period, and the very long touch gesture is recognized when the touch is maintained for 5 seconds or more.

  In this case, the earset device 400 may further generate a second volume control signal for the recognized second type of touch gesture in operation 740. For example, the first volume control signal may include a signal for increasing or decreasing the audio volume level by one level from the current level, and the second volume control signal may include increasing the audio volume level by a second level from the current level. A signal for gradually increasing or decreasing according to the touch time recognized by the type of touch gesture may be included. As a more specific example, if the hold touch gesture is recognized within a preset time after the tap touch gesture is recognized, the audio volume level may be increased or decreased by one level from the current level, and The audio volume level may be gradually increased (for example, increased by one level per 200 ms) or decreased according to the time at which the touch is recognized by maintaining the touch gesture.

  On the other hand, different ear sets of a pair of two ear sets may be realized to perform different ear set controls even with the same touch gesture. For example, a tap touch gesture for the left earset is used to control the start of playback of a sound source (eg, music), and a same tap touch gesture for the right earset is used to control the end of playback of a sound source. May be. As another example, a tap touch gesture and a hold touch gesture for the left earset are used to control a decrease in audio volume, and a tap touch gesture and a hold touch gesture for the right earset control an increase in audio volume. May be used for As another example, the hold touch gesture for the right earset is used to control the invocation of an assistant for voice recognition, and the hold touch gesture for the left earset recognized during voice recognition is used for voice recognition. It may be used to control termination. As yet another example, the hold touch gesture for the left earset is used to control the invocation of the translation function, and the hold touch gesture for the right earset recognized during the provision of the translation function is used for the translation function being provided. May be used to control the termination of

  If the electronic device 210 is receiving a telephone call price, a tap touch gesture for the left earset or right earset may be used to control a call connection for the incoming telephone call, and a hold touch gesture may be used for receiving the telephone call. It may be used for controlling rejection of a telephone call. Also, when a call is being connected on the electronic device 210, two consecutive tap touch gestures on the left earset or the right earset may be used to control the end of the call during connection. As another example, when a sound source is being played, successive two or three tap touch gestures for the left earset or the right earset may be used for controlling the change of the sound source to be played.

  As still another embodiment, when the electronic device 210 is playing a sound source, the very long touch gesture recognized by the left earset or the right earset may be used for control to listen to an external sound together with the sound source. For example, hearing the external sound may be a function of outputting the peripheral sound input to the microphone 430 described above together with the audio of the sound source being reproduced from the speaker 420.

  The embodiment of FIG. 7 describes a case in which the first earset among the earset pairs is considered. In the case of the second earset, control signals (third and fourth control signals) different from the control signals (first and second control signals) of the first earset may be generated.

  FIG. 8 is a flowchart illustrating an example of an earset control method according to another embodiment of the present invention. The earset control method according to the present embodiment may be executed by, for example, the computer device 100 that implements the electronic device 210 described above. For example, the processor 120 of the computer device 100 may be implemented to execute a control instruction based on an operating system code and at least one program code included in the memory 110. Here, the processor 120 may control the computer device 100 such that the computer device 100 performs steps 810 to 850 included in the method of FIG. 8 according to control instructions provided by the code recorded in the computer device 100. . Here, the at least one program may be an application installed on the computer device 100 for controlling the earset.

  At step 810, the computing device 100 may transmit the audio signal to the first earset and the second earset. Here, the first earset and the second earset may correspond to the first earset device 220 and the second earset device 230 described above. The audio signal may include an audio signal from playing a sound source or an audio signal from a telephone call connection. At this time, it is assumed that both the first earset and the second earset are in a state worn by the user's ear.

  In step 820, the computing device 100 disconnects both the first earset and the second earset from the user's ear based on the output values of the proximity sensors included in the first earset and the second earset, respectively. You may decide whether you are. Here, the proximity sensor may correspond to the proximity sensor 450 described with reference to FIG. As described above, the proximity sensor 450 may be a component for sensing whether the earset device 400 is worn on the user's ear. For example, the proximity sensor 450 is disposed between the body of the earset device 400 and a portion inserted into the user's ear, thereby effectively determining whether the earset device 400 is worn on the user's ear. May be sensed. At this time, if both the first earset and the second earset have been removed from the user's ear, step 830 may be performed, and both the first earset and the second earset are set to the user's ear. If it has not been removed from the ear but has joined, step 810 may be repeated.

  At step 830, the computing device 100 may stop transmitting the audio signal. In other words, if either one of the first earset and the second earset has been removed from the user's ear, the user may listen to an external sound or speak with another person. It is highly probable that one earset has been out of the ear for a while, and that it does not mean explicit stop of sound source reproduction or stop of telephone call. On the other hand, if the user removes both of the earsets from their ears, it is likely that this is a manifestation of the explicit intention that they do not want to hear the audio signal now. Therefore, the computer device 100 may stop transmitting the audio signal when both the first earset and the second earset are removed from the user's ear. Stopping the transmission of the audio signal during the telephone call may mean switching from the telephone call using the earset to the telephone call using the computer device 100. Stopping transmission of an audio signal during playback of a sound source may mean stopping playback of the sound source or switching to playback of the sound source using the computer device 100.

  In step 840, the computer apparatus 100 determines whether at least one of the first earset and the second earset is based on a change in the output value of the proximity sensor included in each of the first earset and the second earset. You may determine whether it is associated with the ear. If at least one of the first earset and the second earset is coupled to the user's ear, step 810 may be performed and transmission of the stopped audio signal may be resumed. At step 840, if at least one of the first earset and the second earset is not coupled to the user's ear, computing device 100 may perform step 850.

  At step 850, the computing device 100 may determine whether a preset time has elapsed. Here, the passage of the preset time may mean that the preset time has elapsed from the point in time when both the first earset and the second earset have been removed from the user's ear. For example, the computer device 100 may record the time at which both the first earset and the second earset were removed from the user's ear in step 820, and record the current time in step 850. By comparing the set time, it may be determined whether or not a preset time has elapsed. In operation 850, when the preset time has elapsed, in other words, the first earset and / or the second earset have not been coupled to the user's ear for more than the preset time. In that case, the method of FIG. 8 may be terminated. If the preset time has not elapsed, the computer device 100 returns to step 840 to determine whether the first earset and / or the second earset is connected to the user's ear. You may monitor.

  Thus, that both the first earset and the second earset are disengaged from the user's ear and then the first earset and / or the second earset are re-coupled to the user's ear, It is likely that this is an indication that the user intends to resume using the earset that has been stopped for a while. Therefore, when at least one of the first earset and the second earset is coupled to the user's ear, the computer device 100 resumes the transmission of the audio signal that was stopped and used the earset. The output of the sound source or the connection of the telephone call may be continued. In addition, the first earset and / or the second earset are coupled to the user's ear until both the first earset and the second earset have been removed from the user's ear until a preset time has elapsed. If not, the output of the sound source or the connection of the telephone call may be terminated.

  In one embodiment, transmitting the audio signal in step 810 may include transmitting an audio signal of a currently playing sound source. In this case, stopping the transmission of the audio signal in step 830 may mean stopping the reproduction of the currently reproduced sound source and stopping the transmission of the audio signal. In some embodiments, stopping the transmission of the audio signal in step 830 may mean converting the reproduction of the sound source using the earset to the reproduction of the sound source using the computer device 100.

  In another embodiment, transmitting the audio signal in step 810 may mean transmitting an audio signal carried by a currently connected telephone call. In this case, stopping the transmission of the audio signal in step 830 may mean stopping the transmission of the audio signal transmitted by the currently connected telephone call. In some embodiments, stopping the transmission of the audio signal in step 830 may mean terminating the telephone call.

  FIG. 9 is a flowchart illustrating an example of an earset control method according to still another embodiment of the present invention. The earset control method according to the present embodiment may be executed by, for example, the computer device 100 that implements the electronic device 210 described above. For example, the processor 120 of the computer device 100 may be implemented to execute a control instruction based on an operating system code and at least one program code included in the memory 110. Here, the processor 120 controls the computer device 100 to perform steps 910 to 940 included in the method of FIG. 9 according to the control instructions provided by the code recorded in the computer device 100. Good. Here, the at least one program may be an application installed on the computer device 100 for controlling the earset.

  At step 910, the computing device 100 may record basic settings for the first earset and the second earset. Here, the first earset and the second earset may correspond to the first earset device 220 and the second earset device 230 described above. The basic setting value is not particularly limited, but may include, for example, a basic value for the audio volume. For example, the basic setting value for the audio volume expressed in the levels from 1 to 15 may be preset to 7, and the computer apparatus 100 may record and manage 7 as the preset basic setting value.

  At step 920, the computing device 100 may record the current settings of the first earset and the second earset. For example, the current setting may include a current value for the audio volume of the first earset and the second earset. When the current setting value is 10, the audio volume of the audio signal output from the first earset and the second earset may have a size corresponding to 10.

  In operation 930, the computing device 100 may recognize a touch gesture on the touch area of each of the first earset and the second earset. The recognition of the touch gesture may be processed using the touch sensor included in each of the first earset and the second earset, as described above. The sensing value recognized by the touch sensor of each of the first earset and the second earset is transmitted to the computer device by relaying the first earset and the second earset, respectively, or one of the first earset and the second earset. 100, and the computing device 100 may recognize a touch gesture for a touch area of each of the first earset and the second earset based on the transmitted sensing value.

  In operation 940, the computer apparatus 100 may determine whether the first gesture set and the second gesture set are continuously recognized within a predetermined time range. The current setting value of the second earset may be changed based on the basic setting value. For example, the preset touch gesture may be two consecutive tap touch gestures. At this time, the computer device 100 may change the current setting value to the basic setting value when two consecutive tap touch gestures are respectively recognized in two ear sets successively within a certain time range.

  With reference to FIGS. 5 and 6, the embodiment has been described in which the level of the audio volume is gradually increased or decreased according to the touch time of the hold touch gesture following the tap touch gesture. In this case, the user may be provided with a situation in which the audio volume is rapidly increased or decreased due to inexperienced user or operation error. A sudden increase in audio volume can be confusing to the user, and in some cases can cause abnormalities in the user's hearing. In order to solve such a situation, in the present embodiment, the computer device 100 performs the touch gesture preset for each of the first earset and the second earset continuously within a preset time range. If the audio volume is recognized as the basic setting value, the current setting value of the first earset and the second earset is changed based on the basic setting value, so that the audio volume can be quickly changed to the basic setting value. . As a more specific embodiment, the computer device 100 determines that a preset touch gesture is continuously recognized within a preset time range, and at the same time, the current setting value deviates from the preset value range. In this case, the current setting values of the first earset and the second earset may be changed based on the basic setting values. At this time, the preset value range may be determined based on at least one of the maximum value of the audio volume and the minimum value of the audio volume.

  The embodiment in which the audio volume is quickly changed to the basic setting value has been described above. However, in addition to the audio volume, the embodiment in FIG. 9 may be used to change various settings to the basic setting value. This can be easily understood from the above description.

  As described above, according to the embodiment of the present invention, various functions can be more easily controlled by a limited input interface included in the earset (for example, a touch interface of a touch sensor included in the earset). it can. For example, even for the same touch gesture, different control of the sound source control and the volume control can be performed according to the subsequent touch gesture. Further, it is possible to control the transmission of the audio signal according to the user's wearing condition of the earset. For example, when the user removes both of the earsets from the ear, the reproduction of the sound source may be automatically stopped, or the transmission of the audio signal for the telephone call may be stopped. Further, the set value of the ear set can be quickly returned to the basic set value. For example, in a situation where the audio volume level is manipulated, if the audio volume level suddenly becomes extremely high or the audio volume level suddenly becomes extremely low, the audio volume can be quickly increased by a simple touch operation by the user. It is possible to return to the basic level.

  The above-described system or apparatus may be realized by hardware components or a combination of hardware components and software components. For example, the devices and components described in the embodiments include, for example, a processor, a controller, an ALU (arithmetic logic unit), a digital signal processor, a microcomputer, a FPGA (field programmable gate array), a PLU (programmable logic unit), and a microcontroller. It may be implemented utilizing one or more general purpose or special purpose computers, such as a processor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also respond to the execution of the software, access the data, and record, manipulate, process, and generate the data. Although one processing device may be described as being used for convenience of understanding, those skilled in the art will appreciate that a processing device may include multiple processing elements and / or multiple types of processing elements. You can understand. For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations, such as a parallel processor, are also possible.

  The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to operate as desired, or instructing the processing unit independently or collectively. Or you can. The software and / or data may be embodied in any type of machine, component, physical device, virtual device, computer storage medium or device in order to be interpreted based on the processing device or to provide instructions or data to the processing device. May be changed. The software may be distributed on computer systems connected by a network and recorded or executed in a distributed manner. Software and data may be recorded on one or more computer-readable recording media.

  The method according to the embodiments may be implemented in the form of program instructions executable by various computer means and recorded on a computer-readable medium. A computer-readable medium may include program instructions, data files, data structures, etc., alone or in combination. The medium may continuously record a computer-executable program or may temporarily record the program for execution or download. Further, the medium may be a variety of recording means or storage means in the form of single or a plurality of pieces of hardware combined, and is not limited to a medium directly connected to a certain computer system, but may be distributed over a network. May exist. Examples of media include hard disks, floppy disks, and magnetic media, such as magnetic tape, optical media, such as CD-ROMs and DVDs, magneto-optical media, such as floppy disks, And a ROM, a RAM, a flash memory, and the like, and may be configured to record program instructions. Other examples of the medium include an application store that distributes an application, a recording medium or a storage medium that is managed by a site or a server that supplies or distributes various other software. Examples of program instructions include machine language code, such as that generated by a compiler, as well as high-level language code that is executed by a computer using an interpreter or the like.

  As described above, the embodiments have been described based on the limited embodiments and the drawings. However, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques may be performed in a different order than the described methods, and / or components, such as the described systems, structures, devices, circuits, etc., in different forms than the described methods. Appropriate results can be achieved even when combined or combined, or replaced or replaced by other components or equivalents.

  Therefore, even different embodiments belong to the appended claims as long as they are equivalent to the claims.

400: ear set device 410: control unit 420: speaker 430: microphone 440: touch sensor 450: proximity sensor 460: LED
470: Communication unit

Claims (21)

An earset control method,
Recognizing a touch gesture on the touch area of the first earset of the earset pair,
Responding to the recognition of the first type of touch gesture and confirming whether or not the second type of touch gesture is further recognized within a preset time; and the second type of gesture within the preset time If the touch gesture is not further recognized, a first control signal is generated for the recognized first type of touch gesture, and the second type of touch gesture is generated within the preset time. And generating a second control signal in response to the recognized first type of touch gesture, if the touch gesture is recognized. The first control signal includes a first sound source control signal related to sound source control,
The second control signal includes a first volume control signal related to audio volume control,
The earset control method according to claim 1. The step of generating the second control signal includes:
Generating a second volume control signal based on the recognition time of the further recognized second type of touch gesture;
The earset control method according to claim 2. The first volume control signal includes a signal for increasing or decreasing the audio volume level by one level from a current level,
The second volume control signal includes a signal for gradually increasing or decreasing an audio volume level from a current level according to a touch time recognized by the second type of touch gesture,
The earset control method according to claim 3. The first type of touch gesture and the second type of touch gesture are classified based on a time of a touch continuously recognized in the touch area,
The earset control method according to claim 1. Recognizing a touch gesture on a touch area of a second earset of the earset pair;
Responding to the recognition of the first type of touch gesture for the touch area of the second earset, and further recognizing the second type of touch gesture to the touch area of the second earset within a preset time. Confirming whether or not the touch gesture of the second type is further recognized with respect to the touch area of the second earset within the preset time. A third control signal is generated for a first type of touch gesture recognized for a touch area of the set, and the second type of touch gesture is touched by the second earset within the preset time. A touch gesture of the first type recognized for the touch area of the second earset if further recognized for the area; Generating a fourth control signal with respect to
The earset control method according to claim 1. The third control signal includes a second sound source control signal related to sound source control,
The fourth control signal includes a third volume control signal related to audio volume control,
The earset control method according to claim 6. The step of generating the fourth control signal includes:
If the second type of touch gesture is further recognized on the touch area of the second earset within the preset time, a fourth volume is applied to the further recognized second type of touch gesture. Generate further control signals,
An earset control method according to claim 7. The second control signal and the fourth control signal are signals for controlling an audio volume by different methods.
The earset control method according to claim 6. An earset control method,
Transmitting an audio signal to the first earset and the second earset;
It is determined whether both the first earset and the second earset have been removed from the user's ear based on the output values of the proximity sensors included in the first earset and the second earset, respectively. And a step of stopping transmission of the audio signal when it is determined that both the first earset and the second earset are off the user's ear. At least one of the first earset and the second earset is connected to the user's ear based on a change in the output value of the proximity sensor included in each of the first earset and the second earset. Determining if at least one of the first earset and the second earset is coupled to the user's ear. The method of claim 10, further comprising resuming transmission. Transmitting the audio signal,
Sends the audio signal of the currently playing sound source,
Stopping the transmission of the audio signal,
Stopping the reproduction of the currently reproduced sound source and stopping the transmission of the audio signal,
The earset control method according to claim 10. Transmitting the audio signal,
Sends audio signals carried by the currently connected telephone call,
Stopping the transmission of the audio signal,
Stopping transmission of audio signals carried by the currently connected telephone call;
The earset control method according to claim 10. An earset control method,
Recording basic settings for the first earset and the second earset;
Recording current settings of the first earset and the second earset;
Recognizing a touch gesture with respect to a touch area of each of the first ear set and the second ear set; and a touch gesture preset for each of the first ear set and the second ear set. And changing a current setting value of the first earset and the second earset based on the basic setting value when the recognition is continuously performed within a time range. The basic setting value includes a basic value for an audio volume of the first earset and the second earset,
The current setting value includes a current value for an audio volume of the first earset and the second earset.
An earset control method according to claim 14. The step of changing includes:
If the preset touch gesture is continuously recognized within a preset time range and the current setting value deviates from a preset value range, the first earset and the second Changing the current set value of the two-ear set based on the basic set value;
An earset control method according to claim 14.   A computer program which, when combined with a computer, causes the computer to perform the method according to any one of claims 1 to 16.   A computer-readable recording medium on which a computer program for causing a computer to execute the method according to any one of claims 1 to 16 is recorded. A computer device,
At least one processor implemented to execute the instructions readable by the computing device;
By the at least one processor,
Recognize a touch gesture on the touch area of the first earset of the earset pair,
Responding to the recognition of the first type of touch gesture, confirming whether or not the second type of touch gesture is further recognized within a preset time;
If the second type of touch gesture is not further recognized within the predetermined time, a first control signal is generated for the recognized first type of touch gesture, and the first control signal is generated. When the second type of touch gesture is further recognized within the set time, generating a second control signal for the recognized first type of touch gesture;
Computer device. A computer device,
At least one processor implemented to execute the instructions readable by the computing device;
By the at least one processor,
Sending an audio signal to a first earset and a second earset,
Based on the output values of the proximity sensors included in each of the first ear set and the second ear set, it is determined whether both the first ear set and the second ear set have been removed from the user's ear. ,
Stopping the transmission of the audio signal if it is determined that both the first earset and the second earset are off the user's ear;
Computer device. A computer device,
At least one processor implemented to execute the instructions readable by the computing device;
By the at least one processor,
Record the basic settings for the first earset and the second earset,
Recording the current settings of the first earset and the second earset,
Recognizing a touch gesture for a touch area of each of the first earset and the second earset,
If a preset touch gesture for each of the first earset and the second earset is continuously recognized within a preset time range, the first and second earsets may be displayed. Change the current setting value based on the basic setting value,
Computer device.