JP7114531B2 - Earset control method and system - Google Patents

Description

The following description includes an earset control method and system, and a computer program recorded on a computer-readable recording medium for causing a computer to execute the earset control method according to the embodiment of the present invention and its computer program. It relates to recording media.

An earset is a device equipped with an earphone and a microphone that allows you to talk without using your hands by connecting it to a phone. It receives and outputs various audio, and provides various control signals to the smartphone to control the smartphone by physical buttons, sensors, or voice. For example, US Pat. No. 5,300,000 discloses a Bluetooth® earset with an earkernel microphone built-in.

Korean Patent Publication No. 10-2017-0030375

Execute an earset control method that can more easily control various functions by a limited input interface included in the earset (for example, a touch interface of a touch sensor included in the earset) A computer device, a computer program recorded on a computer-readable recording medium for causing a computer to execute an earset control method, and the recording medium are provided.

An earset control method capable of controlling transmission of an audio signal according to a user's wearing state of the earset, a computer device for executing the earset control method, and a computer readable record for causing a computer to execute the earset control method A computer program recorded on a medium and the recording medium are provided.

Earset control method capable of quickly returning earset settings to basic settings, computer device for executing earset control method, recording on computer-readable recording medium for causing computer to execute earset control method A computer program and its recording medium are provided.

Recognizing a touch gesture on the touch area of the first earset of the earset pair, in response to recognizing the first type of touch gesture, further recognizing a second type of touch gesture within a preset time. and if the second type of touch gesture is not further recognized within the preset time, a first control signal for the recognized first type of touch gesture and, if the second type of touch gesture is further recognized within the preset time, generating a second control signal for the recognized first type of touch gesture. and an earset control method.

transmitting audio signals to a first earset and a second earset; determining whether both sets are unplugged from the user's ears; and if it is determined that both the first earset and the second earset are unplugged from the user's ears, the A method of controlling an earset is provided that includes stopping transmission of an audio signal.

recording default settings for a first earset and a second earset; recording current settings for the first earset and the second earset; and recording the current settings for the first earset and the second earset, respectively. and if the preset touch gestures for each of the first earset and the second earset are successively recognized within a preset time range, A method of controlling an earset includes changing current settings of the first earset and the second earset based on the base settings.

A computer program recorded on a computer-readable recording medium is provided for coupling with a computer to cause the computer to execute the earset control method.

A computer-readable recording medium storing a program for causing a computer to execute the earset control method is provided.

A computing device comprising at least one processor implemented to execute instructions readable by said computing device, wherein said at least one processor causes a touch on a touch area of a first earset of an earset pair to: recognizing a gesture; responding to recognition of a first type of touch gesture; checking whether a second type of touch gesture is further recognized within a preset time; generating a first control signal for the recognized touch gesture of the first type if the second type of touch gesture is not further recognized, and performing the second type of touch gesture within the preset time; A computing device is provided for generating a first control signal for the recognized touch gesture of the first type if a further touch gesture is recognized.

A computing device comprising at least one processor implemented to execute instructions readable by said computing device, said at least one processor transmitting audio signals to a first earset and a second earset. and whether or not both the first earset and the second earset are removed from the user's ear based on the output values of the proximity sensors included in the first earset and the second earset, respectively. determining and stopping transmission of the audio signal when it is determined that both the first earset and the second earset are removed from the user's ear.

A computing device comprising at least one processor implemented to execute instructions readable by said computing device, said at least one processor configured to set preferences for a first earset and a second earset. recording, recording current settings of the first earset and the second earset, recognizing touch gestures on respective touch areas of the first earset and the second earset, and When a touch gesture preset for each of the second earsets is continuously recognized within a preset time range, the current setting values of the first earset and the second earset are set to the basic To provide a computer device that changes based on a set value.

A limited input interface included in the earset (for example, the touch interface of the touch sensor included in the earset) allows for easier control of various functions. For example, even for the same touch gesture, different controls of sound source control and volume control are possible according to the subsequent touch gesture.

The transmission of the audio signal can be controlled according to the user's earset wearing condition. For example, when both ear sets are removed from the user's ears, it is possible to automatically stop playing a sound source or stop sending audio signals for a phone call.

The settings of the earset can be quickly returned to the basic settings. For example, in a situation where the audio volume is to be manipulated, if the audio volume suddenly increases or, on the contrary, the audio volume suddenly decreases, the user's simple touch operation will quickly reduce the audio volume to the basic level. It is possible to return.

1 is a block diagram illustrating an example of a computing device, in accordance with one embodiment of the present invention; FIG. FIG. 4 is a diagram showing an example of communication between an earset pair and an electronic device in one embodiment of the present invention; FIG. 11 illustrates another example of communication between an earset pair and an electronic device in one embodiment of the present invention; 4 is a flow chart showing an example of an earset control method in accordance with an embodiment of the present invention; 4 is a flow chart showing an example of an earset control method in accordance with an embodiment of the present invention; FIG. 4 is a flow chart showing another example of an earset control method according to an embodiment of the present invention; FIG. 4 is a flow chart showing an example of an earset control method by an earset in one embodiment of the present invention. FIG. 4 is a flow chart showing an example of an earset control method according to another embodiment of the present invention; FIG. 10 is a flow chart showing an example of an earset control method in accordance with yet another embodiment of the present invention;

Embodiments will be described in detail below with reference to the accompanying drawings.

An earset control method according to embodiments of the present invention may be implemented by a computer device as described below. At this time, a computer program according to an embodiment of the present invention may be installed and executed in the computer device, and the computer device executes the earset control method according to the embodiment of the present invention under the control of the executed computer program. may be executed. The computer program described above may be recorded on a computer-readable recording medium in order to combine with a computer device and cause the computer to execute the earset control method.

FIG. 1 is a block diagram illustrating an example of a computing device in one embodiment of the invention. The electronics and/or earset pairs described below may be implemented by the computing device 100 shown in FIG. 1, and the earset control method according to one embodiment is shown in FIG. may be performed by an electronic device and/or an earset pair implemented by the integrated computing device 100.

Such a computing device 100 may include memory 110, processor 120, communication interface 130, and input/output interface 140, as shown in FIG. The memory 110 is a computer-readable storage medium and may include random access memory (RAM), read only memory (ROM), and permanent mass storage devices such as disk drives. Here, a permanent mass storage device such as a ROM or disk drive may be included in computer device 100 as a separate permanent storage device separate from memory 110 . Also stored in memory 110 may be an operating system and at least one program code. Such software components may be loaded into memory 110 from a computer-readable medium separate from memory 110 . Such other computer-readable recording media may include computer-readable recording media such as floppy drives, disks, tapes, DVD/CD-ROM drives, memory cards, and the like. In other embodiments, software components may be loaded into memory 110 through communication interface 130 that is not a computer-readable medium. For example, software components may be loaded into memory 110 of computing device 100 based on computer programs installed by files received over network 160 .

Processor 120 may be configured to process computer program instructions by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to processor 120 by memory 110 or communication interface 130 . For example, processor 120 may be configured to execute received instructions according to program code stored in a storage device, such as memory 110 .

The communication interface 130 may provide a function for the computer device 100 to communicate with another electronic device (for example, the recording device described above) via the network 160 . As an example, processor 120 of computing device 100 can transmit requests, instructions, data, files, etc. generated according to program code recorded in a recording device such as memory 110 to other devices via network 160 under the control of communication interface 130 . may be transmitted to Conversely, signals, instructions, data, files, etc. from other devices may be received by computing device 100 through communication interface 130 of computing device 100 via network 160 . Signals, instructions, data, etc., received through communication interface 130 may be transmitted to processor 120 and memory 110, and files, etc., may be stored in a recording medium (permanent recording device described above) that computing device 100 may further include. may be recorded.

Input/output interface 140 may be a means for interfacing with input/output device 150 . For example, input devices may include devices such as a microphone, keyboard, or mouse, and output devices may include devices such as displays, speakers, and the like. As another example, the input/output interface 140 may be a means for interfacing with a device that integrates functions for input and output, such as a touch screen. Input/output device 150 may be one device with computing device 100 .

Also, in other embodiments, computing device 100 may include fewer or more components than the components of FIG. However, most prior art components need not be explicitly shown in the figures. For example, computing device 100 may be implemented to include at least some of the input/output devices 150 described above, and may also include other components such as transceivers, GPS (Global Positioning System), and the like. It's okay.

The communication method is not limited, and not only communication methods using communication networks that the network 160 can include (eg, mobile communication network, wired Internet, wireless Internet, broadcasting network), but also Bluetooth ( (registered trademark) and near field communication (NFC) may be included. For example, the network 160 includes a PAN (personal area network), a LAN (local area network), a CAN (campus area network), a MAN (metropolitan area network), a WAN (wide area network), a BBN (broadband network), and the Internet. Any one or more of the networks may be included. Additionally, network 160 may include any one or more of network topologies including, but not limited to, bus networks, star networks, ring networks, mesh networks, star-bus networks, tree or hierarchical networks, and the like. will not be

However, depending on the embodiment, at least one of the earset pairs may include different components than in FIG. For example, as described below with reference to FIG. 4, earset device 400 may be implemented to include components 410-470 of FIG.

FIG. 2 is a diagram illustrating an example of communication between an earset pair and an electronic device in one embodiment of the present invention. In general, smartphones use near-field wireless communication protocols such as Bluetooth®, Zigbee®, Wi-Fi, etc. to provide peripherals such as earset and wireless speakers. Communicate with equipment. The embodiment of FIG. 2 also describes an example in which electronic device 210 communicates with an earset pair using such a short-range wireless communication protocol. However, electronic device 210 can only communicate with one device at a time (first earset device 220 in the embodiment of FIG. 2) using one short-range wireless communication protocol (eg, Bluetooth 4.1). Sometimes. In other words, electronic device 210 may not be able to communicate with two or more devices simultaneously using one short-range wireless communication protocol. In this embodiment, the electronic device 210 may communicate with one device, the first earset device 220, using one short-range wireless communication protocol, and the second earset device 230 is the first earset device. Communication may be via relay with device 220 . Thus, the first earset device 220 and the second earset device 230 may perform short-range wireless communication with each other. For example, second earset device 230 may transmit audio input to a microphone included in second earset device 230 to electronic device 210 via first earset device 220 . Conversely, control signals sent from electronic device 210 may be sent through first earset device 220 to second earset device 230 . For such voice relay communication, for example, a TWS (True Wireless Stereo) system may be used.

FIG. 3 is a diagram showing another example of communication between an earset pair and an electronic device in one embodiment of the present invention. Unlike the embodiment of FIG. 2, electronic device 210 may simultaneously communicate with both first earset device 220 and second earset device 230 using one short-range wireless communication protocol. For example, short-range wireless communication protocols such as Bluetooth 5.0 provide technology that allows a smart phone to Bluetooth connect and communicate with two devices at the same time. The embodiment of FIG. 3 may thus simultaneously communicate with both first earset device 220 and second earset device 230 utilizing a short-range wireless communication protocol capable of communicating with multiple devices simultaneously.

FIG. 4 is a block diagram showing an example internal configuration of an earset device in one embodiment of the present invention. The earset device 400 according to this embodiment may correspond to the first earset device 220 and/or the second earset device 230 described with reference to FIGS. 2 and 3 above. Such an earset device 400 may comprise a control unit 410 , a speaker 420 , a microphone 430 , a touch sensor 440 , a proximity sensor 450 , an LED 460 and a communication unit 470 . Depending on the embodiment, earset device 400 may not include at least one of components 410-470 described with reference to FIG. 4 (eg LED 460) or other components (eg , an acceleration sensor, a gravity sensor, etc.).

Control unit 410 may be implemented in the form of an electronic circuit and/or chip set for controlling speaker 420 , microphone 430 , touch sensor 440 , proximity sensor 450 , LED 460 and communication unit 470 .

Speaker 420 may be a component for outputting an audio signal. For example, an audio signal transmitted by electronic device 210 may be output from speaker 420 of earset device 400 .

Microphone 430 may be a component for receiving input of ambient audio signals. For example, a user's voice command may be input into microphone 430 and transmitted to electronic device 210 via communication unit 470 .

Touch sensor 440 may be a component for receiving input of a user's touch commands. For example, controlling the earset device 400 and playing a sound source, stopping a sound source, calling an assistant according to various touch gestures recognized in a touch area provided outside the earset device 400 for the touch sensor 440 Various controls such as translation function invocation, volume control, etc. may be handled. For example, various touch gestures may be composed of touch gestures classified into tap, hold, very long, etc., and combinations thereof. Such touch gestures may be classified according to touch time, as an example. As a more specific example, a tap touch gesture may be recognized if the touch area is touched and then released within less than 1 second. A hold touch gesture may be recognized if the touch area is touched and released within a period of time less than a certain amount of time (eg, 3 seconds). A very long touch gesture may be recognized if the touch is maintained for more than a certain amount of time (eg, 5 seconds).

Proximity sensor 450 may be a component for sensing whether earset device 400 is worn on the user's ear. For example, by placing the proximity sensor 450 between the body of the earset device 400 and the portion that is inserted into the user's ear, it effectively senses whether the earset device 400 is worn on the user's ear. You can

A Light Emitting Diode (LED) 460 may be a component for providing various notifications regarding the earset device 400 . For example, the earset device 400 may provide various notifications to the user based on the color of light output from the LEDs 460, time of output, periodicity, and the like.

Communication portion 470 may be a component for communication with electronic device 210 or another earset device (eg, second earset device 230), as described above.

FIG. 5 is a flowchart illustrating an example earset control method in accordance with an embodiment of the present invention. The earset control method according to the present embodiment may be executed, as an example, by computer device 100 that implements electronic device 210 described above. For example, processor 120 of computing device 100 may be implemented to execute control instructions according to operating system code and at least one program code contained in memory 110 . Here, processor 120 may control computing device 100 to perform steps 510 to 540 included in the method of FIG. . Here, the at least one program mentioned above may be an application installed in the computer device 100 for controlling the earset.

At step 510, computing device 100 may recognize a touch gesture on the touch area of the first earset of the earset pair. As an example, the earset pair may correspond to the first earset device 220 and the second earset device 230 described with reference to FIGS. It may correspond to the set device 220 . Recognition of touch gestures may be handled using touch sensors included in the first earset, as described above. For example, sensing values recognized by the touch sensor of the first earset may be transmitted to the computing device 100, and the computing device 100 performs a touch gesture on the touch area of the first earset based on the transmitted sensing values. can recognize. In some embodiments, the first earset may recognize touch gestures based on sensing values recognized by the touch sensors and transmit information about the types of touch gestures recognized to computing device 100. Such touch gesture recognition may be applied in the same or similar manner in other embodiments described below.

At step 520, the computing device 100 may respond to the recognition of the first type of touch gesture and check whether the second type of touch gesture is further recognized within a preset time. At this time, step 530 is performed if the second type of touch gesture is not recognized within the preset time, and step 540 is performed if the second type of touch gesture is recognized within the preset time. may be performed respectively. For example, the first type of touch gesture may be the tap touch gesture described above, and the second type of touch gesture may be the hold touch gesture, but is not limited thereto.

At step 530, computing device 100 may generate a first control signal for the recognized first type of touch gesture. As an example, the first control signal may comprise a first sound source control signal associated with sound source control.

At step 540, computing device 100 may generate a second control signal for the recognized first type of touch gesture. As an example, the second control signal may include a first volume control signal associated with audio volume control.

For example, when only a tap touch gesture is recognized, the computer device 100 may generate a first sound source control signal (eg, a control signal for starting music playback) as a response to the recognition of the tap touch gesture. If the hold touch gesture is input within a certain period of time after the tap touch gesture is input, a first volume control signal (for example, increasing the level of the audio volume by 1 as a response to the recognition of the tap touch gesture) control signals) may be generated. In this case, the same tap touch gesture is used to generate one of different control signals, such as starting music playback and increasing volume, depending on whether an additional hold touch gesture is entered. may be In this case, the types of touch gestures may be classified based on the duration of touches continuously recognized in the touch area. A tap touch gesture is recognized if the touch area is touched and released within less than 1 second, and a hold touch gesture is recognized if the touch area is touched for less than 3 seconds. The very long touch gesture is recognized when the touch is released for 5 seconds or more, as described in the corresponding embodiment.

At this time, in step 540, the computing device 100 may further generate a second volume control signal for the further recognized second type of touch gesture. For example, the first volume control signal may include a signal to increase or decrease the audio volume level by one level from the current level, and the second volume control signal may increase or decrease the audio volume level from the current level by a second level. A signal may be included to incrementally increase or decrease depending on the touch duration perceived by the type of touch gesture. As a more specific example, if a hold touch gesture is recognized within a preset time after a tap touch gesture is recognized, the audio volume level may be increased or decreased by one level from the current level, and the hold Depending on how long the touch gesture is maintained and the touch is recognized, the audio volume level may be progressively increased (eg, increased by 1 level every 200 ms) or decreased.

On the other hand, different earsets of the two earset pairs may be implemented such that the same touch gestures may provide different earset controls. For example, a tap touch gesture on the left earset can be used to control the start of playing a sound source (eg, music), and the same tap touch gesture on the right earset can be used to control the end of playing the sound source. you can As another example, tap-touch and hold-touch gestures on the left earset are utilized to control audio volume decrease, and tap-touch and hold-touch gestures on the right earset control audio volume increase. may be used for As another example, a hold touch gesture on the right earset is used to control the call of an assistant for voice recognition, and a hold touch gesture on the left earset that is recognized during voice recognition is used for voice recognition. May be used to control termination. As yet another example, a hold touch gesture on the left earset is utilized to control the invocation of the translation function, and a hold touch gesture on the right earset that is recognized while the translation function is being served is used to control the translation function being served. may be used to control the termination of the

When a phone quote is being received on electronic device 210, a tap touch gesture on the left earset or right earset may be utilized to control the call connection for the incoming phone call, and a hold touch gesture may be used to receive the call. It may also be used for call rejection control for medium calls. Also, when a call is connected on the electronic device 210, a consecutive double tap touch gesture on either the left earset or the right earset may be used to control the end of the call during the connection. As yet another example, when a sound source is playing, consecutive double or triple tap touch gestures on the left earset or the right earset may be used to control changing the sound source to play.

As yet another embodiment, when the electronic device 210 is playing a sound source, a very long touch gesture recognized on the left earset or the right earset may be used to control listening to external sounds along with the sound source. For example, listening to an external sound may be a function of outputting the ambient sound input to the microphone 430 described above from the speaker 420 together with the audio of the sound source being reproduced.

FIG. 6 is a flowchart illustrating another example of an earset control method in accordance with one embodiment of the present invention. Steps 610-640 included in the method of FIG. 6 may be performed by computing device 100 in parallel with steps 510-540 of FIG.

At step 610, computing device 100 may recognize a touch gesture on the touch area of the second earset of the earset pair. In step 510 of FIG. 5, the computing device 100 recognizes a touch gesture on the touch area of the first earset, and in parallel with such actions, the computing device 100 also recognizes the touch gesture on the touch area of the second earset. can recognize.

At step 620, the computing device 100 responds to the recognition of the first type of touch gesture on the touch area of the second earset, and the second type of touch gesture is detected on the second earset within a preset time. It may be checked whether the touch area is still recognized. As described above with reference to FIG. 5, computing device 100 may further take advantage of touch gestures recognized on the second earset as well as the first earset. For example, the first type of touch gesture may be a tap touch gesture and the second type of touch gesture may be a hold touch gesture, but is not limited thereto.

At step 630, computing device 100 may generate a third control signal for the first type of touch gesture recognized on the touch area of the second earset. As an example, the third control signal may include a second sound source control signal related to sound source control.

At step 640, computing device 100 may generate a fourth control signal for the first type of touch gesture recognized on the touch area of the second earset. As an example, the fourth control signal may include a third volume control signal associated with audio volume control.

As in the description of FIG. 5, when only the tap touch gesture is recognized in the touch area of the second earset, the computer device 100 outputs the second sound source control signal (for example, music) as a response to the recognition of the tap touch gesture. may generate a control signal for terminating the reproduction of the If the hold touch gesture is recognized within a certain amount of time after the tap touch gesture is recognized, a third volume control signal (for example, decrease the level of the audio volume by 1) is sent in response to the recognition of the tap touch gesture. control signals) may be generated. In this case, the same tap touch gesture is additionally used to generate one of different control signals, such as ending music playback and decreasing volume, depending on whether a hold touch gesture is recognized. good. As described above, the types of touch gestures may be classified based on the duration of consecutively recognized touches in the touch area. A tap touch gesture may be recognized if the touch area is touched and released within less than 1 second, and a hold touch gesture is recognized if the touch area is touched for less than 3 seconds. , and a very long touch gesture may be recognized if the touch is maintained for 5 seconds or more, as described in the corresponding embodiment.

At this time, in step 640, the computing device 100 may further generate a fourth volume control signal for the further recognized second type of touch gesture. For example, the first volume control signal described with reference to FIG. 5 may include a signal to increase the audio volume level by one level from the current level, and the second volume control signal increases the audio volume level by A signal may be included to incrementally increase from the current level according to the touch duration recognized by the second type of touch gesture. Conversely, the third volume control signal described with reference to FIG. 6 may include a signal to decrease the audio volume level by one level from the current level, and the fourth volume control signal may include a signal to decrease the audio volume level by one level. A signal may be included to progressively decrease the volume level from the current level in accordance with the touch time recognized by the second type of touch gesture. As a more specific example, if the hold touch gesture is recognized within a preset time after the tap touch gesture is recognized on the second earset, the audio volume level is decreased by one level from the current level. Well, depending on how long the touch is recognized by maintaining the hold touch gesture, the audio volume level may be progressively decreased (eg, by 1 level every 200 ms).

As noted above, different earsets of two earset pairs may be implemented to provide different earset controls for the same touch gestures. For example, a tap touch gesture on the left earset can be used to control the start of playing a sound source (eg, music), and the same tap touch gesture on the right earset can be used to control the end of playing the sound source. you can As another example, tap-touch and hold-touch gestures on the left earset are utilized to control audio volume decrease, and tap-touch and hold-touch gestures on the right earset control audio volume increase. may be used for As another example, a hold touch gesture on the right earset is used to control the call of an assistant for voice recognition, and a hold touch gesture on the left earset that is recognized during voice recognition is used for voice recognition. May be used to control termination. As yet another example, a hold touch gesture on the left earset may be utilized to control invocation of the translation function, and a hold touch gesture on the right earset recognized during translation function provisioning may be used to control the translation function being provided. may be used to control the termination of the

FIG. 7 is a flowchart illustrating an exemplary earset control method for an earset in accordance with one embodiment of the present invention. The earset control method according to the present embodiment may be executed by the earset device 400 described above, as an example. For example, controller 410 of earset device 400 may be included in the method of FIG. The earset device 400 may be controlled to perform steps 710-740.

At step 710 , earset device 400 may recognize touch gestures on touch areas included in earset device 400 . For example, earset device 400 may recognize touch gestures on the touch area by touch sensor 440 included in earset device 400 .

At step 720, the earset device 400 may respond to the recognition of the first type of touch gesture and check whether the second type of touch gesture is also recognized within a preset time. At this time, step 730 is performed if the second type of touch gesture is not recognized within the preset time, and step 740 is performed if the second type of touch gesture is recognized within the preset time. may be performed, respectively. For example, the first type of touch gesture may be the tap touch gesture described above, and the second type of touch gesture may be the hold touch gesture, but is not limited thereto.

At step 730, earset device 400 may generate a first control signal for the recognized first type of touch gesture. As an example, the first control signal may comprise a first sound source control signal associated with sound source control. While in the embodiment of FIG. 5 the first control signal was generated by the computing device 100 implementing the electronic device 210, such as a smart phone, in the embodiment of FIG. 7 the first control signal is generated by the earset device 400. and may be transmitted to electronic device 210 via communication unit 470 included in earset device 400 . For example, electronic device 210 may control the sound source currently being played according to the first sound source control signal transmitted from earset device 400 .

At step 740, earset device 400 may generate a second control signal in response to the recognized first type of touch gesture. As an example, the second control signal may include a first volume control signal associated with audio volume control. While in the embodiment of FIG. 5 the second control signal was generated by the computing device 100 implementing the electronic device 210, such as a smart phone, in the embodiment of FIG. 7 the second control signal is generated by the earset device 400. and may be transmitted to electronic device 210 via communication unit 470 included in earset device 400 . For example, electronic device 210 may control the volume of audio currently being provided on earset device 400 according to a first volume control signal transmitted from earset device 400 . Other embodiments may contemplate earset device 400 controlling its own audio volume according to the generated first volume control signal.

If only a tap touch gesture is recognized, earset device 400 may generate a first sound source control signal (eg, a control signal to start playing music) in response to recognition of the tap touch gesture. If the hold touch gesture is input within a certain period of time after the tap touch gesture is input, a first volume control signal (for example, increasing the level of the audio volume by 1 as a response to the recognition of the tap touch gesture) control signals) may be generated. In this case, the same tap touch gesture is used to generate one of different control signals, such as starting music playback and increasing volume, depending on whether an additional hold touch gesture is entered. good. In this case, the types of touch gestures may be classified based on the duration of touches continuously recognized in the touch area. A tap touch gesture is recognized if the touch area is touched and released within less than 1 second, and a hold touch gesture is recognized if the touch area is touched for less than 3 seconds. The very long touch gesture is recognized when the touch is released for 5 seconds or more, as described in the corresponding embodiment.

At this time, the earset device 400 may further generate a second volume control signal for the further recognized second type of touch gesture in step 740 . For example, the first volume control signal may include a signal to increase or decrease the audio volume level by one level from the current level, and the second volume control signal may increase or decrease the audio volume level from the current level by a second level. A signal may be included to incrementally increase or decrease depending on the touch duration perceived by the type of touch gesture. As a more specific example, if a hold touch gesture is recognized within a preset time after a tap touch gesture is recognized, the audio volume level may be increased or decreased by one level from the current level, and the hold The audio volume level may be progressively increased (eg, incremented by 1 level every 200ms) or decreased depending on how long the touch gesture is perceived for holding the touch gesture.

On the other hand, different earsets of the two earset pairs may be implemented such that the same touch gestures may provide different earset controls. For example, a tap touch gesture on the left earset can be used to control the start of playing a sound source (eg, music), and the same tap touch gesture on the right earset can be used to control the end of playing the sound source. you can As another example, tap-touch and hold-touch gestures on the left earset are utilized to control audio volume decrease, and tap-touch and hold-touch gestures on the right earset control audio volume increase. may be used for As another example, a hold touch gesture on the right earset is used to control the call of an assistant for voice recognition, and a hold touch gesture on the left earset that is recognized during voice recognition is used for voice recognition. May be used to control termination. As yet another example, a hold touch gesture on the left earset may be utilized to control invocation of the translation function, and a hold touch gesture on the right earset recognized during translation function provisioning may be used to control the translation function being provided. may be used to control the termination of the

When a phone quote is being received on electronic device 210, a tap touch gesture on the left earset or right earset may be utilized to control the call connection for the incoming phone call, and a hold touch gesture may be used to control the call connection for the incoming phone call. It may also be used for call rejection control for telephone calls. Also, when a call is ongoing on the electronic device 210, a consecutive double tap touch gesture on either the left earset or the right earset may be used to control the end of the ongoing call. As yet another example, when a sound source is playing, a consecutive double or triple tap touch gesture on the left earset or right earset may be used to control changing the sound source being played.

As yet another embodiment, when the electronic device 210 is playing a sound source, a very long touch gesture recognized on the left earset or the right earset may be used to control listening to external sounds along with the sound source. For example, listening to an external sound may be a function of outputting the ambient sound input to the microphone 430 described above from the speaker 420 together with the audio of the sound source being reproduced.

The embodiment of FIG. 7 describes the case in which the first earset of the earset pair is considered. In the case of the second earset, control signals (third and fourth control signals) different from those of the first earset (first and second control signals) may be generated.

FIG. 8 is a flowchart illustrating an exemplary earset control method in accordance with another embodiment of the present invention. The earset control method according to the present embodiment may be executed, as an example, by computer device 100 that implements electronic device 210 described above. For example, processor 120 of computing device 100 may be implemented to execute control instructions according to operating system code and at least one program code contained in memory 110 . Here, processor 120 may control computing device 100 to perform steps 810 to 850 included in the method of FIG. 8 according to control instructions provided by code recorded in computing device 100. . Here, the at least one program mentioned above may be an application installed in the computer device 100 for controlling the earset.

At step 810, computing device 100 may transmit audio signals to the first earset and the second earset. Here, the first earset and the second earset may correspond to the first earset device 220 and the second earset device 230 described above. The audio signal may include an audio signal from the reproduction of a sound source or an audio signal from a telephone call connection. At this time, it is assumed that both the first earset and the second earset are worn on the user's ears.

At step 820, computing device 100 determines whether both the first earset and the second earset are removed from the user's ear based on the output values of the proximity sensors included in each of the first earset and the second earset. You may decide whether Here, the proximity sensor may correspond to the proximity sensor 450 described with reference to FIG. As noted above, proximity sensor 450 may be a component for sensing whether earset device 400 is worn on the user's ear. For example, the proximity sensor 450 may be positioned between the body of the earset device 400 and the portion that is inserted into the user's ear, thereby effectively detecting whether the earset device 400 is being worn on the user's ear. you can perceive. At this time, step 830 may be performed if both the first earset and the second earset are removed from the user's ear, and both the first earset and the second earset are removed from the user's ear. Step 810 may be performed repeatedly if the ear is not detached and is docked.

At step 830, computing device 100 may stop transmitting audio signals. In other words, if either one of the first earset and the second earset is detached from the user's ear, then the user can hear external sounds or converse with others using one earset. There is a high probability that this is the case when one earset is removed from the ear for a while, and a high probability that it does not mean an explicit stop of the sound source reproduction or the stop of the phone call. On the other hand, if the user has both ear-sets out of their ears, this is likely an explicit indication that they do not wish to hear the audio signal at this time. Accordingly, computing device 100 may stop transmitting audio signals when both the first earset and the second earset are removed from the user's ears. Stopping transmission of audio signals during a phone call may mean switching from a phone call using the earset to a phone call using computer device 100 . Also, stopping the transmission of the audio signal during reproduction of the sound source may mean stopping reproduction of the sound source or switching to reproduction of the sound source using the computer device 100 .

At step 840, the computer device 100 determines whether at least one of the first earset and the second earset is the user's earset based on the change in the output value of the proximity sensor included in each of the first earset and the second earset. It may be determined whether or not it is attached to the ear. If at least one of the first earset and the second earset is coupled with the user's ear, step 810 may be performed and the suspended audio signal transmission may be resumed. At step 840 , if at least one of the first earset and the second earset is not coupled with the user's ear, computing device 100 may perform step 850 .

At step 850, computing device 100 may determine whether a preset amount of time has elapsed. Here, the lapse of a preset time may mean that a preset time has passed since both the first earset and the second earset were removed from the user's ear. For example, the computing device 100 may record the time when both the first earset and the second earset are removed from the user's ear at step 820, and record the current time at step 850. By comparing the set time, it may be determined whether the preset time has elapsed. Computing device 100 determines at step 850 if the preset time has elapsed, in other words, the first earset and/or the second earset have not been coupled to the user's ear for more than the preset time. If so, the method of FIG. 8 may end. Also, if the preset time has not elapsed, the computing device 100 returns to step 840 to determine whether the first earset and/or the second earset are coupled with the user's ear. may be monitored.

Thus, both the first earset and the second earset are removed from the user's ear, and then the first earset and/or the second earset are recoupled to the user's ear. It is highly likely that the user intends to resume using the earset after stopping for a while. Therefore, when at least one of the first earset and the second earset is coupled to the user's ear, the computer device 100 resumes the stopped transmission of the audio signal and the earset is used. You may continue to output the sound source or connect the phone call. Also, the first earset and/or the second earset are coupled to the user's ear until a preset time has passed since both the first earset and the second earset are removed from the user's ear. If not, you may terminate the output of the sound source or the connection of the telephone call.

As an embodiment, transmitting the audio signal in step 810 may mean transmitting the audio signal of the sound source currently being played. In this case, stopping the transmission of the audio signal in step 830 may mean stopping the reproduction of the sound source currently being played to stop the transmission of the audio signal. In some embodiments, stopping transmission of the audio signal in step 830 may mean converting the reproduction of the sound source using the earset to the reproduction of the sound source using the computing device 100 .

As another embodiment, transmitting the audio signal in step 810 may mean transmitting the audio signal carried by the currently connected telephone call. In this case, stopping transmission of audio signals in step 830 may mean stopping transmission of audio signals carried by the currently connected telephone call. Depending on the embodiment, stopping transmission of the audio signal in step 830 may mean ending the phone call.

FIG. 9 is a flowchart illustrating an exemplary earset control method according to yet another embodiment of the present invention. The earset control method according to the present embodiment may be executed, as an example, by computer device 100 that implements electronic device 210 described above. For example, processor 120 of computing device 100 may be implemented to execute control instructions according to operating system code and at least one program code contained in memory 110 . Here, processor 120 controls computer device 100 to perform steps 910 to 940 included in the method of FIG. 9 according to control instructions provided by the code recorded in computer device 100. good. Here, the at least one program mentioned above may be an application installed in the computer device 100 for controlling the earset.

At step 910, computing device 100 may record the preferences for the first and second earsets. Here, the first earset and the second earset may correspond to the first earset device 220 and the second earset device 230 described above. The basic setting value may include, but is not limited to, a basic value for audio volume, as an example. For example, a basic setting value for audio volume expressed in levels of 1 to 15 may be preset to 7, and the computer device 100 may record and manage 7 as the preset basic setting value.

At step 920, computing device 100 may record the current settings for the first and second earsets. For example, the current settings may include current values for the audio volume of the first earset and the second earset. If the current setting value is ten, the audio volume of the audio signals output from the first earset and the second earset may have a magnitude corresponding to ten.

At step 930, computing device 100 may recognize touch gestures on the touch areas of the first earset and the second earset, respectively. Recognition of touch gestures may be handled using touch sensors included in each of the first and second earsets, as described above. The sensing values recognized by the touch sensors of each of the first earset and the second earset are relayed by one of each of the first earset and second earset or the first earset and second earset to the computing device. 100, and the computing device 100 may recognize touch gestures on the touch areas of the first earset and the second earset, respectively, based on the transmitted sensing values.

At step 940, the computing device 100 selects the first earset and the second earset when the preset touch gestures for each of the first earset and the second earset are continuously recognized within the preset time range. The current settings for the second earset may be changed based on the base settings. For example, the preset touch gesture may be two consecutive tap touch gestures. At this time, the computing device 100 may change the current setting value to the basic setting value when two consecutive tap touch gestures are recognized respectively by two earsets consecutively within a certain time range.

Embodiments that progressively increase or decrease the level of audio volume according to the touch duration of a tap touch gesture followed by a hold touch gesture have been described with reference to FIGS. 5 and 6 . In this case, the user may be presented with a situation in which the audio volume suddenly increases or decreases due to the user's inexperienced operation or operational error. A sudden increase in audio volume can confuse the user and, in some cases, cause the user's hearing to be abnormal. In order to solve such a situation, in the present embodiment, the computer device 100 makes it possible for the touch gesture preset for each of the first earset and the second earset to continue within a preset time range. is recognized, the current setting values of the first earset and the second earset are changed based on the basic setting value, thereby controlling the audio volume to quickly change to the basic setting value. . As a more specific embodiment, the computer device 100 detects that a preset touch gesture is continuously recognized within a preset time range, and at the same time, the current setting value deviates from the preset value range. If so, the current settings for the first and second earsets may be changed based on the default settings. At this time, the preset value range may be determined based on at least one of a maximum audio volume value and a minimum audio volume value.

In the above, the embodiment of quickly changing the audio volume to the basic setting value has been described, but the embodiment of FIG. 9 may be used to change various settings other than the audio volume to the basic setting value. This can be easily understood from the above explanation.

Thus, according to embodiments of the present invention, a limited input interface included in the earset (eg, a touch interface of a touch sensor included in the earset) can more easily control various functions. can. For example, even for the same touch gesture, different control of sound source control and volume control can be performed according to subsequent touch gestures. In addition, it is possible to control the transmission of the audio signal according to the wearing condition of the earset by the user. For example, if the user removes both earset from the ear, it may automatically stop playing the sound source or stop sending the audio signal for the phone call. In addition, the earset settings can be quickly returned to the basic settings. For example, in the situation of manipulating the audio volume level, if the audio volume level suddenly becomes very high or, conversely, the audio volume level suddenly becomes very low, the user can quickly adjust the audio volume by a simple touch operation. It is possible to return to the basic level.

The systems or devices described above may be realized by hardware components or a combination of hardware and software components. For example, the devices and components described in the embodiments may include, for example, processors, controllers, ALUs (arithmetic logic units), digital signal processors, microcomputers, FPGAs (field programmable gate arrays), PLUs (programmable logic units), microcontrollers, It may be implemented using one or more general purpose or special purpose computers, such as a processor or various devices capable of executing instructions and responding. The processing unit may run an operating system (OS) and one or more software applications that run on the OS. The processor may also access, record, manipulate, process, and generate data in response to executing software. For convenience of understanding, one processing device may be described as being used, but those skilled in the art will appreciate that a processing device may include multiple processing elements and/or multiple types of processing elements. You can understand. For example, a processing unit may include multiple processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

Software may include computer programs, code, instructions, or a combination of one or more of these, to configure a processor to operate at its discretion or to independently or collectively instruct a processor. You can Software and/or data may be embodied in any kind of machine, component, physical device, virtual device, computer storage medium or device for interpretation on or for providing instructions or data to a processing device. may be changed. The software may be stored and executed in a distributed fashion over computer systems linked by a network. Software and data may be recorded on one or more computer-readable recording media.

The method according to the embodiments may be embodied in the form of program instructions executable by various computer means and recorded on a computer-readable medium. The computer-readable media may include program instructions, data files, data structures, etc. singly or in combination. The medium may be a continuous recording of the computer-executable program or a temporary recording for execution or download. In addition, the medium may be various recording means or storage means in the form of a combination of single or multiple hardware, and is not limited to a medium that is directly connected to a computer system, but is distributed over a network. It may exist in Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROM, RAM, flash memory, etc., and may be configured to store program instructions. Other examples of media include recording media or storage media managed by application stores that distribute applications, sites that supply or distribute various software, and servers. Examples of program instructions include machine language code, such as that generated by a compiler, as well as high-level language code that is executed by a computer, such as using an interpreter.

As described above, the embodiments have been described based on the limited embodiments and drawings, but those skilled in the art will be able to make various modifications and variations based on the above description. For example, the techniques described may be performed in a different order than in the manner described and/or components such as systems, structures, devices, circuits, etc. described may be performed in a manner different from the manner described. Any combination or combination, substitution or replacement by other elements or equivalents may achieve suitable results.

Therefore, different embodiments that are equivalent to the claims are covered by the appended claims.

400: Earset device 410: Control unit 420: Speaker 430: Microphone 440: Touch sensor 450: Proximity sensor 460: LED
470: communication unit

Claims (17)

An earset control method comprising:
Recognizing a touch gesture on the touch area of the first earset with the touch sensor of the first earset of an earset pair having a first earset and a second earset;
responsive to the recognition of a first type of touch gesture and checking whether a second type of touch gesture different from the first type of touch gesture is further recognized within a preset time; and generating a first control signal for the recognized touch gesture of the first type if the second type of touch gesture is not further recognized within the predetermined time; a second control signal for the recognized first type touch gesture, only the second type touch gesture is recognized, if the second type of touch gesture is further recognized within the second type of touch gesture. generating a second control signal different from the third control signal generated for the case
recording basic settings for the first earset and the second earset;
recording the current settings of the first earset and the second earset;
recognizing touch gestures by the touch area of the first earset and the touch sensor of the second earset to each of the touch areas of the second earset; and
When touch gestures preset for each of the first earset and the second earset are continuously recognized within a preset time range, the first earset and the second earset changing the current setting value based on the basic setting value;
including
the base settings include base values for audio volume of the first earset and the second earset;
the current settings include current values for audio volume of the first earset and the second earset;
The modifying step includes:
The preset touch gesture is continuously recognized within a preset time range, and the current setting value is based on at least one of a maximum audio volume value and a minimum audio volume value. and changing the current setting values of the first earset and the second earset based on the basic setting values when the values deviate from a preset value range determined by the method. the first control signal includes a first sound source control signal associated with sound source control;
said second control signal comprises a first volume control signal associated with audio volume control;
The earset control method according to claim 1. Generating the second control signal includes:
further generating a second volume control signal according to the recognition time of the further recognized second type of touch gesture;
The earset control method according to claim 2. the first volume control signal includes a signal for increasing or decreasing the audio volume level by one level from the current level;
The second volume control signal includes a signal for gradually increasing or decreasing an audio volume level from a current level according to touch time recognized by the second type of touch gesture.
The earset control method according to claim 3. The first type of touch gesture and the second type of touch gesture are classified based on the time of continuously recognized touches in the touch area.
The earset control method according to claim 1. recognizing a touch gesture on the touch area of the second earset of the earset pair;
in response to recognizing the first type of touch gesture on the touch area of the second earset, and performing the second type of touch gesture on the touch area of the second earset within a preset time. checking whether the second type of touch gesture is further recognized; and if the second type of touch gesture is not further recognized on the touch area of the second earset within the preset time, the first generating a fourth control signal for the first type of touch gesture recognized on the touch area of two earsets, wherein the second type of touch gesture is performed on the second ear within the preset time; generating a fifth control signal for the first type of touch gesture recognized for the touch area of the second earset, if further recognized for the touch area of the set. ,
The earset control method according to claim 1. the fourth control signal includes a second sound source control signal related to sound source control;
the fifth control signal includes a third volume control signal for audio volume control;
The earset control method according to claim 6. The step of generating the fifth control signal includes:
if the second type of touch gesture is further recognized on the touch area of the second earset within the preset time, a fourth volume for the further recognized second type of touch gesture further generating a control signal,
The earset control method according to claim 7. The second control signal and the fifth control signal are signals for controlling the audio volume by different methods,
The earset control method according to claim 6. The earset control method further comprises:
transmitting audio signals to the first earset and the second earset;
determining whether both the first earset and the second earset are removed from the user's ear based on output values of proximity sensors included in each of the first earset and the second earset; and ceasing transmission of the audio signal if it is determined that both the first earset and the second earset are removed from the user's ear. An earset control method according to any one of the preceding items. At least one of the first earset and the second earset couples with the user's ear based on a change in the output value of the proximity sensor included in each of the first earset and the second earset. and if it is determined that at least one of the first earset and the second earset is coupled with the user's ear, the muted audio signal. 11. The earset control method of claim 10, further comprising: resuming transmission of . The step of transmitting the audio signal comprises:
Sends the audio signal of the sound source currently playing,
Stopping transmission of the audio signal comprises:
stopping the transmission of the audio signal by stopping playing the currently playing sound source;
The earset control method according to claim 10. The step of transmitting the audio signal comprises:
transmit the audio signal carried by the currently connected telephone call;
Stopping transmission of the audio signal comprises:
ceasing transmission of audio signals carried by the currently connected telephone call;
The earset control method according to claim 10. A computer program which, in combination with a computer, causes the computer to perform the method according to any one of claims 1 to 13 . A computer-readable recording medium storing a computer program for causing a computer to execute the method according to any one of claims 1 to 13 . A computer device,
at least one processor implemented to execute instructions readable by said computing device;
by the at least one processor;
recognizing a touch gesture on a touch area of the first earset by the touch sensor of the first earset of an earset pair having a first earset and a second earset;
responsive to recognition of a first type of touch gesture and checking whether a second type of touch gesture different from the first type of touch gesture is further recognized within a preset time;
generating a first control signal for the recognized first type touch gesture if the second type of touch gesture is not further recognized within the preset time; if the second type of touch gesture is further recognized within the time period, a second control signal for the recognized first type of touch gesture, wherein only the second type of touch gesture is generating a second control signal different from the third control signal generated for the recognized case ;
recording base settings for the first earset and the second earset;
recording the current settings of the first earset and the second earset;
recognizing a touch gesture on the touch area of the second earset by the touch area of the first earset and the touch sensor of the second earset, respectively;
When touch gestures preset for each of the first earset and the second earset are continuously recognized within a preset time range, the first earset and the second earset changing the current set value based on the basic set value;
the base settings include base values for audio volume of the first earset and the second earset;
the current settings include current values for audio volume of the first earset and the second earset;
Changing the current settings of the first earset and the second earset based on the base settings includes:
The preset touch gesture is continuously recognized within a preset time range, and the current setting value is based on at least one of a maximum audio volume value and a minimum audio volume value. changing the current setting values of the first earset and the second earset based on the base setting values if the current setting values of the first earset and the second earset deviate from a preset value range determined by
computer equipment. by the at least one processor;
transmitting an audio signal to the first earset and the second earset;
determining whether both the first earset and the second earset are removed from the user's ear based on output values of proximity sensors included in the first earset and the second earset, respectively; ,
ceasing transmission of the audio signal if it is determined that both the first earset and the second earset are removed from the user's ear;
17. A computer device as claimed in claim 16 .

Images