WO2022134910A1 - Terminal, terminal control method and apparatus, and storage medium - Google Patents

Abstract

Provided are a terminal, a terminal control method and apparatus, and a storage medium, which relate to the technical field of terminals. The terminal comprises a positioning component, an electric motor control component and an audio processing component, wherein the positioning component is used for determining related information of a target object, the related information comprising a contour shape of the target object and/or a location relationship between the target object and the terminal, the electric motor control component is used for controlling the rotation of the audio processing component on the basis of the related information, and the audio processing component is used for outputting or collecting audio; the positioning component is coupled to the electric motor control component; and the electric motor control component is coupled to the audio processing component. By means of the embodiments of the present application, the effectiveness of audio output or collection is improved.

Description

Terminal, terminal control method, device and storage medium

This application claims the priority of the Chinese patent application with the application number 202011521562.2 and the invention title "terminal, terminal control method, device and storage medium" filed on December 21, 2020, the entire contents of which are incorporated into this application by reference .

technical field

The embodiments of the present application relate to the field of terminal technologies, and in particular, to a terminal, a terminal control method, an apparatus, and a storage medium.

Background technique

The terminal has the functions of audio output and audio collection.

In the related art, a speaker is provided at the bottom of the terminal, and the speaker is used for outputting audio; and a microphone is also provided at the bottom of the terminal, and the microphone is used for collecting audio.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a terminal, a terminal control method, an apparatus, and a storage medium. The technical solution is as follows:

According to an aspect of the embodiments of the present application, a terminal is provided, the terminal includes a positioning component, a motor control component, and an audio processing component; wherein the positioning component is used to determine relevant information of a target object, and the relevant information includes The outline shape of the target object and/or the positional relationship between the target object and the terminal, the motor control component is used to control the rotation of the audio processing component based on the relevant information, the audio processing component for outputting or capturing audio;

the positioning assembly and the motor control assembly are coupled;

The motor control assembly and the audio processing assembly are coupled.

According to an aspect of the embodiments of the present application, a terminal control method is provided, which is applied to the terminal according to the above aspect, and the method includes:

sending a first millimeter wave signal through the positioning component;

receiving, by the positioning component, a second millimeter-wave signal reflected from the first millimeter-wave signal by the target object;

Based on the first millimeter wave signal and the second millimeter wave signal, determine the relevant information of the target object, where the relevant information includes the contour shape of the target object and/or the relationship between the target object and the terminal positional relationship between

The motor control component controls the audio processing component to rotate based on the relevant information, and the rotated audio processing component corresponds to the target object.

According to an aspect of the embodiments of the present application, a terminal control apparatus is provided, and the apparatus includes:

a signal sending module, configured to send the first millimeter wave signal through the positioning component;

a signal receiving module, configured to receive, through the positioning component, a second millimeter-wave signal reflected from the first millimeter-wave signal by the target object;

An information determination module, configured to determine relevant information of the target object based on the first millimeter wave signal and the second millimeter wave signal, the relevant information including the contour shape of the target object and/or the target The positional relationship between the object and the terminal;

The component rotation module is configured to control the rotation of the audio processing component based on the relevant information through the motor control component, and the rotated audio processing component corresponds to the target object.

According to an aspect of the embodiments of the present application, a terminal is provided, the terminal includes a processor and a memory, the memory stores a computer program, and the computer program is loaded and executed by the processor to implement the above terminal control method .

According to an aspect of the embodiments of the present application, a computer-readable storage medium is provided, where a computer program is stored in the computer-readable storage medium, and the computer program is loaded and executed by a processor to implement the above terminal control method.

According to one aspect of the embodiments of the present application, a computer program product is provided, the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the terminal reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the terminal executes the above-mentioned terminal control method.

Description of drawings

1 is a schematic diagram of an audio processing system provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of a terminal provided by an embodiment of the present application;

3 is a schematic diagram of a terminal provided by another embodiment of the present application;

4 is a schematic diagram of a terminal provided by another embodiment of the present application;

5 is a flowchart of a terminal control method provided by an embodiment of the present application;

6 is a flowchart of a terminal control method provided by another embodiment of the present application;

7 is a flowchart of a terminal control method provided by another embodiment of the present application;

8 is a block diagram of a terminal control apparatus provided by an embodiment of the present application;

FIG. 9 is a structural block diagram of a terminal provided by an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

First, the terms involved in the embodiments of the present application are explained:

Electric Machine: commonly known as motor, refers to an electromagnetic device that realizes the conversion or transfer of electrical energy based on the law of electromagnetic induction.

Stepping Motor: It can also be called a stepping motor, which is a type of motor. A stepper motor is a control motor that converts an electrical pulse excitation signal into a discrete value of corresponding angular displacement or linear displacement. The stepper motor moves one step whenever an electrical pulse is input, so it is also called a pulse motor. Stepper motors are divided into three basic types: electromechanical, magnetic and linear.

Millimeter Waves: refers to electromagnetic waves (Electromagnetic Waves) in the frequency range of 30-300 GHz (gigahertz). Under vacuum or Free-Space conditions, the corresponding wavelength range is 1-10 mm.

Transceiver (transceiver): It can also be called a radio transceiver, which is a radio transmitter and receiver that are installed on one component and share a part of the same circuit.

LPAMiD (Power Amplifier Module): It is an integrated module that integrates power amplifier, duplexer, filter, switch module and low noise amplifier in the RF front-end part. Exemplarily, the LPAMID includes an LNA (Low Noise Amplifier, low noise amplifier), an integrated multi-mode multi-band PA (Power Amplifier, power amplifier), and a FEMiD.

LNA: is an amplifier with a very low noise figure, generally used as a high-frequency or intermediate-frequency preamplifier for various radio receivers, and an amplifier circuit for high-sensitivity electronic detection equipment. The LNA determines the overall performance of the receiver. The role of the LNA is to take an extremely weak, uncertain signal from the antenna, usually on the order of microvolts or below -100dBm, and amplify that signal to a more useful level, typically around 0.5 to 1V. The main parameters of LNA are noise figure (NF, Noise Factor), gain and linearity. Noise figure is used to measure the amount of noise inside the LNA.

Integrated multi-mode multi-band PA: refers to a PA that supports multiple modes and frequency bands.

FEMiD (Front-End Module): It is an integrated module that integrates RF switches, filters and duplexers in the RF front-end. The performance of RF switches such as insertion loss, return loss, isolation, harmonic suppression and power handling are critical to the impact of the RF front-end chain. The function of the duplexer is to isolate the transmitting and receiving signals to ensure that both receiving and transmitting can work normally at the same time.

DSP (Digital Signal Processor): It is a chip that integrates a special-purpose computer, and refers to a processor that can realize digital signal processing technology.

Please refer to FIG. 1 , which shows a schematic diagram of an audio processing system provided by an embodiment of the present application. The system may include a terminal 100 and a target object 200.

In this embodiment of the present application, the terminal 100 refers to an electronic device having functions of audio output and/or audio collection. Exemplarily, the terminal 100 may be a mobile phone, a tablet computer, an e-book reader, a multimedia playback device, a wearable device, and the like.

In this embodiment of the present application, the target object 200 refers to an object with audio output or audio acquisition requirements. Exemplarily, the target object 200 may include at least one of the following: a person and an item. For example, the target object 200 may include at least one person, or the target object 200 may include at least one item (such as a musical instrument, an audio film, a smart home, etc.), or the target object 200 may include at least one person and at least one item. This is not limited in the application examples. The target object 200 may be in a stationary state or in a moving state, which is not limited in this embodiment of the present application.

Exemplarily, the terminal 100 provided in this embodiment of the present application may output audio to the target object 200 based on relevant information of the target object 200 , or collect audio from the target object 200 . The relevant information of the target object 200 includes the contour shape of the target object and/or the positional relationship between the target object and the terminal. The terminal 100 outputs audio or audio to the target object based on the contour shape of the target object and/or the position between the target object and the terminal. The audio is collected from the target object, and the directional output or collection of the audio is realized. For audio output, in the diffusion direction of non-target audiences, the interference to others is reduced, and the waste of power is reduced; for audio acquisition, the audio source to be input often only comes from a narrow specific direction angle, reducing income from other directions. The probability of sound source reduces the possibility of noise input.

Hereinafter, several embodiments of the present application will be introduced and described.

Please refer to FIG. 2 , which shows a schematic diagram of a terminal provided by an embodiment of the present application. The terminal 100 may include: a positioning component 110 , a motor control component 120 and an audio processing component 130 .

In this embodiment of the present application, the positioning component 110 is used to determine the relevant information of the target object. The relevant information includes the contour shape of the target object and/or the positional relationship between the target object and the terminal. The contour shape of the target object is used to indicate the external shape of the target object, and based on the contour shape of the target object, the part corresponding to the audio output or audio acquisition can be determined. The positional relationship between the target object and the terminal includes at least one of the following: a distance between the target object and the terminal, and an orientation between the target object and the terminal. The distance between the target object and the terminal may refer to the vertical distance between the target object and the terminal, for example, the distance between the target object and the terminal may be 50cm (centimeter), 10cm (centimeter), etc.; the distance between the target object and the terminal The orientation of the terminal is used to indicate the orientation of the target object when the terminal is used as the base point. For example, the orientation between the target object and the terminal is that the target object is located in the south of the terminal, or the orientation between the target object and the terminal is that the target object is located in the terminal. North, or the orientation between the target object and the terminal is that the target object is located in the northwest of the terminal, etc. This embodiment of the present application is only an exemplary description of the orientation between the target object and the terminal. In other possible implementations , the orientation between the target object and the terminal may also be in other forms, which are not limited in this embodiment of the present application.

The motor control assembly 120 is used to control the rotation of the audio processing assembly 130 based on the relevant information. Exemplarily, when the related information includes the contour shape of the target object, the motor control component 120 may control the rotation of the audio processing assembly 130 based on the contour shape of the target object; when the related information includes the positional relationship between the target object and the terminal, the motor The control component 120 may control the rotation of the audio processing component 130 based on the positional relationship between the target object and the terminal.

The audio processing component 130 is used to output or capture audio. The audio processing component 130 is used for outputting audio to the target object, or the audio processing component 130 is used for collecting audio from the target object. The audio processing assembly 130 provided in this embodiment of the present application can be rotated. In a possible implementation, the audio processing component may include one or more components, for example, the audio processing component may include one or more microphones, the audio processing component may include one or more earpieces, the audio processing component may include one or more Multiple speakers, etc., are not limited in this embodiment of the present application.

The positioning component 110 is coupled with the motor control component 120 ; the motor control component 120 is coupled with the audio processing component 130 . In a possible implementation manner, after the positioning component 110 determines the relevant information of the target object, it sends it to the motor control component 120, and the motor control component 120 controls the rotation of the audio processing component 130 based on the relevant information of the target object.

To sum up, in the technical solutions provided by the embodiments of the present application, the rotation of the audio processing component is controlled based on the contour shape of the target object and/or the positional relationship between the target object and the terminal, so that the audio processing component can be more accurate. Outputting audio to or capturing audio from the target object reduces interference to non-target audiences and improves the effectiveness of audio output or capture.

Please refer to FIG. 3 , which shows a schematic diagram of a terminal provided by another embodiment of the present application.

In a possible implementation, the positioning component 110 includes a millimeter wave transceiver 111, a radio frequency integrated unit 112, and a digital signal processing unit 113; the millimeter wave transceiver 111 is coupled with the radio frequency integrated unit 112; the millimeter wave transceiver 111 is connected with the digital signal processing unit 113 Coupling.

The millimeter wave transceiver 111 refers to a device for transmitting and receiving millimeter waves. Illustratively, the millimeter wave transceiver 111 includes a Transceiver. The millimeter wave is used in the embodiment of the present application because the millimeter wave has the capability of all-weather operation, the millimeter wave has a shorter wavelength, a wider frequency band, and has the characteristics of good propagation characteristics in the atmosphere. Millimeter waves can easily penetrate mobile phone casings without being affected by the structural shape. Millimeter waves generally use the operating frequency of 24GHz or 77GHz. The advantage of 77GHz is that it has higher accuracy for ranging, better resolution of horizontal angles, and at the same time, the antenna is smaller and less prone to signal interference.

The radio frequency integrated unit 112 refers to a device used to convert a radio signal into a certain radio signal waveform and send it out through an antenna resonance. Illustratively, the radio frequency integration unit 112 includes LPAMiD.

The digital signal processing unit 113 refers to a device for processing transmission signals and reception signals. Illustratively, the digital signal processing unit 113 includes a DSP.

In a possible implementation, the motor control assembly 120 includes a stepper motor 121 .

In a possible implementation manner, the audio processing component 130 includes at least one of the following: a microphone, a speaker, and an earpiece. It should be noted that in FIG. 3 only the audio processing component 130 is used as a microphone for illustration, and in other possible implementation manners, the audio processing component 130 may also be other forms of components, which are not limited in this embodiment of the present application.

Exemplarily, the terminal 100 may further include a body 140 , and the body 140 may also be referred to as a body, which is the main frame of the terminal 100 . The body 140 is generally in the shape of a hexahedron, and some edges or corners of the hexahedron may be formed with arc-shaped chamfers. The front of the body 140 is generally in the shape of a rounded rectangle or a right-angled rectangle.

The body 140 includes a middle frame 141 , and the middle frame 141 is a frame around the body 140 . In a possible implementation manner, the body 140 is formed with at least one hole 150 , and the audio processing component 130 corresponds to the position of the at least one hole 150 . Exemplarily, at least one hole 150 is formed on the middle frame 141 . The audio processing component 130 corresponds to the position of the at least one hole 150 (the audio processing component corresponding to the position of the hole means that the audio processing component can output audio or capture audio from the position of the hole). In the case where the audio processing component 130 is a component for collecting audio, the above-mentioned holes may be referred to as sound pickup holes, and the audio of the target object can be collected by the audio processing component 130 through the above-mentioned at least one hole 150; in the audio processing component 130 In the case of a component for outputting audio, the above hole may be referred to as a sound outlet hole, and the audio output from the audio processing component 130 may be transmitted to the target object through the above at least one hole 150 . Certainly, in other possible implementation manners, the above-mentioned hole 150 may also have other names, which are not limited in this embodiment of the present application.

Exemplarily, the terminal 100 may further include a display screen (not shown in the figure), and the display screen is arranged on the body 140. For example, the display screen may be arranged on the front, the back, or around the body 140. This is not limited. The display is used to display images and colors. Exemplarily, the display screen is a touch display screen. In addition to the display function, the touch display screen also has the function of receiving a user's touch operation (such as clicking, sliding, pressing, etc.). The display screen may be a rigid screen or a flexible screen, which is not limited in this embodiment of the present application.

In a possible implementation manner, as shown in FIG. 4 , the terminal 100 further includes a camera assembly 160, and the camera assembly 160 is configured to acquire the initial positional relationship of the target object. The camera assembly 160 is coupled with the positioning assembly 110 , the positioning assembly 110 is coupled with the motor control assembly 120 , and the motor control assembly 120 is coupled with the audio processing assembly 130 . In a possible implementation, the camera assembly 160 is coupled with the digital signal processing unit 113 in the positioning assembly 110 . The relevant introduction and description of the positioning component 110 , the motor control component 120 , and the audio processing component 130 can be referred to above, and will not be repeated here. When the target object includes an item, for example, a musical instrument or other items, the embodiment of the present application uses the camera assembly to achieve preliminary positioning, and then the positioning assembly performs repositioning and continuous positioning. Optionally, when the target object includes a person, the camera assembly can also be used to achieve preliminary positioning, and then the positioning assembly can perform repositioning and continuous positioning.

To sum up, in the technical solutions provided by the embodiments of the present application, the relevant information of the target object is determined by sending and receiving millimeter wave signals. The relevant information is more accurate.

Optionally, the camera assembly is used for preliminary positioning first, and then the positioning assembly is used to achieve precise positioning, so that the audio work effect is better.

Please refer to FIG. 5 , which shows a flowchart of a terminal control method provided by an embodiment of the present application. The method can be applied to the terminal shown in FIG. 2 to FIG. 4 , and the method can include the following steps.

Step 501: Send a first millimeter wave signal through the positioning component.

In a possible implementation manner, the positioning component sends the first millimeter wave signal through the array antenna. Illustratively, the positioning assembly transmits the first millimeter wave signal in all directions.

In a possible implementation manner, the first millimeter-wave signal is an FMCW (Frequency Modulated Continuous Wave, frequency modulated continuous wave) signal, and the FMCW signal is a high-frequency continuous wave whose frequency changes according to a triangular wave law with time.

Step 502, the positioning component receives the second millimeter-wave signal reflected by the target object from the first millimeter-wave signal.

The first millimeter-wave signal is received, amplified, and demodulated by the receiving antenna after being reflected on the surface of the obstacle (for example, the surface of the target object) to obtain the second millimeter-wave signal. When the first millimeter wave is an FMCW signal, the second millimeter wave signal is also an FMCW signal.

In a possible implementation manner, when the positioning component sends the first millimeter-wave signals in various directions, the positioning component receives second millimeter-wave signals from various directions.

Step 503: Determine relevant information of the target object based on the first millimeter wave signal and the second millimeter wave signal.

In this embodiment of the present application, the related information includes the contour shape of the target object and/or the positional relationship between the target object and the terminal.

When the first millimeter-wave signal and the second millimeter-wave signal are both FMCW signals, the frequency variation of the first millimeter-wave signal and the second millimeter-wave signal is the same, both are triangular waves, but there is a time difference, which can be used to determine Get the distance between the target object and the terminal.

In a possible implementation manner, the first millimeter wave signal and the second millimeter wave signal are passed through a mixer to form an intermediate frequency signal, and the frequency of the intermediate frequency signal is f (f is obtained by performing fast Fourier transform on the intermediate frequency signal), and d represents The distance between the terminal and the target object, s represents the frequency domain slope of the FMCW signal, and c represents the speed of light, then the distance between the terminal and the target object can be determined by the following formula:

Based on the d value samples of multiple points in the scanning area obtained by millimeter wave signal processing, the distribution map of the d value in the scanning area can be further obtained, and then the contour shape of the target object can be identified in the distribution map by software algorithms.

Step 504 , the motor control component controls the rotation of the audio processing component based on the relevant information, and the rotated audio processing component corresponds to the target object.

The fact that the rotated audio processing component corresponds to the target object means that the rotated audio processing component faces the target object. That is, the rotated audio processing component is oriented to output audio to the target object, or the rotated audio processing component is oriented to collect audio from the target object.

In the case where the target object includes a person, the head position of the person is used as the target part of audio output or audio capture. Exemplarily, the rotation of the audio processing component is controlled by the motor control component, and the rotated audio processing component corresponds to the target portion. The audio processing component outputs audio to the target portion, or the audio processing component captures audio from the target portion.

When the target object includes an item, the sounding position of the item is taken as the target part of the audio collection. Exemplarily, the rotation of the audio processing component is controlled by the motor control component, and the rotated audio processing component corresponds to the target portion. The audio processing component captures audio from the target part. Optionally, the audio processing component outputs audio to the target item, and voice control of the target item is achieved by issuing audio instructions to the target item. Voice control for smart home.

The motor control component converts the signal from the positioning component into the control signal of the stepper motor. Taking the audio processing component as the speaker as an example, for example, the stepper motor can be used to rotate the speaker slightly in the z direction to control the speaker The audio direction of the speaker can be adjusted and moved in the x-y plane; or, the speaker can be slightly rotated in the y direction through the stepper motor to control the audio direction of the speaker to be adjusted and moved in the x-z plane. Based on this adjustment, the audio direction of the speaker will start from the hole and point outward in all directions, and the final direction will be based on the target positioned by the positioning component.

In this embodiment of the present application, by dynamically adjusting the audio processing component of the terminal based on the relevant information of the target object, the terminal can output or collect audio accurately, and the accurate audio output can reduce interference to others; Improve recording quality.

To sum up, in the technical solutions provided by the embodiments of the present application, the rotation of the audio processing component is controlled based on the contour shape of the target object and/or the positional relationship between the target object and the terminal, so that the audio processing component can be more accurate. Outputting audio to the target object, or capturing audio from the target object, reduces interference to non-target audiences and improves the effectiveness of audio output or capture.

In an exemplary embodiment, the target object includes a character, and the related information includes a human outline of the character and/or a positional relationship between the character and the terminal. Please refer to FIG. 6 , which shows a flowchart of a terminal control method provided by another embodiment of the present application. The method can be applied to the terminal shown in FIG. 2 to FIG. 4 , and the method can include the following steps.

Step 601, displaying indication information, where the indication information is used to indicate whether to enable the audio pointing function.

The audio pointing function refers to the function of the audio processing component to output audio to or capture audio from a specific area. The specific area refers to the area where the target object is located.

In a possible implementation manner, indication information is displayed in the system setting interface. If the user confirms to enable the audio pointing function in the system setting interface, the subsequent terminal will automatically execute the following terminal control method when outputting audio or collecting audio.

In a possible implementation manner, indication information is displayed in the audio collection interface, and if the user confirms to enable the audio pointing function in the audio collection interface, the subsequent terminal will automatically execute the following terminal control method when collecting audio. Exemplarily, the audio collection interface includes a call interface, a voice chat interface, a video chat interface, a web conference interface, and the like, and the embodiment of the present application does not limit the type of the audio collection interface.

In a possible implementation manner, indication information is displayed in the audio output interface. If the user confirms to enable the audio pointing function in the audio output interface, the subsequent terminal will automatically execute the following terminal control method when outputting audio. Exemplarily, the audio output interface includes a music playing interface, a video playing interface, a call interface, and the like, and the embodiment of the present application does not limit the type of the audio output interface.

Step 602, in response to receiving the confirmation instruction for the indication information, send the first millimeter wave signal through the positioning component.

The confirmation command is used to instruct to turn on the audio pointing function.

In a possible implementation manner, the user triggers a confirmation instruction for the indication information by means of gesture, touch, voice, or the like.

For the introduction and description of sending the first millimeter-wave signal through the positioning component, reference may be made to the above embodiments, and details are not repeated here.

It should be noted that, in a possible implementation manner, the terminal does not display the indication information, but enables the audio pointing function by default.

Step 603 , receiving the second millimeter-wave signal reflected by the target object from the first millimeter-wave signal through the positioning component.

Step 604, based on the first millimeter-wave signal and the second millimeter-wave signal, determine relevant information of the target object.

In this embodiment of the present application, the related information includes the contour shape of the target object and/or the positional relationship between the target object and the terminal.

For the introduction and description of steps 603 to 604, reference may be made to the above embodiments, and details are not repeated here.

Step 605: Determine the head position of the character based on the relevant information and head features.

Head features are used to indicate the profile features of a person's head.

The head position of the character is used to indicate the positional relationship between the head of the character and the terminal. For example, the head position of the character may be such that the head is located on the upper side of the terminal.

In a possible implementation manner, the terminal determines the head area of the character from the outline of the character based on the outline and head features of the character; the terminal determines the head area of the character based on the positional relationship between the character and the terminal and the head area of the character The positional relationship between the head and the terminal.

In a possible implementation, steps 602 to 605 may be performed by a positioning component. Exemplarily, steps 602 to 603 may be performed by a millimeter wave transceiver and a radio frequency integrated unit in the positioning component, and steps 604 to 605 may be performed by a digital signal processing unit in the positioning component.

Step 606 , the audio processing component is controlled to rotate by the motor control component, and the rotated audio processing component faces the position of the head of the character.

After the terminal determines the head position of the character, the terminal can determine the rotation information corresponding to the audio processing assembly based on the current position of the audio processing assembly and the head position of the character, and the rotation information is used to indicate how the audio processing assembly rotates. Exemplarily, the rotation information may be determined by a digital signal processing unit, and after the determination, the digital signal processing unit sends the rotation information to the motor control component; the motor control component controls the audio processing component to rotate based on the rotation information.

Step 607: Determine the updated positional relationship between the person and the terminal. The updated positional relationship is obtained by measuring the position between the person and the terminal again after the time when the relevant information is acquired.

In a possible implementation manner, after the audio processing component completes the rotation, the terminal performs the step of determining the updated positional relationship between the character and the terminal.

The updated positional relationship refers to the positional relationship between the person and the terminal obtained after the terminal re-measures. In a possible implementation, the millimeter-wave signal is sent through the positioning component, and the reflected millimeter-wave signal reflected by the person is received; based on the sent millimeter-wave signal and the reflected millimeter-wave signal, the updated positional relationship between the person and the terminal is determined .

Step 608: Determine whether the change between the updated positional relationship and the positional relationship satisfies a preset condition. In response to the change between the updated positional relationship and the positional relationship satisfying the preset condition, the execution starts from step 602 again; in response to the change between the updated positional relationship and the positional relationship does not satisfy the preset condition, the execution starts from step 607 again.

In a possible implementation manner, after the terminal determines the location relationship of the target object, it stores it in the register. After the terminal determines the updated location relationship, it compares the updated location relationship with the location relationship, and determines the difference between the updated location relationship and the location relationship. changes between. The terminal will also store the updated position relationship in the register.

In a possible implementation manner, the updated position relationship includes the updated distance between the target object and the terminal, and/or the updated orientation between the target object and the terminal.

The updating of the positional relationship and the change between the positional relationship may include at least one of the following: a change in distance, and a change in orientation.

In a possible implementation manner, the preset condition includes that the change between the updated positional relationship and the positional relationship is greater than a preset threshold, and the preset threshold can be set by a technician. Exemplarily, when the change between the updated positional relationship and the positional relationship is greater than a preset threshold, it is determined that the change between the updated positional relationship and the positional relationship satisfies the preset condition; when the change between the updated positional relationship and the positional relationship is less than the predetermined threshold When the threshold is set, it is determined that the change between the updated positional relationship and the positional relationship does not satisfy the preset condition. Exemplarily, the preset threshold corresponding to the change of the distance and the preset threshold corresponding to the change of the orientation may be different, the change of the distance may be measured by cm (centimeter), and the change of the orientation may be measured by the angle.

In a possible implementation manner, in response to the update of the positional relationship and the change between the positional relationships satisfying a preset condition, the execution starts from the step of sending the first millimeter-wave signal through the positioning component again. When the change between the updated positional relationship and the positional relationship satisfies the preset conditions, it means that the position of the character has changed significantly, and the terminal needs to re-determine the position of the character's head, and then adjust the steering of the audio processing component.

In a possible implementation manner, in response to the change between the updated positional relationship and the positional relationship not satisfying the preset condition, execution is performed again from the step of determining the updated positional relationship between the character and the terminal. When the change between the updated positional relationship and the positional relationship does not meet the preset conditions, it means that the position of the character has not changed significantly, and the terminal can still output audio or collect audio through the previously rotated audio processing component, without the need for audio The steering of the handling assembly is adjusted. The terminal may continuously determine the updated positional relationship, and determine whether the orientation of the audio processing component needs to be readjusted based on the updated positional relationship.

Exemplarily, when the relative movement of the character's head such as raising or lowering the head and the terminal is relatively small, it is determined that it is not necessary to adjust the audio pointing; when the relative movement is relatively large or the target object is replaced, it is determined that the head of the character needs to be reset position.

In this embodiment of the present application, even if the target object moves, the orientation of the audio processing component can be dynamically adjusted to ensure the best audio work effect.

In a possible implementation manner, the target object includes a first object and a second object; the first audio processing component in the audio processing components corresponds to the first object; and the second audio processing component in the audio processing components corresponds to the second object. The first audio processing component of the audio processing components serves the first object (that is, the first audio processing component outputs audio for the first object, or the first audio processing component collects audio from the first object), and the audio processing component The second audio processing component of , serves the second object (the second audio processing component outputs audio for the second object, or the second audio processing component collects audio from the second object). The first audio processing component and the second audio processing component are different components. In a possible implementation manner, the second audio processing component is all components of the audio processing component except the first audio processing component, or the second audio processing component is a part of the audio processing component except the first audio processing component . In an example, the numbers of the first audio processing components and the second audio processing components are the same; in another example, the numbers of the first audio processing components and the second audio processing components are different, which is not limited in this embodiment of the present application.

In a possible implementation, a component of the audio processing components that is closest to the first object is determined as the first audio processing component; and a component of the audio processing components that is closest to the second object is determined to be the second audio processing component.

In a possible implementation manner, when the target object includes multiple objects, the object closest to the terminal by default corresponds to the audio processing component. That is, in the case where the target object includes multiple objects, the default audio processing component serves the object closest to the terminal (that is, the audio processing component outputs audio for the object closest to the terminal, or the audio processing component starts from the object closest to the terminal. object that captures audio).

To sum up, in the technical solutions provided by the embodiments of the present application, by displaying the indication information, and then after receiving the confirmation instruction for the indication information, the millimeter wave signal is sent through the positioning component, and the user can flexibly choose whether to enable the audio pointing function and more flexibility.

In addition, the embodiment of the present application determines whether the orientation of the audio processing component needs to be readjusted based on the updated positional relationship and positional relationship. Even if the target object moves, the orientation of the audio processing component can be dynamically adjusted to ensure the best audio work effect.

In an exemplary embodiment, the target object includes an item. Please refer to FIG. 7 , which shows a flowchart of a terminal control method provided by another embodiment of the present application. The method can be applied to the terminal shown in FIG. 2 to FIG. 4 , and the method can include the following steps.

Step 701: Determine the initial positional relationship between the item and the terminal through the camera assembly.

In a possible implementation manner, the terminal displays indication information, which is used to indicate whether to enable the audio pointing function; in response to receiving a confirmation instruction for the indication information, the camera assembly determines the initial positional relationship between the item and the terminal.

In a possible implementation manner, the user focuses the item through the camera assembly, so that the terminal determines the initial positional relationship between the item and the terminal. The initial positional relationship is used to indicate the approximate position between the item and the terminal.

Optionally, before step 701, it further includes displaying indication information, where the indication information is used to indicate whether to enable the audio pointing function. In response to receiving the confirmation instruction for the indication information, the initial positional relationship between the item and the terminal is determined by the camera assembly.

Step 702: Send a first millimeter-wave signal to the item based on the initial position relationship through the positioning component.

In a possible implementation manner, after the terminal determines the initial position relationship, the positioning component may determine the approximate position of the item, and at this time, the positioning component may send the first millimeter wave signal to the item based on the initial position relationship.

In step 703, the positioning component receives the second millimeter-wave signal reflected from the first millimeter-wave signal by the article.

Step 704 , based on the first millimeter-wave signal and the second millimeter-wave signal, determine relevant information of the article, where the relevant information includes the outline and shape of the article and/or the positional relationship between the article and the terminal.

For the introduction and description of steps 702 to 704, reference may be made to the above embodiments, and details are not repeated here.

Step 705 , the motor control component controls the rotation of the audio processing component based on the relevant information, and the rotated audio processing component corresponds to the item.

In a possible implementation, when the target object includes an item, the audio processing component is mainly used to collect the audio of the item. Therefore, the fact that the rotated audio processing assembly corresponds to the item means that the rotated audio processing assembly collects the audio of the item. Optionally, the audio processing component outputs audio to the target item, and voice control of the target item is achieved by issuing audio instructions to the target item. Voice control for smart home.

In a possible implementation manner, the sounding positions of different items may be different. The terminal may determine the sounding position of the item based on the contour shape of the item, and determine the position between the sounding position and the terminal based on the positional relationship between the item and the terminal. so as to control the motor control component to control the rotation of the audio processing component, and the rotated audio processing component faces the sounding part.

Step 706: Determine a new positional relationship between the item and the terminal, where the new positional relationship is obtained by measuring the position between the item and the terminal again after the time when the relevant information is acquired.

Step 707: Determine whether the change between the new positional relationship and the positional relationship satisfies a preset condition. In response to the change between the new positional relationship and the positional relationship meeting the preset condition, the execution starts from step 701 again; in response to the change between the new positional relationship and the positional relationship does not meet the preset condition, the execution starts from step 706 again.

In a possible implementation manner, in response to the new positional relationship and the change between the positional relationship satisfying the preset condition, the process starts from the step of determining the initial positional relationship between the item and the terminal by using the camera again.

In a possible implementation manner, in response to the change between the new positional relationship and the positional relationship not satisfying the preset condition, execution starts from the step of determining the new positional relationship between the item and the terminal again.

For the introduction and description of steps 706 to 707, reference may be made to the above embodiments, and details are not repeated here.

To sum up, in the technical solutions provided by the embodiments of the present application, the positional relationship between the item and the terminal is determined, so that the audio processing component faces the item, so that the audio processing component can output audio to the collected item more accurately , the audio processing component can also collect the audio of the item more accurately and reduce the interference of other noises.

The following are apparatus embodiments of the present application, which can be used to execute the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

Please refer to FIG. 8 , which shows a block diagram of a terminal control apparatus provided by an embodiment of the present application. The apparatus can be applied to the terminals shown in FIG. 2 to FIG. 4 , and the apparatus has the function of implementing the above example of the terminal control method. , the functions can be implemented by hardware, and can also be implemented by hardware executing corresponding software. The apparatus 800 may include:

a signal sending module 810, configured to send a first millimeter wave signal through the positioning component;

a signal receiving module 820, configured to receive, through the positioning component, a second millimeter-wave signal reflected from the first millimeter-wave signal by the target object;

An information determination module 830, configured to determine relevant information of the target object based on the first millimeter wave signal and the second millimeter wave signal, where the relevant information includes the contour shape of the target object and/or the the positional relationship between the target object and the terminal;

The component rotation module 840 is configured to control the rotation of the audio processing component through the motor control component based on the relevant information, and the rotated audio processing component corresponds to the target object.

To sum up, in the technical solutions provided by the embodiments of the present application, the rotation of the audio processing component is controlled based on the contour shape of the target object and/or the positional relationship between the target object and the terminal, so that the audio processing component can be more accurate. Outputting audio to or capturing audio from the target object reduces interference to non-target audiences and improves the effectiveness of audio output or capture.

In an exemplary embodiment, the target object includes a character, and the related information includes a human outline of the character and/or a positional relationship between the character and the terminal;

The assembly rotation module 840 is used for:

determining the head position of the character based on the relevant information and the head feature;

The rotation of the audio processing assembly is controlled by the motor control assembly, and the rotated audio processing assembly faces the head position of the character.

In an exemplary embodiment, the apparatus further comprises: a position determination module (not shown in the figure).

A position determination module, configured to determine an updated positional relationship between the character and the terminal, where the updated positional relationship is to re-determine the position between the character and the terminal after obtaining the relevant information obtained by measuring;

The signal sending module 810 is further configured to, in response to the change between the updated positional relationship and the positional relationship satisfying a preset condition, start executing again from the step of sending the first millimeter-wave signal through the positioning component ;

The location determination module is further configured to, in response to the change between the updated location relationship and the location relationship not satisfying a preset condition, re-determine the updated location relationship between the character and the terminal from the The steps are executed.

In an exemplary embodiment, the target object includes an item, and the terminal further includes a camera assembly;

The device further includes: a position determination module (not shown in the figure).

the position determination module, configured to determine the initial position relationship between the item and the terminal through the camera assembly;

The signal sending module 810 is used for:

The first millimeter wave signal is sent to the article by the positioning component based on the initial positional relationship.

In an exemplary embodiment, the location determination module is further configured to:

determining a new positional relationship between the item and the terminal, where the new positional relationship is obtained by measuring the position between the item and the terminal again after obtaining the relevant information;

In response to the change between the new positional relationship and the positional relationship satisfying a preset condition, performing again from the step of determining the initial positional relationship between the item and the terminal through the camera;

In response to the change between the new positional relationship and the positional relationship not satisfying a preset condition, the step of determining the new positional relationship between the item and the terminal is performed again.

In an exemplary embodiment, the target object includes a first object and a second object;

A first audio processing component in the audio processing components corresponds to the first object;

A second audio processing component of the audio processing components corresponds to the second object.

In an exemplary embodiment, the apparatus further comprises:

an information display module (not shown in the figure), used to display indication information, the indication information is used to indicate whether to enable the audio pointing function;

The signal sending module 810 is further configured to start from the step of sending the first millimeter wave signal through the positioning component in response to receiving the confirmation instruction for the indication information.

It should be noted that, when the device provided in the above embodiment realizes its functions, only the division of the above functional modules is used as an example for illustration. The internal structure is divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.

Please refer to FIG. 9 , which shows a structural block diagram of a terminal provided by an embodiment of the present application.

The terminal in this embodiment of the present application may include one or more of the following components: a processor 910 and a memory 920 .

Processor 910 may include one or more processing cores. The processor 910 uses various interfaces and lines to connect various parts in the entire terminal, and executes the terminal's operation by running or executing the instructions, programs, code sets or instruction sets stored in the memory 920, and calling the data stored in the memory 920. Various functions and processing data. Optionally, the processor 910 may adopt at least one of a digital signal processing (Digital Signal Processing, DSP), a Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and a Programmable Logic Array (Programmable Logic Array, PLA). A hardware form is implemented. The processor 910 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU) and a modem. Among them, the CPU mainly handles the operating system and application programs; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 910, but is implemented by a single chip.

Optionally, when the processor 910 executes the program instructions in the memory 920, the methods provided by the foregoing method embodiments are implemented.

The memory 920 may include a random access memory (Random Access Memory, RAM), or may include a read-only memory (Read-Only Memory, ROM). Optionally, the memory 920 includes a non-transitory computer-readable storage medium. Memory 920 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 920 may include a stored program area and a stored data area, wherein the stored program area may store an instruction for implementing an operating system, an instruction for at least one function, an instruction for implementing each of the above method embodiments, and the like; the storage data area Data and the like created according to the use of the terminal can be stored.

The above-mentioned structure of the terminal is only illustrative. In actual implementation, the terminal may include more or less components, such as a display screen, etc., which is not limited in this embodiment.

Those skilled in the art can understand that the structure shown in FIG. 9 does not constitute a limitation on the terminal, and may include more or less components than shown, or combine some components, or adopt different component arrangements.

In an exemplary embodiment, a computer-readable storage medium is also provided, and a computer program is stored in the computer-readable storage medium, and the computer program is loaded and executed by a processor of a terminal to implement the above-mentioned terminal control method. the steps in the example.

In an exemplary embodiment, a computer program product is provided that includes computer instructions stored in a computer-readable storage medium. The processor of the terminal reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the terminal executes the above-mentioned terminal control method.

It should be understood that references herein to "a plurality" means two or more. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are an "or" relationship. In addition, the numbering of the steps described in this document only exemplarily shows a possible execution sequence between the steps. In some other embodiments, the above steps may also be executed in different order, such as two different numbers. The steps are performed at the same time, or two steps with different numbers are performed in a reverse order to that shown in the figure, which is not limited in this embodiment of the present application.

The above are only exemplary embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the protection of the present application. within the range.

Claims (20)

1. A terminal, characterized in that the terminal includes a positioning component, a motor control component and an audio processing component; wherein, the positioning component is used to determine relevant information of a target object, and the relevant information includes an outline shape of the target object And/or the positional relationship between the target object and the terminal, the motor control component is used to control the rotation of the audio processing component based on the relevant information, and the audio processing component is used to output or collect audio;

   the positioning assembly and the motor control assembly are coupled;

   The motor control assembly and the audio processing assembly are coupled.
2. The terminal according to claim 1, wherein the positioning component comprises a millimeter wave transceiver, a radio frequency integrated unit, and a digital signal processing unit;

   the millimeter wave transceiver is coupled to the radio frequency integrated unit;

   The millimeter wave transceiver is coupled to the digital signal processing unit.
3. The terminal according to claim 1 or 2, wherein the motor control assembly comprises a stepping motor.
4. A terminal control method, characterized in that, applied to the terminal according to any one of claims 1 to 3, the method comprising:

   sending a first millimeter wave signal through the positioning component;

   receiving, by the positioning component, a second millimeter-wave signal reflected from the first millimeter-wave signal by the target object;

   Based on the first millimeter wave signal and the second millimeter wave signal, determine the relevant information of the target object, where the relevant information includes the contour shape of the target object and/or the relationship between the target object and the terminal positional relationship between

   The motor control component controls the audio processing component to rotate based on the relevant information, and the rotated audio processing component corresponds to the target object.
5. The method according to claim 4, wherein the target object includes a person, and the related information includes a human outline of the person and/or a positional relationship between the person and the terminal;

   The controlling the rotation of the audio processing component by the motor control component based on the relevant information includes:

   determining the head position of the character based on the relevant information and the head feature;

   The rotation of the audio processing component is controlled by the motor control component, and the rotated audio processing component faces the position of the head of the character.
6. The method according to claim 5, wherein after controlling the rotation of the audio processing component by the motor control component, the method further comprises:

   determining the updated positional relationship between the character and the terminal, the updated positional relationship is obtained by measuring the position between the character and the terminal again after the time when the relevant information is obtained;

   In response to the change between the updated positional relationship and the positional relationship satisfying a preset condition, performing again from the step of sending the first millimeter-wave signal through the positioning component;

   In response to the change between the updated positional relationship and the positional relationship not satisfying a preset condition, the execution starts from the step of determining the updated positional relationship between the character and the terminal again.
7. The method according to claim 4, wherein the target object comprises an item, and the terminal further comprises a camera assembly;

   Before the sending the first millimeter wave signal through the positioning component, the method further includes:

   Determine the initial positional relationship between the item and the terminal by using the camera assembly;

   The sending of the first millimeter-wave signal through the positioning component includes:

   The first millimeter wave signal is sent to the article by the positioning component based on the initial positional relationship.
8. The method according to claim 7, wherein after the controlling the rotation of the audio processing component by the motor control component based on the relevant information, the method further comprises:

   determining a new positional relationship between the item and the terminal, where the new positional relationship is obtained by measuring the position between the item and the terminal again after obtaining the relevant information;

   In response to the change between the new positional relationship and the positional relationship satisfying a preset condition, performing again from the step of determining the initial positional relationship between the item and the terminal through the camera;

   In response to the change between the new positional relationship and the positional relationship not satisfying a preset condition, the step of determining the new positional relationship between the item and the terminal is performed again.
9. The method according to any one of claims 4 to 8, wherein the target object comprises a first object and a second object;

   A first audio processing component in the audio processing components corresponds to the first object;

   A second audio processing component of the audio processing components corresponds to the second object.
10. The method according to any one of claims 4 to 8, wherein the method further comprises:

    Displaying indication information, the indication information is used to indicate whether to enable the audio pointing function;

    In response to receiving the confirmation instruction for the indication information, the step of sending the first millimeter wave signal through the positioning component is performed.
11. A terminal control device, characterized in that, when applied to the terminal according to any one of claims 1 to 3, the device comprises:

    a signal sending module, configured to send the first millimeter wave signal through the positioning component;

    a signal receiving module, configured to receive the second millimeter-wave signal reflected from the first millimeter-wave signal by the target object through the positioning component;

    an information determination module, configured to determine relevant information of the target object based on the first millimeter wave signal and the second millimeter wave signal, the relevant information including the contour shape of the target object and/or the target the positional relationship between the object and the terminal;

    The component rotation module is used for controlling the rotation of the audio processing component based on the relevant information through the motor control component, and the rotated audio processing component corresponds to the target object.
12. The device according to claim 11, wherein the target object includes a person, and the related information includes a human outline of the person and/or a positional relationship between the person and the terminal;

    The assembly rotation module is used for:

    determining the head position of the character based on the relevant information and the head feature;

    The rotation of the audio processing component is controlled by the motor control component, and the rotated audio processing component faces the position of the head of the character.
13. The apparatus of claim 12, wherein the apparatus further comprises:

    A position determination module, configured to determine an updated positional relationship between the character and the terminal, where the updated positional relationship is to re-determine the position between the character and the terminal after obtaining the relevant information obtained by measuring;

    The signal sending module is further configured to start executing again from the step of sending the first millimeter wave signal through the positioning component in response to the change between the updated positional relationship and the positional relationship meeting a preset condition;

    The location determination module is further configured to, in response to the change between the updated location relationship and the location relationship not satisfying a preset condition, re-determine the updated location relationship between the character and the terminal from the The steps are executed.
14. The device according to claim 11, wherein the target object comprises an item, and the terminal further comprises a camera assembly;

    The device also includes:

    a position determination module, configured to determine the initial positional relationship between the item and the terminal through the camera assembly;

    The signal sending module is further configured to send the first millimeter wave signal to the article based on the initial position relationship through the positioning component.
15. The device according to claim 14, wherein the position determination module is further configured to:

    determining a new positional relationship between the item and the terminal, where the new positional relationship is obtained by measuring the position between the item and the terminal again after obtaining the relevant information;

    In response to the change between the new positional relationship and the positional relationship satisfying a preset condition, start performing again from the step of determining the initial positional relationship between the item and the terminal by using the camera;

    In response to the change between the new positional relationship and the positional relationship not satisfying a preset condition, the step of determining the new positional relationship between the item and the terminal is performed again.
16. The apparatus according to any one of claims 11 to 15, wherein the target object includes a first object and a second object;

    A first audio processing component in the audio processing components corresponds to the first object;

    A second audio processing component of the audio processing components corresponds to the second object.
17. The device according to any one of claims 11 to 15, wherein the device further comprises:

    an information display module, used to display indication information, the indication information is used to indicate whether to enable the audio pointing function;

    The signal sending module is further configured to start from the step of sending the first millimeter wave signal through the positioning component in response to receiving a confirmation instruction for the indication information.
18. A terminal, characterized in that the terminal includes a processor and a memory, the memory stores a computer program, and the computer program is loaded and executed by the processor to realize the terminal according to any one of claims 4 to 10 Control Method.
19. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, and the computer program is loaded and executed by a processor to realize the terminal according to any one of claims 4 to 10 Control Method.
20. A computer program product, characterized in that the computer program product includes computer instructions, the computer instructions are stored in a computer-readable storage medium, and a processor reads and executes the computer instructions from the computer-readable storage medium , so as to realize the terminal control method according to any one of claims 4 to 10.

Images