CN116896657A

CN116896657A - Ultrasonic positioning method and display device

Info

Publication number: CN116896657A
Application number: CN202310772850.2A
Authority: CN
Inventors: 刘浩; 王丽娟
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2023-06-27
Filing date: 2023-06-27
Publication date: 2023-10-17

Abstract

The application provides an ultrasonic positioning method and display equipment, if at least one external device exists in an audio signal player and an audio signal receiver. The current device installation mode of the audio signal player and/or the audio signal receiver which are the external devices is obtained. And searching distance parameters of the audio signal player and/or the audio signal receiver from the corresponding relation according to the current installation mode. And finally, positioning the target object according to the first distance parameter, the second distance parameter, the transmitted ultrasonic audio signal and the ultrasonic audio signal reflected by the target object. Therefore, even if the external audio system is utilized for ultrasonic positioning, the distance parameters can be determined according to the actual installation mode of the external audio system, then the target object is positioned according to the determined distance parameters, and the situation that the target object cannot be positioned due to unknown distance is avoided.

Description

Ultrasonic positioning method and display device

Technical Field

The application relates to the technical field of display equipment, in particular to an ultrasonic positioning method and display equipment.

Background

With the rapid development of display device technology, the functions of display devices are becoming more and more diversified, and for example, the image quality of the display device or the sound quality of the display device can be adjusted based on the positional relationship between a target object and the display device. In order to achieve the above function, it is necessary to locate the target object, and the positional relationship of the target object and the display device is determined based on the location of the target object.

Current display devices may utilize an on-board audio system to locate a target object. For example, an ultrasonic wave is emitted by an audio signal player in an audio system of the display device, an ultrasonic wave emitted by the audio signal player is received by an audio signal receiver in the audio system of the display device, and then the positional relationship between the target object and the display device is determined according to the ultrasonic wave signal emitted by the audio signal player and the ultrasonic wave signal received by the audio signal receiver.

In locating a target object using the display device's own audio system, the target object can be located using these known location data because the location-related data of the own audio system at the display device is known (including the location-related data of the audio signal player and the location-related data of the audio signal receiver is known). But at present, the display device is widely applied to daily life in a scene of externally connecting an audio signal player or an externally connecting an audio signal receiver. In an application scenario of sending out ultrasonic waves by using an external audio signal player or receiving ultrasonic waves by using an external audio signal receiver, the position of the external audio signal player is unknown or the position of the external audio signal receiver is unknown, so that the position relationship between the target object and the display device cannot be calculated, i.e. the target object cannot be positioned.

Disclosure of Invention

The application provides an ultrasonic positioning method and display equipment, which solve the problem that if the display equipment performs ultrasonic positioning by using an external audio system, a target object cannot be positioned because the position of the external audio system is unknown.

In a first aspect, some embodiments of the present application provide a display apparatus, including:

a display configured to display a user interface;

an audio signal player configured to emit an ultrasonic audio signal;

the system comprises an audio signal receiver, a display device and a display device, wherein the audio signal receiver is configured to receive an ultrasonic audio signal reflected by a target object, the audio signal player and the audio signal receiver are one of external equipment and built-in equipment, the audio signal player is provided with a first distance parameter, the audio signal receiver is provided with a second distance parameter, the distance parameter of the external equipment is an unknown parameter, and the distance parameter of the built-in equipment is a known parameter;

the controller is configured to:

if at least one external device exists in the audio signal player and the audio signal receiver, at least one of the first distance parameter and the second distance parameter is an unknown parameter, and a current device installation mode of the audio signal player and/or a current device installation mode of the audio signal receiver are obtained;

According to the current equipment installation mode, searching a first distance parameter corresponding to the audio signal player and/or searching a second distance parameter corresponding to the audio signal receiver from a corresponding relation, wherein the corresponding relation is the relation between the equipment installation mode and the distance parameter;

and positioning the target object according to the first distance parameter, the second distance parameter, the ultrasonic audio signal and the ultrasonic audio signal reflected by the target object.

In a second aspect, some embodiments of the present application provide an ultrasonic positioning method applied to a controller of a display device, the display device further including an audio signal player configured to emit an ultrasonic audio signal; the system comprises an audio signal receiver, a display device and a display device, wherein the audio signal receiver is configured to receive an ultrasonic audio signal reflected by a target object, the audio signal player and the audio signal receiver are one of external equipment and built-in equipment, the audio signal player is provided with a first distance parameter, the audio signal receiver is provided with a second distance parameter, the distance parameter of the external equipment is an unknown parameter, and the distance parameter of the built-in equipment is a known parameter;

The ultrasonic positioning method comprises the following steps:

According to the technical scheme, the ultrasonic positioning method and the display device provided by the application are used for positioning the target object by using the audio signal player and the audio signal receiver. If at least one external device exists in the audio signal player and the audio signal receiver, at least one of the corresponding first distance parameter and second distance parameter is an unknown parameter. The current device installation mode of the audio signal player and/or the audio signal receiver which are the external devices is obtained. And searching distance parameters of the audio signal player and/or the audio signal receiver from the corresponding relation according to the current installation mode, namely searching a first distance parameter according to the current equipment installation mode if the audio signal player is external equipment, and searching a second distance parameter according to the current equipment installation mode if the audio signal receiver is external equipment. And finally, positioning the target object according to the first distance parameter, the second distance parameter, the transmitted ultrasonic audio signal and the ultrasonic audio signal reflected by the target object. Therefore, even if the external audio system is utilized for ultrasonic positioning, the distance parameters can be determined according to the actual installation mode of the external audio system, then the target object is positioned according to the determined distance parameters, and the situation that the target object cannot be positioned due to unknown distance is avoided.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment of the present application;

fig. 2 is a block diagram of a hardware configuration of a control device 100 according to an embodiment of the present application;

fig. 3 is a block diagram of a hardware configuration of a display device 200 according to an embodiment of the present application;

fig. 4 is a software configuration diagram of a display device 200 according to an embodiment of the present application;

fig. 5 is a view of a usage scenario of a display device 200 according to an embodiment of the present application;

FIG. 6 is a schematic diagram of the principle of ultrasonic reflection;

fig. 7 is a schematic diagram of a distance calculation principle between a target object and the display device 200;

fig. 8 is a schematic diagram of the installation of an audio system on a display device 200;

fig. 9 is a flowchart illustrating a positioning method executed by the display device 200 according to an embodiment of the present application;

fig. 10 is a block diagram showing hardware connection of some functional modules of the display device 200 according to the embodiment of the present application;

FIG. 11 is a schematic diagram of an ultrasonic positioning principle using an audio system according to an embodiment of the present application;

fig. 12 is a schematic diagram of a user interface of a display device 200 according to an embodiment of the present application;

FIG. 13 is a schematic diagram of a user interface of a display device 200 according to another embodiment of the present application;

FIG. 14 is a schematic diagram of a user interface of a display device 200 according to an embodiment of the present application;

FIG. 15 is a schematic diagram of a user interface of a display device 200 according to another embodiment of the present application;

fig. 16 is a schematic diagram illustrating the distribution of external device interfaces on a display device 200 according to an embodiment of the present application;

FIG. 17 is a schematic diagram of a user interface of a display device 200 according to another embodiment of the present application;

FIG. 18 is a schematic diagram of a user interface of a display device 200 according to an embodiment of the present application;

fig. 19 is a schematic diagram showing a distribution of audio signal receivers on a display device 200 according to an embodiment of the present application;

fig. 20 is a schematic diagram of a distribution of audio signal players on a display device 200 according to an embodiment of the present application;

fig. 21 is a schematic diagram showing a distribution of still another audio signal player on a display device 200 according to an embodiment of the present application;

fig. 22 is a schematic diagram showing a distribution of still another audio signal player on a display device 200 according to an embodiment of the present application;

Fig. 23 is a schematic diagram of a difference frequency signal generation principle according to an embodiment of the present application;

FIG. 24 is a flowchart of an ultrasonic round trip distance calculation method according to an embodiment of the present application;

FIG. 25 is a schematic diagram of the calculation principle of the ultrasonic round trip time according to the embodiment of the present application;

fig. 26 is a schematic diagram showing a distribution of still another audio signal receiver on a display device 200 according to an embodiment of the present application;

fig. 27 is a schematic diagram showing a distribution of still another audio signal receiver on a display device 200 according to an embodiment of the present application;

FIG. 28 is a schematic diagram of determining the position of an audio signal receiver at a wavefront using a distance parameter according to an embodiment of the present application;

fig. 29 is a schematic diagram of a target object positioning workflow according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, exemplary embodiments of the present application will be described more fully hereinafter with reference to the accompanying drawings. It will be apparent that the exemplary embodiments described are only some, but not all, embodiments of the application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of some embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided by the embodiment of the application can have various implementation forms, for example, a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table) and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device in an exemplary embodiment of the present application. As shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a hardware configuration block diagram of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200. As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface. The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM (Random AccessMemory, RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; and Native applications (Native APPs).

The application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, the image quality of the display device or the sound quality of the display device may be adjusted based on the positional relationship of the user with the display device. Fig. 5 is a usage scenario diagram of a display device 200 according to an embodiment of the present application. The display device 200 in fig. 5 is mounted with left and right speakers, and the left and right speakers are symmetrically disposed at both ends of the display device 200 with a center line of the display device as a symmetry axis. The front of the display apparatus 200 is the direction in which the screen of the display apparatus 200 can be viewed, for example, the area where the user a and the user B are located is the front of the display apparatus 200.

The right front of the display apparatus 200 refers to a position on the center line of the display apparatus 200, for example, a position where the user a is located falls on the center line, and the user a is located in the right front area of the display apparatus 200. The user a in fig. 5 is located in the immediate front middle area of the display device 200, and is then able to obtain the best acoustic experience when viewing the display device 200. User B is not located in the immediate front middle area and is not able to obtain the best acoustic experience while viewing display device 200. In order to provide the best acoustic experience to user B at this time, it is necessary to locate user B and then adjust the sound quality of display device 200 according to the location of user B.

In addition, when the display device 200 is used by a user, there are cases where the screen image quality required when the user is closer to the screen is different from the screen image quality required when the user is farther from the screen. For example, when the user is closer to the screen, the screen is required to show details in the picture, so that the noise reduction effect of the screen is stronger; when the user is far away from the screen, the details in the picture are not needed to be reflected by the screen, and the noise reduction effect of the corresponding screen is weaker.

For example, in fig. 5, the distance between the user a and the display device 200 is relatively short, so that the screen is required to be able to embody details in the screen, and the distance between the user B and the display device 200 is relatively long, and the screen is not required to embody details of the screen. In order to provide different image quality to different users, it is necessary to adjust the image quality according to the actual positional relationship between the user and the display device 200, and therefore it is also necessary to position the user and then adjust the image quality of the display device 200 according to the user's designation.

The display device 200 may utilize an on-board audio system to locate the target object. For example, ultrasonic waves are emitted by an audio signal player (e.g., a speaker) in the audio system of the display apparatus 200, ultrasonic waves emitted by the audio signal player are received by an audio signal receiver (e.g., a microphone) in the audio system of the display apparatus, and then the positional relationship between the target object and the display apparatus is determined based on the ultrasonic signals emitted by the audio signal player and the ultrasonic signals received by the audio signal receiver.

As shown in the schematic diagram of ultrasonic reflection in fig. 6, the ultrasonic audio signal reflected by the target object is received at the same time on the whole wave front, so that only the round trip distance between the sound source and the target object can be obtained according to the echo time difference, and the specific position of the microphone on the wave front cannot be determined, so that the position relationship between the loudspeaker and the microphone needs to be obtained, and the actual position of the target object can be determined.

As shown in the calculation schematic diagram of fig. 7, the calculation formula of the distance between the target object and the display device 200 (the distance between the target object and the display device 200 according to the present application are all straight-line distances) is as follows:

wherein the speaker and microphone are considered to be on the same horizontal line for convenience of solution explanation. S is the speed at which the ultrasonic wave propagates, T is the time difference between the ultrasonic wave emitted from the speaker and the ultrasonic wave reflected by the target object, H is the distance between the speaker and the microphone, which is a device included in the self-contained audio system of the display apparatus 200, and thus the distance H between the speaker and the microphone is a known parameter. It can be seen that if the target object is ultrasonically positioned using the audio system of the display device 200 itself, the linear distance of the target object from the display device 200 can be calculated from known parameters.

In locating a target object using the audio system of the display device 200, since the data relating to the position of the audio system of the display device is known, the target object can be located using these known position data. For example, as shown in the installation schematic of the audio system shown in fig. 8 on the display device 200, the audio system shown in fig. 6 includes left and right speakers and microphones. Since the display apparatus 200 is an audio system of the display apparatus 200, when the display apparatus 200 leaves the factory, the installation positions of the left and right speakers on the display apparatus 200 are known, that is, the distance parameters of the left and right speakers are known parameters. Likewise, the mounting position of the microphone on the display device 200 is also known, i.e. the distance parameter of the microphone is a known parameter.

But currently, the display apparatus 200 is widely used in daily life in a scene of an external audio signal player or an external audio signal receiver. In an application scenario of sending out ultrasonic waves by using an external audio signal player or receiving ultrasonic waves by using an external audio signal receiver, the position of the external audio signal player is unknown or the position of the external audio signal receiver is unknown, so that the position relationship between the target object and the display device cannot be calculated, i.e. the target object cannot be positioned.

For example, if the principle in the schematic diagram shown in fig. 7 is applied to a scene where the display device 200 is externally connected to an audio system, if the speaker is an external device, the distance H between the speaker and the microphone is an unknown parameter, so that the distance between the target object and the display device 200 cannot be calculated. If the microphone is an external device, the distance H between the speaker and the microphone is also an unknown parameter, and thus the distance between the target object and the display device 200 cannot be calculated. If the speaker and the microphone are external devices, the distance H between the speaker and the microphone is also an unknown parameter, so that the distance between the target object and the display device 200 cannot be calculated. It can be seen that if the distance of the target object from the display device 200 is to be calculated, it is necessary to satisfy both the loudspeaker and the microphone as known parameters at the location of the display device.

In view of the above, some embodiments of the present application provide a display apparatus 200. In order to facilitate understanding of the technical solutions in some embodiments of the present application, the following details of each step are described with reference to some specific embodiments and the accompanying drawings. Fig. 9 is a flowchart illustrating a positioning method performed by the display device 200 according to an embodiment of the present application. Fig. 10 is a block diagram showing hardware connection of some functional modules of the display device 200 according to some embodiments of the present application. The ultrasonic positioning method provided by some embodiments of the present application is applied to the display device 200, and is used for identifying and positioning the target object in the detection area of the display device 200. The detection zone may be a detectable range zone of the ultrasound positioning device. For example, the detectable distance of the ultrasonic positioning device is 2 meters, and the detection area is a circular area with a radius of 2 meters and taking the center point of the display device 200 as the center.

The detection area may also be an artificially delimited area. For example, the detection area may be a distance range of 0.5 meters to 3 meters from the center of the display apparatus 200, and if the user's straight distance from the center of the display apparatus 200 is more than 0.5 meters and less than 3 meters, it means that the user is within the area, and the process of adjusting sound quality of the present application may be performed by detecting the positional relationship of the user and the display apparatus 200. Conversely, if the user is located at a linear distance of less than 0.5 meter or more than 3 meters from the center of the display apparatus 200, indicating that the user is not in the detection area, the process of adjusting sound quality of the present application may not be performed.

As shown in fig. 10, the functional modules of the display device 200 according to the embodiment of the present application mainly include: a controller 250, a power supply, a display 260, an audio signal player, an audio signal receiver, and a memory. The above-mentioned functional modules are merely modules described for the purpose of illustration, and are not intended to be all functional modules that implement the present application.

The controller 250 is a control and signal processing core of the whole display device 200, and is responsible for controlling the system operation of the whole display device 200, including receiving external image signals, decoding the image signals, processing the image quality and outputting the image signals; audio signal input, audio signal processing and audio signal output to the sound reproduction assembly, the backlight assembly is controlled to work, and the normal work of peripheral equipment or devices such as Wi-Fi, bluetooth, position detection assembly and the like is ensured.

The power supply is a power output module of the entire display apparatus 200, and provides power guarantee to all modules of the display apparatus 200. The memory is used for storing the signals detected by the detection device or data generated by the processor, for example, the memory can store the distance information and the angle information of the target object, and the stored distance information and angle information of the target object are used as historical record data for subsequent data analysis.

The audio signal player is used for receiving the echo signal reflected by the target object by transmitting ultrasonic waves to the detection area, and the target object in the detection area is the user in the detection area. The audio signal receiver reports the echo signals reflected by the target object to the controller, and the controller performs algorithm processing on the echo signals received by the audio signal receiver to calculate and obtain the position information of the target object.

The audio signal player and the audio signal receiver may belong to an audio playback system that is self-contained with the display device 200. The audio signal player and the audio signal receiver may also belong to an external audio player system. That is, the audio signal player and the audio signal receiver are one of an external device and a built-in device. And the audio signal player has a first distance parameter and the audio signal receiver has a second distance parameter. The distance parameter of the external equipment is an unknown parameter, and the distance parameter of the built-in equipment is a known parameter.

For example, the audio signal player may include a speaker that is self-contained with the display device 200, and the audio signal receiver may include a microphone that is self-contained with the display device 200. The audio signal player may further include an ultrasonic sound source device, and after the ultrasonic sound source device generates the ultrasonic audio signal, the ultrasonic sound source device transmits the generated ultrasonic audio signal to a speaker, and the speaker plays the ultrasonic audio signal. After the ultrasonic audio signal is reflected by the target object, the microphone collects the ultrasonic audio signal reflected by the target object, and then reports the collected ultrasonic audio signal to the controller 250.

The memory is used for storing parameters, such as the corresponding relation between the installation mode of the external device and the distance parameters.

It should be noted that, for convenience of explanation of the scheme, in the embodiment of the present application, the audio signal player, the audio signal receiver and the target object are considered to be on the same plane. Therefore, the distance of the target object from the display device 200 refers to a planar distance as well, that is, in the embodiment of the present application, the influence of the height between the target object and the display device 200 on the positioning result is not considered.

Based on the display device 200 in the above embodiment and the functional modules shown in fig. 10, as shown in fig. 9, the controller 250 in some embodiments of the present application is configured to perform the following steps S100 to S400, which are specifically as follows:

S100, if at least one external device exists in the audio signal player and the audio signal receiver, at least one of the first distance parameter and the second distance parameter is an unknown parameter, and a current device installation mode of the audio signal player and/or a current device installation mode of the audio signal receiver is obtained.

The audio signal player according to the present application is a device capable of emitting an ultrasonic audio signal, and as shown in the schematic diagram of fig. 11, the audio signal player includes at least an ultrasonic sound source and a speaker. The ultrasonic wave is an acoustic wave with the frequency higher than 20KHZ, has good directivity and strong penetrating power, and is easy to obtain more concentrated acoustic energy. The process of generating the ultrasonic audio signal by the ultrasonic sound source device can be as follows: the piezoelectric crystal in the ultrasonic sound source is placed in the probe, the frequency conversion alternating electric field is generated by the host machine, the direction of the electric field is consistent with the electric axis direction of the piezoelectric crystal, and the piezoelectric crystal can be strongly stretched and compressed in a certain direction in the alternating electric field due to the effect of electric oscillation, namely mechanical vibration, and ultrasonic audio signals can be generated by the mechanical vibration. The ultrasonic sound source transmits ultrasonic audio signals to the loudspeaker, and the loudspeaker can send out the ultrasonic audio signals.

After the ultrasonic audio signal is transmitted, it is reflected back to the direction in which the display device 200 is located via the target object (user a) and then collected by an audio signal receiver, which may include a microphone, i.e., the ultrasonic audio signal is collected by the microphone.

In the embodiment of the application, the ultrasonic audio signal sent by the audio signal player may be FMCW (Frequency Modulated Continuous Wave ). If the ultrasonic audio signal sent by the audio signal player is FMCW, the ultrasonic audio signal collected by the audio signal receiver is FMCW. The distance between the target object and the display device 200 can be calculated from the ultrasonic audio signal transmitted by the audio signal player and the ultrasonic audio signal collected by the audio signal receiver.

In the embodiment of the application, the audio signal player can be one of external equipment and built-in equipment, and the audio signal receiver can also be one of external equipment and built-in equipment. That is, the audio signal player may be an audio player in the audio system of the display apparatus 200, or may be an audio player externally connected to the display apparatus 200. For example, the display device 200 may be a speaker, or may be externally connected to a whispering gallery of the display device 200. It should be noted that the speaker portion may be included only in the external connection to the display device 200, and the ultrasonic sound source portion may still be provided in the display device. External to the display device 200 may include a speaker and an ultrasonic sound source. The application does not limit whether the ultrasonic sound source device belongs to external connection or internal connection, and if the audio signal player is external connection equipment, only ultrasonic audio signals are required to be sent by an external loudspeaker.

The audio signal receiver may be an audio acquisition device in the audio system of the display apparatus 200, or may be an audio acquisition device externally connected to the display apparatus 200. For example, the microphone may be built in the display device 200 or an external microphone. If the audio signal player is an external audio player, the positional relationship between the audio signal player and the display device 200 (refer to the host frame of the display device 200) is unknown, whereas if the audio signal player is a built-in audio player, the positional relationship between the audio signal player and the display device 200 is known (factory-determined data). If the audio signal receiver is an external audio acquisition device, the positional relationship between the audio signal receiver and the display apparatus 200 is unknown, whereas if the audio signal receiver is a built-in audio acquisition device, the positional relationship between the audio signal receiver and the display apparatus 200 is known.

For convenience of explanation, the distance between the audio signal player and the display apparatus 200 is referred to as a first distance parameter, and the distance between the audio signal receiver and the display apparatus 200 is referred to as a second distance parameter. Based on the above principle, if at least one external device exists in the audio signal player and the audio signal receiver, at least one of the first distance parameter and the second distance parameter is an unknown parameter.

Several situations are included here: the first case is that the audio signal player is an external device, the audio signal receiver is a built-in device, the corresponding first distance parameter is an unknown parameter, and the second distance parameter is a known parameter. The second case is that the audio signal player is an external device, the audio signal receiver is also an external device, the corresponding first distance parameter is an unknown parameter, and the second distance parameter is a position parameter. The third case is that the audio signal player is a built-in device, the audio signal receiver is an external device, the corresponding first distance parameter is a known parameter, and the second distance parameter is an unknown parameter.

If no external device exists in the audio signal player and the audio signal receiver, the audio signal player and the audio signal receiver are built-in devices, and the corresponding first distance parameter and the second distance parameter are known parameters.

If it is determined that at least one external device exists in the audio signal player and the audio signal receiver, a device installation mode of the audio signal player and the audio signal receiver, which is the external device, can be obtained. For example, if only the audio signal player is an external device, the current device installation mode of the audio signal player needs to be acquired, and the current device installation mode of the audio signal receiver which is the built-in device does not need to be acquired; if only the audio signal receiver is an external device, the current device installation mode of the audio signal receiver needs to be acquired, and the current device installation mode of the audio signal player which is the built-in device does not need to be acquired; if the audio signal player and the audio signal receiver are both external devices, the current device installation mode of the audio signal player and the audio signal receiver needs to be acquired.

The method for acquiring the current equipment installation mode of the audio signal player and the audio signal receiver can be as follows:

if an external audio signal player or audio signal receiver is detected, a selection dialog box is popped up on the display 260, based on which the user can select the device installation mode, and the current device installation mode of the audio signal player or audio signal receiver is acquired in response to the information input by the user.

The selection dialog may be in the form of a dialog box in the user interface schematic as shown in fig. 12, which dialog box shows several ways of installing the audio signal player: an upper installation mode, a left installation mode, a right installation mode and a lower installation mode. An "apply" button is also provided below each installation. The user can click the application button, a corresponding selection instruction is generated in response to the button selected by the user, and a corresponding equipment installation mode can be obtained according to the selection instruction.

For example, in the user interface shown in fig. 12, if the user selects the "application" button under the "upper installation mode", which indicates that the current installation mode of the audio signal player is selected by the user as the upper installation mode, the current installation mode of the device of the audio signal player is correspondingly acquired as the upper installation mode. If the user selects the application button in the left installation mode, the current installation mode of the audio signal player is selected as the left installation mode by the user, and the current equipment installation mode of the audio signal player is correspondingly acquired as the left installation mode. Also, if a device mounting manner of the audio signal receiver is required, the above manner may be adopted.

For example, in the user interface shown in fig. 13, a selection dialog of the audio signal player and a selection dialog of the audio signal receiver are simultaneously displayed. The user can select the current device mounting mode of the audio signal player and the current device mounting mode of the audio signal receiver simultaneously using the above-described modes. If the audio signal player and the audio signal receiver are both external devices, a selection dialog of the audio signal player and a selection dialog of the audio signal receiver are simultaneously displayed in the user interface. If only the audio signal player is an external device, only a selection dialog box of the audio signal player can be displayed, and a selection dialog box of the audio signal receiver is not displayed; the user interface shown in fig. 14 may also be displayed with the selection dialog of the audio signal player and the selection dialog of the audio signal receiver, but the selection dialog of the audio signal player is displayed normally (i.e., operable) and the selection dialog of the audio signal receiver is displayed grayed out (i.e., inoperable).

In some embodiments, a schematic diagram of the installation position corresponding to the installation mode of the device of the audio signal player or the audio signal receiver may also be displayed in the selection dialog box. For example, in the user interface shown in fig. 15, the "upper mounting manner" of the audio signal player is the position of the right upper frame of the display apparatus 200, the "left mounting manner" of the audio signal player is the position of the left frame of the display apparatus 200, the "right mounting manner" of the audio signal player is the position of the right frame of the display apparatus 200, and the "lower mounting manner" of the audio signal player is the position of the right lower frame of the display apparatus 200. Therefore, a user can install the audio signal player at the corresponding position in the diagram according to the installation position diagram, then select the corresponding equipment installation mode, and finally obtain the equipment installation mode to be matched with the actual equipment installation mode, so that inaccurate positioning of a target object caused by error acquisition of the installation mode is avoided.

For example, the user installs the audio signal player at the position in the drawing according to the installation position diagram of the "left installation mode", and then selects the "application" button under the "left installation mode", so that the acquired device installation mode "left installation mode" matches with the actual installation mode. The user installs the audio signal player at the position in the diagram according to the installation position diagram of the 'lower installation mode', and then selects the 'application' button under the 'lower installation mode', so that the acquired 'lower installation mode' of the equipment is matched with the actual installation mode.

In some embodiments, a plurality of external device interfaces may be disposed on the display apparatus 200, and if access information of the external device interfaces is detected and at least apparatus information of at least one of the audio signal player and the audio signal receiver is included in the access information, it may be determined that at least one external apparatus exists in the audio signal player and the audio signal receiver.

For example, as in the display apparatus 200 of fig. 16, an external device interface is mounted on the frame directly above, on the left side frame, on the right side frame, and on the frame directly below, and the external device interfaces are numbered A, B, C, D, respectively. If an external audio signal player establishes a connection with the display apparatus 200 through the external device interface a on the frame directly above, access information of the audio signal player can be detected from the external device interface a. Therefore, the audio signal player can be judged to be an external device. And because the access information of the audio signal player is detected from the external device interface a, it is possible to determine not only that the audio signal player is an external device, but also that the current device mounting manner of the audio signal player is an "upper mounting manner".

If an external audio signal player establishes a connection with the display apparatus 200 through the external device interface C on the right frame, access information of the audio signal player can be detected from the external device interface C. Therefore, the audio signal player can be judged to be an external device. And since the access information of the audio signal player is detected from the external device interface C, it is possible to determine not only that the audio signal player is an external device but also that the current device mounting manner of the audio signal player is the "right-side mounting manner". Therefore, the installation mode of the external equipment can be determined by detecting the access information of the equipment through the interface of the external device without selecting the installation mode of the equipment by a user.

It should be noted that if no access information is detected from the interface of the external device, it may be determined that the audio signal player and the audio signal receiver are both built-in devices, and the installation manner of the audio signal player and the audio signal receiver is not required to be determined, so that the known distance parameter may be directly used to locate the target object.

S200, according to the current equipment installation mode, searching a first distance parameter corresponding to the audio signal player and/or searching a second distance parameter corresponding to the audio signal receiver from the corresponding relation, wherein the corresponding relation is the relation between the equipment installation mode and the distance parameter.

According to the embodiment of the application, based on the fact that at least one external device exists in the audio signal player and the audio signal receiver, at least one of the first distance parameter and the second distance parameter is an unknown parameter, so that a device installation mode of the external device in the audio signal player and the audio signal receiver is required to be acquired. And searching a first distance parameter corresponding to the audio signal player, or searching a second distance parameter corresponding to the audio signal receiver, or searching the first distance parameter and the second distance parameter at the same time according to the acquired equipment installation mode and the corresponding relation. The corresponding relation is the relation between the equipment installation mode and the distance parameter. The correspondence may be one-to-one as shown in table 1.

TABLE 1 correspondence between device mounting means and distance parameters

The corresponding relation comprises a first corresponding sub-relation and a second corresponding sub-relation, wherein the first corresponding sub-relation is a corresponding relation applicable to the audio signal player, the second corresponding sub-relation is a corresponding relation applicable to the audio signal receiver, and the first corresponding sub-relation and the second corresponding sub-relation are different corresponding relations. The second row in table 1 is a first correspondence suitable for an audio signal player, and the third row in table 1 is a second correspondence suitable for an audio signal receiver.

In some embodiments, after searching for the first distance parameter corresponding to the audio signal player and/or the second distance parameter corresponding to the audio signal receiver from the correspondence, the first distance parameter and/or the second distance parameter may be adjusted in response to an input parameter adjustment instruction. Then positioning the target object according to the adjusted first distance parameter, the second distance parameter, the ultrasonic audio signal and the ultrasonic audio signal reflected by the target object; or positioning the target object according to the adjusted first distance parameter, the adjusted second distance parameter, the ultrasonic audio signal and the ultrasonic audio signal reflected by the target object; or positioning the target object according to the first distance parameter, the adjusted second distance parameter, the ultrasonic audio signal and the ultrasonic audio signal reflected by the target object.

The first distance parameter and the second distance parameter may be fixed values, or may be distance ranges, for example, X1 of the first distance parameter corresponds to a fixed value H1, or may correspond to a distance range H1 to H1±0.5. In the user interface diagram shown in fig. 17, an "adjust" button may be provided in the user interface, and if the user clicks the "adjust" button, an adjustment dialog box is flicked out in the selection dialog box as shown in fig. 18 in response to an operation input by the user. In the adjustment dialog shown in fig. 18, the distance parameter may be increased by clicking the up button in units of 0.1, or may be decreased by clicking the down button in units of 0.1. Thus, the user can make fine adjustments to the distance parameters of the audio signal player or the audio signal receiver using the adjustment dialog box.

In some embodiments, the distance parameter and the device installation manner may not be in a one-to-one correspondence, for example, if the audio signal receiver is built in the middle position of the display device 200, if the device installation manner of the audio signal player is "left frame" or "right frame", and when the audio signal player is externally connected to the two positions, the first distance parameter X2 is equal to the first distance parameter X3, that is, if the device installation manner of the audio signal player is "left frame" and the device installation manner of the audio signal player is "right frame" corresponds to the same distance parameter.

If the audio signal player is an external device, the installation mode of the audio signal receiver also needs to be considered, different corresponding relations are obtained according to the different installation modes of the audio signal receiver, and then corresponding second distance parameters are searched from the obtained corresponding relations.

For example, if the audio signal receiver is located at the position shown in fig. 19, the correspondence relationship of the device mounting manner of the audio signal player and the distance parameter may be as shown in table 1. In fig. 19, the audio signal player at the a position, the audio signal player at the B position, the audio signal player at the C position, and the audio signal player at the D position are different from the audio signal receiver, so that each of the audio signal players at the positions has a unique corresponding first distance parameter.

If the audio signal receiver is located at the position shown in fig. 20, the correspondence relationship may be as shown in table 2. In fig. 20, the audio signal player at the B position and the audio signal player at the C position are the same distance from the audio signal receiver, and thus the audio signal player at the B position and the audio signal player at the C position have the same first distance parameter. The distance between the audio signal player at the A position, the audio signal player at the D position and the audio signal players at other positions and the audio signal receiver is different, so that the audio signal player at the A position and the audio signal player at the D position have uniquely corresponding first distance parameters.

Similarly, if the audio signal player is a built-in device, the audio signal receiver is an external device, and the audio signal player is located at the E position shown in fig. 19, the correspondence between the second distance parameter and the device installation manner may be as shown in table 1. If the audio signal player is located at the E position shown in fig. 20, the correspondence relationship between the second distance parameter and the installation manner of the device may be as shown in table 2.

	Square frame	Left side frame	Right side frame	Lower square frame
					First distance parameter	X1	X2	X2	X4
Second distance parameter	Y1	Y2	Y2	Y4

TABLE 2 correspondence between device mounting means and distance parameters

The audio signal player and the audio signal receiver are external devices, and then the first distance parameter is required to be searched in the corresponding relation according to the device installation mode of the audio signal player, and the second distance parameter is required to be searched in the corresponding relation according to the device installation mode of the audio signal receiver. For example, as shown in fig. 21, an audio signal player is mounted as an external device on the frame directly above, and an audio signal receiver is also mounted as an external device on the frame directly above. From the correspondence of table 1, a first distance parameter corresponding to the audio signal player may be obtained as X1, and a second distance parameter corresponding to the audio signal receiver may be obtained as Y1. As shown in fig. 22, the audio signal player is mounted on the left side frame as an external device, and the audio signal receiver is mounted on the right side frame as an external device. From the correspondence of table 1, a first distance parameter corresponding to the audio signal player may be obtained as X2, and a second distance parameter corresponding to the audio signal receiver may be obtained as Y3.

And S300, positioning the target object according to the first distance parameter, the second distance parameter, the ultrasonic audio signal and the ultrasonic audio signal reflected by the target object.

Several situations are included here: if the audio signal player is external equipment and the audio signal receiver is built-in equipment, the first distance parameter is a distance parameter searched from the corresponding relation according to the equipment installation mode, and the second distance parameter is a known parameter; if the audio signal player is external equipment and the audio signal receiver is external equipment, the first distance parameter and the second distance parameter are distance parameters searched from the corresponding relation according to the equipment installation mode; if the audio signal player is built-in equipment and the audio signal receiver is external equipment, the first distance parameter is a known parameter, and the second distance parameter is a distance parameter searched from the corresponding relation according to the equipment installation mode; the audio signal player is a built-in device, and the audio signal receiver is a built-in device, and the first distance parameter are both known parameters.

The first distance parameter and the first distance parameter may take various forms, for example, the first distance parameter may be a vertical distance between the audio signal player and a central axis of the frame of the display device 200, and the second distance parameter may be a vertical distance between the audio signal receiver and a central axis of the frame of the display device 200; the first distance parameter may also be a straight line distance between the audio signal player and a center point of the display device 200, and the second distance parameter may also be a straight line distance between the audio signal receiver and a center point of the display device 200.

The distance between the ultrasonic wave and the round trip is calculated according to the ultrasonic audio signal sent by the audio signal player and the ultrasonic audio signal collected by the audio signal receiver, which can be realized by the steps shown in fig. 24 based on the principle in the difference frequency signal generation schematic diagram shown in fig. 23:

step S101: the ultrasonic speaker (i.e. the combination of the ultrasonic sound source and the speaker) transmits an ultrasonic audio signal, and the processor extracts the transmitted ultrasonic audio signal;

step S102: the audio signal receiver (i.e., microphone) collects ultrasonic audio signals reflected by the target object, as well as non-ultrasonic audio signals, which may include human voice or other noise. The audio sampling rate of the audio signal receiver can be set to be relatively high, for example to 48KHZ, so that the requirements for the low-pass filter can be correspondingly reduced.

In the process of performing echo cancellation on the audio signal acquired by the audio signal receiver, the following formula may be used for performing echo cancellation:

d(n)＝s(n)+x(n)

wherein d (n) is an audio signal collected by the audio signal receiver, s (n) is an ultrasonic audio signal collected, x (n) is an audio signal and noise of a frequency band below 20kHZ to be filtered, and the noise can be determined according to an ultrasonic audio signal e (n) played by the audio signal player. Thus, when the microphone also collects non-ultrasonic audio signals, the audio signal receiving area may further include a noise canceller, which cancels the non-ultrasonic audio signals collected by the microphone.

The filtered and denoised collected audio signal may also be filtered through a low pass filter. By means of the low-pass filter, the low-frequency signal can be retained, while the high-frequency signal is filtered, so that burrs and interference signals in the signal are further removed. The collected audio signal may also be subjected to FFT (Fast Fourier Transform ) to extract only the frequency spectrum of the audio signal for spectral analysis.

Step S103: according to the ultrasonic audio signal sent in the step S101 and the ultrasonic audio signal emitted by the target object and collected in the step S102, a difference frequency signal (namely, the frequency difference of the ultrasonic audio signal and the target object) is obtained, and the time T from sending the ultrasonic audio signal to receiving the reflected ultrasonic audio signal by the audio signal receiver according to the difference frequency signal is determined.

The principle of acquiring the frequency difference between the transmitted ultrasonic audio signal and the received reflected ultrasonic audio signal is shown in fig. 25. The audio signal player sends out an ultrasonic audio signal of 20kHZ, then reflects the ultrasonic audio signal of 20kHZ through the target object, and when the audio signal receiver receives the reflected ultrasonic audio signal of 20kHZ, the audio signal player sends out an ultrasonic audio signal of 23 kHZ. Therefore, the frequency difference between the transmitted ultrasonic audio signal and the received reflected ultrasonic audio signal is 3kHZ, and then according to the time difference T of the ultrasonic audio signals with different frequencies, the time t=3t from the transmission of the ultrasonic audio signal by the audio signal player to the reception of the reflected ultrasonic audio signal by the audio signal receiver is obtained.

Step S104: the distance 2l=st of ultrasonic wave round trip is obtained from the time T elapsed from the transmission of the ultrasonic wave audio signal by the audio signal player to the reception of the reflected ultrasonic wave audio signal by the audio signal receiver, and the speed S of ultrasonic wave propagation (i.e., sound propagation speed).

If the audio signal player is a built-in device and is placed in the lower left corner of the display device 200 as shown in fig. 26, the audio signal receiver is an external device and is connected to the display device 200 through the external device interface C as shown in fig. 26, the second distance parameter Y3 can be found from the correspondence in table 1. In order to simplify the calculation process, if the audio signal receiver is connected to the display apparatus 200 through the external device interface C, the audio signal receiver may be regarded as being mounted at the lower right corner of the display apparatus 200, and the second distance parameter Y3 and the known first distance parameter are both substantially perpendicular distances to the central axis of the display apparatus 200. The first distance parameter and the second distance parameter Y3 are thus known as the bottom edge length M of the frame of the display device 200. Based on the principle of calculating the vertical distance between the target object and the display apparatus 200 shown in fig. 7, the calculation formula of the vertical distance between the target object and the display apparatus 200 is as follows:

Wherein S is the propagation speed of ultrasonic wave, T is the time difference between the ultrasonic wave emitted by the loudspeaker and the ultrasonic wave reflected by the target object, and M is the distance between the audio signal player and the audio signal receiver.

If the audio signal player is a built-in device and is placed in the lower left corner of the display device 200 as shown in fig. 27, the audio signal receiver is an external device and is connected to the display device 200 through the external device interface a as shown in fig. 27, the second distance parameter Y1 can be found from the correspondence in table 1. In order to simplify the calculation process, if the audio signal receiver is connected to the display apparatus 200 through the external device interface a, the audio signal receiver may be regarded as being installed at the D position of the display apparatus 200, and the second distance parameter Y1 is actually zero. The distance between the audio signal player and the audio signal receiver is thus half the length of the lower edge of the frame of the display device 200, i.e. M/2. Based on the principle of calculating the vertical distance between the target object and the display apparatus 200 shown in fig. 7, the calculation formula of the vertical distance between the target object and the display apparatus 200 is as follows:

the above embodiments are all embodiments in which the audio signal player and the audio signal receiver are mounted on the frame of the display apparatus 200. In some embodiments, the audio signal player and the audio signal receiver may also not be mounted on the frame of the display device 200. For example, the whispering gallery as shown in fig. 28 is placed at a position below the display device 200. The embodiment of the present application may also set a corresponding distance parameter for a scene of an audio signal player that is not mounted on the frame of the display apparatus 200.

For example, the whispering gallery may be disposed above (disposed above the display device 200), below (disposed below the display device 200), or may be a 2.1 channel scheme (circumscribed by two audio signal players), and then distance parameters corresponding to the above whispering gallery scheme, the below whispering gallery scheme, and the 2.1 channel scheme are respectively built in the system. And when the accessed external audio signal player is detected, a selection dialog box is popped up for a user to select different external audio signal player schemes. Accordingly, the distance parameters corresponding to the different schemes are searched in the system, then, as shown in fig. 28, the unique position (at the a position instead of the B position) of the audio signal receiver on the wavefront is determined by using the searched distance parameters, and the positional relationship of the audio signal receiver and the audio signal player is determined according to the unique position, and finally, the positional relationship of the target object and the display device 200 is determined.

It should be noted that, if the external audio signal player is not mounted on the frame of the display device 200, the distance parameters corresponding to the audio signal player may specifically include: the vertical distance (height on the Y axis) between the audio signal player and the display device, the horizontal distance (spacing on the X axis) between the audio signal player and the display device, and the front-to-back distance (spacing on the Z axis) between the audio signal player and the display device can determine the relative positional relationship between the external audio signal player and the display device 200 in three-dimensional space according to the above three parameters.

In some embodiments, if the corresponding distance parameter is found from the corresponding relationship according to the current installation mode of the device, a notification of the error of the current installation mode may be displayed on the display 260. For example, the display apparatus 200 stores only the first distance parameters corresponding to the a position, the B position, the C position, and the D position of the audio signal player shown in fig. 19. If the audio signal player is installed at the a position, the B position, the C position, and the D position, the distance parameters corresponding to the four device installation modes are stored in the display device 200. However, if the audio signal player is installed at another location, the corresponding distance parameter is not obtained for the device installation mode stored at the other location in the display device 200. At this time, a notification message indicating that the installation mode is wrong may be displayed on the display 260. The user can reinstall the audio signal player according to the wrong alert information of the installation mode.

As shown in the flowchart of fig. 29, the following is a target object positioning workflow provided in an embodiment of the present application, where the workflow includes the following steps:

s3010: and receiving a sensing instruction input by a user through opening the intelligent sensing switch.

S3011: in response to the sensing instruction, it is determined whether the display device 200 is externally connected to a sound box. If the display device 200 is not externally connected with the sound box, and the built-in sound box plays sound (i.e. the built-in sound box sends out ultrasonic audio signals), step S3016 is performed; if the display device 200 is externally connected to the external speaker, and the external speaker plays the sound (i.e. the external speaker emits the ultrasonic audio signal), step S3012 is performed.

S3012: and popping up a selection dialog box for selecting the installation mode of the device on a user interface displayed on the display, wherein the selection dialog box comprises a lower whispering gallery, an upper whispering gallery, a 2.1-channel sound box and other schemes of the installation mode of the device.

S3013: and receiving a selection instruction input by a user in a selection dialog box, responding to the selection instruction, and if the selection instruction is an instruction generated after the user selects one of the equipment installation modes of the lower echo wall, the upper echo wall and the 2.1 sound channel sound box, performing step S3014. If the selection instruction is an instruction generated after the user selects "other scheme", step S3015 is performed.

S3014: according to the device installation mode corresponding to the selection instruction, the corresponding distance parameter is searched, the linear distance between the target object and the display device 200 is determined according to the searched distance parameter calculation data, and then step S3016 is executed. The intelligent sensing may be to adjust the volume according to the linear distance between the target object and the display device 200, or adjust the screen brightness or the screen image quality according to the linear distance between the target object and the display device 200.

S3015: the data cannot be extrapolated to determine the linear distance between the target object and the display device 200, disabling intelligent sensing. The prompt information can be popped up on the user interface, and the prompt information can be that the current sound box position is unknown and intelligent induction cannot be performed.

S3016: an intelligent sensing procedure (i.e., locating the target object based on the known distance parameter and the found distance parameter) is run.

The same and similar parts of the embodiments in this specification are referred to each other, and are not described herein.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied essentially or in parts contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods of the embodiments or parts of the embodiments of the present invention.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

a display configured to display a user interface;

An audio signal player configured to emit an ultrasonic audio signal;

the controller is configured to:

2. The display device according to claim 1, wherein if the audio signal player is an external device and the audio signal receiver is a built-in device, the controller is configured to, in accordance with a current device installation manner, find a first distance parameter corresponding to the audio signal player from a correspondence relation and/or find a second distance parameter corresponding to the audio signal receiver:

and searching the first distance parameter corresponding to the audio signal player from the corresponding relation according to the current equipment installation mode of the audio signal player.

3. The display device according to claim 1, wherein if the audio signal player is a built-in device and the audio signal receiver is an external device, the controller is configured to, in accordance with a current device installation manner, find a first distance parameter corresponding to the audio signal player from a correspondence relation and/or find a second distance parameter corresponding to the audio signal receiver:

And searching the second distance parameter corresponding to the audio signal receiver from the corresponding relation according to the current equipment installation mode of the audio signal receiver.

4. The display device according to claim 1, wherein if the audio signal player and the audio signal receiver are external devices, the controller is configured to, according to a current device installation manner, search for a first distance parameter corresponding to the audio signal player and/or search for a second distance parameter corresponding to the audio signal receiver from a correspondence relation:

according to the current equipment installation mode of the audio signal player, the first distance parameter corresponding to the audio signal player is searched from the corresponding relation, and according to the current equipment installation mode of the audio signal receiver, the second distance parameter corresponding to the audio signal receiver is searched from the corresponding relation.

5. The display device according to claim 1, wherein the correspondence includes a first correspondence and a second correspondence, the first correspondence being a correspondence suitable for the audio signal player, the second correspondence being a correspondence suitable for the audio signal receiver, the first correspondence and the second correspondence being different correspondences.

6. The display device according to claim 1, wherein the condition of finding the first distance parameter and/or the second distance parameter corresponding to the audio signal player and/or the audio signal receiver being an external device from the correspondence relation comprises: and the corresponding relation stores a first distance parameter corresponding to the current equipment installation mode of the audio signal player and/or a second distance parameter corresponding to the current equipment installation mode of the audio signal receiver.

7. The display device of claim 6, wherein the controller is further configured to:

and if the corresponding relation does not store the first distance parameter corresponding to the current equipment installation mode of the audio signal player and/or the second distance parameter corresponding to the current equipment installation mode of the audio signal receiver, controlling to display prompt information for prompting the error of the current installation mode on the display.

8. The display apparatus according to claim 1, further comprising an external device interface configured to connect to an external apparatus;

in determining that at least one external device exists in the audio signal player and the audio signal receiver, the controller is configured to:

Detecting access information of the external device interface;

and if the access information at least comprises equipment information of at least one equipment in the audio signal player and the audio signal receiver, determining that at least one external equipment exists in the audio signal player and the audio signal receiver.

9. The display device according to claim 1, wherein after finding a first distance parameter corresponding to the audio signal player and/or finding a second distance parameter corresponding to the audio signal receiver from the correspondence, the controller is configured to:

adjusting the first distance parameter and/or the second distance parameter in response to an input parameter adjustment instruction;

in locating the target object based on the first distance parameter, the second distance parameter, the ultrasonic audio signal, and the ultrasonic audio signal reflected by the target object, the controller is configured to:

positioning the target object according to the adjusted first distance parameter, the second distance parameter, the ultrasonic audio signal and the ultrasonic audio signal reflected by the target object;

Or positioning the target object according to the adjusted first distance parameter, the adjusted second distance parameter, the ultrasonic audio signal and the ultrasonic audio signal reflected by the target object;

or positioning the target object according to the first distance parameter, the adjusted second distance parameter, the ultrasonic audio signal and the ultrasonic audio signal reflected by the target object.

10. An ultrasonic positioning method, characterized by being applied to a controller of a display device, the display device further comprising an audio signal player configured to emit an ultrasonic audio signal; the system comprises an audio signal receiver, a display device and a display device, wherein the audio signal receiver is configured to receive an ultrasonic audio signal reflected by a target object, the audio signal player and the audio signal receiver are one of external equipment and built-in equipment, the audio signal player is provided with a first distance parameter, the audio signal receiver is provided with a second distance parameter, the distance parameter of the external equipment is an unknown parameter, and the distance parameter of the built-in equipment is a known parameter;

the ultrasonic positioning method comprises the following steps: