WO2020087748A1 - 一种音频设备定向显示方法、装置和音频设备 - Google Patents

一种音频设备定向显示方法、装置和音频设备 Download PDF

Info

Publication number
WO2020087748A1
WO2020087748A1 PCT/CN2018/125256 CN2018125256W WO2020087748A1 WO 2020087748 A1 WO2020087748 A1 WO 2020087748A1 CN 2018125256 W CN2018125256 W CN 2018125256W WO 2020087748 A1 WO2020087748 A1 WO 2020087748A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
display screen
projection
display
angle
Prior art date
Application number
PCT/CN2018/125256
Other languages
English (en)
French (fr)
Inventor
赵吉福
Original Assignee
歌尔股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歌尔股份有限公司 filed Critical 歌尔股份有限公司
Priority to US17/309,137 priority Critical patent/US11670200B2/en
Publication of WO2020087748A1 publication Critical patent/WO2020087748A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/002—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0261—Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/08—Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user

Definitions

  • the invention relates to an audio equipment directional display method, device and audio equipment.
  • Some smart multimedia devices on the market are mostly equipped with display screens.
  • the display screen can be used not only to display related information, but also to realize human-computer interaction control of smart speakers through a touch screen display.
  • the display direction of the display screen of the smart speaker is generally fixed, and cannot be adjusted in real time.
  • the user needs to move to the opposite side of the display or manually when viewing the display or performing touch operations. Moving the speaker box results in poor human-computer interaction and affects the user experience.
  • the invention provides a method, device and audio equipment for audio equipment directional display to solve the problem of poor human-computer interaction effect caused by the inability of the display screen to face the user accurately in the prior art solutions.
  • the audio device includes a camera module and a display screen distributed circumferentially on the side of the audio device.
  • the method of the present invention includes: in response to the acquired activation signal, activating the camera module Perform panoramic shooting to detect the user's position; when multiple users are detected, determine the display area of the display according to the positional relationship between the multiple users and the horizontal projection center position of the display; control the display area to display.
  • the camera module includes at least one panoramic camera or at least one group of binocular cameras or a spherical array of cameras with multiple cameras.
  • the horizontal projection center position of the display screen includes the center position of the projection circle formed by the projection of the display screen on the first plane.
  • starting the camera module to take a panoramic shot to detect the user's position includes: using the camera module to take continuous photos to obtain a panoramic image; according to the change of the position of the target in the panoramic image at different times relative to the background, determining the target in the panoramic image as the detection To the user; determine the projection angle of the user relative to the projection circle according to the user's position in the panoramic image and the proportional relationship between the length of the panoramic image and the circumference of the projection circle.
  • starting the camera module to take a panoramic shot to detect the user's position includes: using the camera module to take continuous photos to obtain a panoramic image; according to the change in the position of the user in the panoramic image at different times relative to the background, determining the user present in the panoramic image ; Determine the projection angle of the user relative to the projection circle according to the user's position in the panoramic image and the proportional relationship between the length of the panoramic image and the circumference of the projection circle.
  • the display area is determined according to the number of groups where multiple users are located and the location relationship between the groups, including: when multiple users are located in multiple groups, if the multiple groups are not adjacent to each other in position , Determine that the display area is full-screen display; if multiple groups are close to each other in position, determine the display area according to the horizontal projection center position of the display screen and the user's projection angle relative to the projection circle.
  • the display area is determined according to the horizontal projection center position of the display screen and the user's projection angle relative to the projection circle, including: grouping from small to large according to the arc length angle corresponding to the group Direction, sort the multiple groups where multiple users are located, the multiple groups where multiple users are located include the first group and the second group; when the second group is close to the first group in position relative to the direction of the group, the first The first connection between the user position corresponding to the smallest projection angle in the group and the horizontal projection center position of the display screen and the second connection between the user position corresponding to the largest projection angle and the horizontal projection center position of the display screen in the second group are on the horizontal plane
  • the first included angle is determined as the display area according to the arc area enclosed by the arcs corresponding to the upper and lower edges of the display screen according to the first included angle; when the second group is in a position opposite to the group direction When the first group is close to the first group, obtain the third connection between the user position corresponding to
  • the plurality of users include the first user, the second user, and the third user
  • determining the display area according to the number of groups where the plurality of users are located and the positional relationship between the groups including: when the first user, When the second user and the third user are in three groups, or when the first user, the second user, and the third user are in two groups, but the two groups where the three users are located are not adjacent to each other in position, Determine that the display area is full-screen; when the first user and the second user are in the first group and the third user is in the second group, if the second group is close to the first group in position relative to the direction of the group, the first user is acquired
  • the angle formed by the first connection between the user position corresponding to the projection circle and the horizontal projection center position of the display screen and the second connection between the user position corresponding to the projection circle and the horizontal projection center position of the display screen on the horizontal plane Is the first included angle, and the arc area enclosed by the arcs corresponding to the upper and lower edges of the display screen is
  • the angle formed by the four lines on the horizontal plane is the second angle, and the arc area enclosed by the arcs corresponding to the upper and lower edges of the display screen is determined as the display area according to the second angle; wherein, the first user The angle corresponding to the projection circle is smaller than the angle corresponding to the projection circle of the second user.
  • the display area is determined according to the number of groups where multiple users are located and the positional relationship between the groups, including: when multiple users are in the same group, acquiring the user position corresponding to the smallest projection angle and the display screen ’s position
  • the third angle formed by the fifth line of the horizontal projection center position and the user line corresponding to the largest projection angle and the sixth line of the horizontal projection center position of the display on the horizontal plane; corresponding to the upper and lower sides of the display according to the third angle
  • the arc area enclosed by the arc of the edge is determined as the display area.
  • determining the display area according to the number of groups where the plurality of users are located and the positional relationship between the groups including: when the first user and the second user When the users are in the same group, the seventh connection between the user position corresponding to the projection circle of the first user and the horizontal projection center position of the display screen and the user position corresponding to the projection circle of the second user and the horizontal projection center position of the display screen.
  • the eighth line forms an included angle on the horizontal plane as the fourth included angle, and the arc area enclosed by the arcs corresponding to the upper and lower edges of the display screen is determined as the display area according to the fourth included angle.
  • the directional display method of the present invention uses the camera module to detect the user's position.
  • the display area is determined according to the relationship between the multiple users and the center position of the display screen. By controlling this part of the display area for display, it is guaranteed The users are all in the display area of the audio device, enhancing the visual experience of the audio device when interacting with multiple people.
  • the audio device includes a camera module and a display screen distributed circumferentially on the side of the audio device.
  • the method of the present invention includes: in response to the acquired activation signal, activating the camera module Perform a panoramic shot to detect the user's position, which includes the user's direction indicated by the connection between the user's angular position relative to the projection circle and the horizontal projection center of the display screen; when a single user is detected, the user's The angle bisector of the set mapping angle determines the arc of the upper and lower edges corresponding to the mapping angle on the display screen; the arc area enclosed by the arc determines the display area of the display screen and controls the display area to display; wherein The horizontal projection center position of the display screen includes the center position of the projection circle formed by the projection of the display screen on the first plane.
  • the directional display method of the present invention uses the camera module to detect the user's position.
  • the display area is determined according to the user's direction and a preset mapping angle for directional display, so that the audio device can dynamically adjust in real time following the change of the user's position
  • the visual display area enhances the human-computer interaction effect and enhances the user experience.
  • the audio device includes a camera module and a display screen distributed circumferentially on the side of the audio device.
  • the device of the present invention includes: a first detection unit for responding to the acquisition The start signal of the camera module is started to perform panoramic shooting to detect the user's position; the first calculation unit is used to determine the position relationship between the multiple users and the horizontal projection center position of the display screen when multiple users are detected The display area of the display screen; the first control unit is used to control the display area for display.
  • the first detection unit in the directional display device of the present invention uses the camera module to detect the user position.
  • the display area is determined according to the relationship between the multiple users and the center position of the display screen.
  • a control unit controls the display area to perform display, so as to ensure that multiple users are all in the display area of the audio device, and improve the visual experience of the audio device when multiple people interact.
  • the audio device includes a camera module and a display screen distributed circumferentially on the side of the audio device.
  • the device of the present invention includes: a second detection unit for responding to the acquisition The start signal of the camera module is started to perform panoramic shooting to detect the user's position.
  • the user position includes the user's direction indicated by the connection between the angle position of the user relative to the projection circle and the center position of the horizontal projection surface of the display screen; the second calculation unit , Used to determine the arc of the upper and lower edges corresponding to the mapping angle on the display screen according to the angle bisector of the user ’s direction as the preset mapping angle when a single user is detected; the second control unit is used to use the circle
  • the arc-shaped area enclosed by the arc determines the display area of the display screen and controls the display area for display; wherein, the horizontal projection center position of the display screen includes the center position of the projection circle formed by the display screen projected on the first plane.
  • the second detection unit in the directional display device of the present invention uses a camera module to detect the user's position.
  • the display area is determined according to the user's direction and a preset mapping angle, and the second control unit controls the display The area is displayed, so that the audio device can dynamically adjust the visual display area in real time with the change of the user's position, enhance the human-computer interaction effect, and improve the user experience.
  • an audio device including: a camera module and a display screen circumferentially distributed on the side of the audio device, a processor, and a machine-readable storage medium storing machine-executable instructions.
  • the machine-executable instructions in the machine-readable storage medium are read and executed, and the processor can execute the aforementioned audio device directional display method.
  • Another aspect of the present invention provides a machine-readable storage medium that stores machine-executable instructions.
  • the machine-executable instructions are executed by a processor, the foregoing audio device directional display method is implemented.
  • FIG. 1 is a flowchart of a method for directional display of an audio device according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a spatial coordinate system established according to the horizontal projection center position of a display screen according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram showing that groups where three users are located are close to each other according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of panoramic images at different moments shown in an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of angles of three users relative to a projection circle in a panoramic image shown in an embodiment of the present invention
  • FIG. 6 is a schematic diagram of a display area according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram showing that groups where three users are located are not adjacent to each other, according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of angles of three users relative to a projection circle in a panoramic image shown in an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a display area according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram showing that two users are grouped together in an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of angles of two users relative to a projection circle shown in an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of a display area shown in an embodiment of the present invention.
  • FIG. 13 is a flowchart of an audio device directional display method according to an embodiment of the present invention.
  • FIG. 14 is a schematic diagram showing the angle of a single user relative to the projection circle according to an embodiment of the present invention.
  • 15 is a schematic diagram of the position of a single user on the circumference of the display screen in the panoramic image shown in an embodiment of the present invention.
  • 16 is a schematic diagram of a display area according to an embodiment of the present invention.
  • FIG. 17 is a schematic structural diagram of an audio device directional display device according to an embodiment of the present invention.
  • FIG. 18 is a schematic structural diagram of an audio device directional display device according to an embodiment of the present invention.
  • FIG. 19 is a structural block diagram of an audio device according to an embodiment of the present invention.
  • FIG. 20 is a schematic diagram of a system hardware structure according to an embodiment of the present invention.
  • the technology of the present invention may be implemented in the form of hardware and / or software (including firmware, microcode, etc.).
  • the technology of the present invention may take the form of a computer program product on a computer-readable medium storing instructions, which may be used by or in conjunction with an instruction execution system.
  • a computer-readable medium may be any medium capable of containing, storing, transmitting, propagating, or transmitting instructions.
  • computer-readable media may include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, devices, or propagation media.
  • Specific examples of computer-readable media include: magnetic storage devices such as magnetic tapes or hard disks (HDD); optical storage devices such as compact disks (CD-ROM); memories such as random access memory (RAM) or flash memory; and / or wired / Wireless communication link.
  • a method of the present invention provides an audio device directional display method suitable for multi-person interaction situations.
  • the audio device includes a camera module and a display screen distributed on the side of the audio device in a circle, and the projection of the display screen on the horizontal plane corresponds to a circle.
  • FIG. 1 is a flowchart of a method for directional display of an audio device according to an embodiment of the present invention. As shown in FIG. 1, the method in this embodiment includes:
  • S110 in response to the acquired start signal, start the camera module to perform panoramic shooting to detect the user's position.
  • the display area of the display screen is determined according to the positional relationship between the multiple users and the horizontal projection center position of the display screen.
  • the horizontal projection center position of the display screen includes the center position of the projection circle formed by the projection of the display screen on the first plane. It can be understood that the projection of the display screen on the first plane forms the circumference of the projection circle, and the horizontal projection of the display screen The center position is at the center of the circle.
  • This embodiment uses the camera module to detect the user's position.
  • the display area is determined according to the relationship between the multiple users and the center position of the display screen. By controlling this part of the display area for display, it is ensured that multiple users are in The display area of the audio device enhances the visual experience of the audio device when interacting with multiple people.
  • step S110 is executed, that is, in response to the acquired activation signal, the camera module is activated to perform panoramic shooting to detect the user's position.
  • the activation signal includes an electrical signal generated from a voice signal carrying a preset keyword, and the voice signal can be picked up by a microphone array in the audio device and converted into an electrical signal, and the voice signal carries the preset keyword
  • the detector array is activated according to the preset keywords carried.
  • the preset keyword includes "Xiaozhi”
  • the received voice signal is "hello, Xiaozhi”
  • the voice signal can be obtained by voice recognition carrying the preset keyword "Xiaozhi” which can be generated according to the voice signal
  • the electrical signal activates the camera module of the audio device to take a panoramic shot to detect the user's position.
  • the camera module includes at least one panoramic camera or at least one set of binocular cameras or a spherical array of cameras with multiple cameras to enable panoramic shooting to obtain panoramic images, and to detect the user's position based on the analysis of the panoramic images.
  • the start signal acquired in this embodiment may be a periodic signal.
  • the camera module is periodically started for panoramic shooting to detect the user's position. For example, after the camera module is started for the first panoramic shot, the camera mode is turned off, the captured panoramic image is used to detect the user's position, and the relationship between the user's position and the horizontal projection center position of the display is obtained based on The relationship between the horizontal projection center position and the display area of the display screen is determined for display.
  • the camera module is restarted for panoramic shooting, based on panoramic image analysis of user changes, based on user changes and user positions and The relationship between the horizontal projection center positions of the display screen determines the display area of the display screen for display.
  • the period of the start signal it is necessary to consider the power consumed by the camera module and the accuracy of the orientation of the display screen to track the user's position. For example, the period can be set to 5-20 minutes.
  • the user's position is detected in the following manner: First, the camera module is used to continuously take pictures to obtain a panoramic image; then, according to the position change of the target in the panoramic image at different times relative to the background, the target in the panoramic image is determined to be the detected user ; Then, according to the position of the user in the panoramic image and the proportional relationship between the length of the panoramic image and the circumference of the projection circle, determine the projection angle of the user relative to the projection circle.
  • the camera module continuously takes photos to compare photos at different moments, and analyzes whether there are users around the audio device and the number of users present.
  • the user is not absolutely stationary at any time, and the high-definition camera module can perfectly capture the user's movement.
  • targets A, B, and C are located in the space at the same time as the audio device.
  • two panoramic images at time t0 and t1 are obtained, and the position of the same target in the two panoramic images is changed by comparing The situation can determine whether the target is a user.
  • target A is located at position Ia0, at time t1, target A is located at position Ia1, it can be determined that there is a displacement difference ⁇ Ia between target A at times t0 and t1, indicating that at this time in the same background, Target A has moved, and target A is the user.
  • ⁇ Ia displacement difference between target A at times t0 and t1
  • target A is the user.
  • ⁇ Ib and ⁇ Ic there is a position difference between the targets B and C relative to the background of the panoramic image, and both targets B and C are detected users.
  • the projection angle of the user relative to the projection circle can be determined according to the proportional relationship between the length of the panoramic image and the circumference of the projection circle.
  • the circumference of the projection circle formed by the projection of the display screen on the first plane is a line segment with a certain length after expansion.
  • the length of the line segment and the length of the panoramic image in FIG. 4 are both L.
  • step S120 After detecting the position of the user, step S120 is continued, that is, when multiple users are detected, the display area of the display screen is determined according to the positional relationship between the multiple users and the horizontal projection center position of the display screen.
  • the horizontal projection center position of the display screen is preset to include the center position of the projection circle formed by the display screen projected on the first plane.
  • the display area of the display screen is determined in the following manner: First, multiple users are grouped according to the angle of the user with respect to the horizontal projection center position of the display screen, and each group corresponds to the arc length range of the set angle of the projection circle; The number of groups where multiple users are located and the positional relationship between the groups located determine the display area.
  • the display area is determined to be a full-screen display; if multiple groups are close to each other in position, according to the relative projection of the user
  • the angle of the circle and the horizontal projection center of the display screen determine the display area, that is, the grouping of multiple users is sorted according to the grouping direction of the arc length angle corresponding to the grouping from small to large.
  • the grouping includes the first grouping and the second grouping, when the second grouping is close to the first grouping in position relative to the grouping direction, the first connection between the user position corresponding to the smallest projection angle in the first grouping and the horizontal projection center position of the display screen is acquired
  • the arc area enclosed by the circular arc is determined to be the display area; when the second group is in a position opposite to the direction of the group near the first point in position ,
  • the second angle formed by the connecting line on the horizontal plane is determined as the display area according to the
  • the horizontal projection center position of the display screen is taken as the coordinate origin O
  • the vertical line in the space of the audio device is taken as the Z axis
  • the two straight lines on the first plane perpendicular to each other are taken as the X axis
  • this embodiment provides that the number 1234 in FIG. 2 is used to represent the four quadrants of the XOY plane, that is, the number 1 represents the first quadrant, the number 2 represents the second quadrant, the number 3 represents the third quadrant, and the number 4 is utilized Indicates the fourth quadrant.
  • This embodiment assumes that the arc length of the projection circle corresponding to each group is 90 °, that is, this embodiment assumes that there are four groups, and the group direction is set according to the direction of the arc length corresponding to the group from small to large, that is, this embodiment sets the group The direction is clockwise.
  • the grouping direction can also be set in other ways, which is not specifically limited.
  • the arc length range of the projection circle is 0 ⁇ 90 ° corresponding to a grouping range
  • the arc length range corresponding to the projection circle is 90 ° ⁇ 180 ° corresponding to a grouping range
  • the arc length range of the projection circle is 180 ° ⁇ 270 ° corresponding to a grouping range
  • the arc length range of the projection circle is 270 ° to 360 °, which corresponds to a grouping range.
  • the four groupings correspond to the first quadrant to the fourth quadrant on the XOY plane, respectively.
  • the display area is determined by any of the following three ways.
  • the first user, the second user, and the third user are in three groups respectively, or when the first user, the second user, and the third user are in two groups, but the two groups where the three users are located are in position When there is no proximity to each other, make sure that the display area is full screen.
  • the projection angle of the first user A to the projection circle is ⁇
  • the projection angle of the second user B to the projection circle is ⁇
  • the projection angle of the third user C to the projection circle is ⁇ , ⁇ ⁇ ⁇ .
  • the projection angle of the three users relative to the projection circle and the arc length range of the projection circle corresponding to each group it is determined that the first user A and the second user B are in the first group where the first quadrant is located, and the third user C is in the first In the second group where the three quadrants are located, since the second group and the first group are separated by one group, that is, the second group and the first group are not adjacent to each other in position, it is determined that the display area is full-screen display.
  • the groups where multiple users are located are not adjacent to each other in position. It should be understood that if any two groups are not adjacent to each other in position, the groups where the multiple users are located are not adjacent to each other in position. Assume that user A is in the first group, user B is in the second group, and user C is in the third group. Since the first group and the third group are separated by the second group in position, it is determined that the group where users A to C are located is in position There is no mutual proximity.
  • the user position and the corresponding projection circle of the first user are obtained
  • the angle formed between the first connection line of the horizontal projection center position of the display screen and the third user corresponding to the projection circle user position and the second connection line of the horizontal projection center position of the display screen on the horizontal plane is the first included angle, according to
  • the arc area enclosed by the arcs corresponding to the upper and lower edges of the display screen at the first included angle is determined as the display area; wherein, the angle corresponding to the projection circle of the first user is smaller than the angle corresponding to the projection circle of the second user.
  • the projection angle of the first user A to the projection circle is ⁇
  • the projection angle of the second user B to the projection circle is ⁇
  • the projection angle of the third user C to the projection circle is ⁇ , ⁇ ⁇ ⁇ .
  • the projection angle of the three users relative to the projection circle and the arc length range of the projection circle corresponding to each group it is determined that the first user A and the second user B are in the first group where the first quadrant is located, and the third user C is in the first In the second group where the two quadrants are located, since the second group is close to the first group in position relative to the direction of the group, that is, the second group is close to the first group relative to the clockwise direction, the user position of the projection circle corresponding to the first user A is obtained at this time
  • the first line L1 between A and the horizontal projection center position O of the display screen and the third user C correspond to the intersection formed by the user line C of the projection circle and the second line L2 of the horizontal projection center position O of the display screen on the horizontal plane
  • the arc area surrounded by the arcs AC and ED at the upper and lower edges of the display screen and the straight line AE and the straight line CD is determined as the display area according to the first included angle ⁇ , that is, the arc area ACDE Is the display area.
  • the corresponding projection circle of the second user is obtained.
  • the third line between the user position and the horizontal projection center position of the display screen and the third user's corresponding projection circle and the fourth line of the horizontal projection center position of the display screen form an angle formed on the horizontal plane as the second clip
  • the angle is determined as the display area according to the arc area enclosed by the arcs corresponding to the upper and lower edges of the display screen according to the second included angle; wherein the angle corresponding to the projection circle of the first user is smaller than the angle corresponding to the projection circle of the second user.
  • the second user B Since the second group is close to the first group in the position opposite to the direction of the group, that is, the second group is close to the first group in the counterclockwise direction, the second user B is acquired at this time
  • the fourth connection between the user position C of the projection circle and the horizontal projection center position O of the display screen is on the horizontal plane
  • the formed angle is the second included angle. According to the second included angle, the two arcs corresponding to the upper and lower edges of the display and the arc area enclosed by the two straight lines between the two arcs are determined as the display area .
  • the fifth position of the user with the smallest projection angle and the fifth position of the horizontal projection center of the display screen are obtained.
  • the third angle formed by the line connecting the user position with the largest projection angle and the sixth line of the horizontal projection center of the display on the horizontal plane, according to the third angle corresponding to the arc on the upper and lower edges of the display The formed arc area determines the display area.
  • multiple users include two users, a first user A and a second user B.
  • the positions of the first user A and the second user B relative to the audio device are shown in FIG. 10, based on panoramic images at different times.
  • two users are detected around the audio device.
  • the projection angle of the first user A to the projection circle is ⁇
  • the projection angle of the second user B to the projection circle is ⁇ , ⁇ ⁇ , according to the projection angles of the two users relative to the projection circle, and each The arc length range of the projection circle corresponding to the group determines that the first user A and the second user B are in the first group where the first quadrant is located.
  • the projection corresponding to the first user A is obtained at this time
  • the fifth line L5 of the circle user position A and the horizontal projection center position O of the display screen and the second user B correspond to the sixth line L6 of the projection circle user position B and the horizontal projection center position O of the display screen on the horizontal plane
  • the arc area surrounded by the arc AB, the arc FE on the upper and lower edges of the display screen and the straight line AF and the straight line BE according to the third included angle ⁇ is determined as the display area, that is, the arc area ABEF Is the display area.
  • step S130 that is, control the display area for display, which can be understood as controlling the display area to work.
  • the display area is full-screen display, as shown in FIG. 9, the entire display screen is in working state.
  • the display area is not full-screen display, the arc-shaped display area displays information and / or human-computer interaction through touch, and the rest of the display is in standby or Low power consumption mode.
  • a method of the present invention provides a directional display method for an audio device suitable for a single-person situation.
  • the audio device in this embodiment includes a camera module and a display screen distributed on the side of the audio device in a circle, and the projection of the display screen on the horizontal plane corresponds to a circle.
  • FIG. 13 is a flowchart of an audio device directional display method according to an embodiment of the present invention. As shown in FIG. 13, the method in this embodiment includes:
  • S1310 starts the camera module to perform panoramic shooting to detect the user's position.
  • the user position includes the user's direction indicated by the connection between the user's angle position relative to the projection circle and the horizontal projection center position of the display screen.
  • the horizontal projection center position of the display screen includes the position of the center of the projection circle formed by the projection of the display screen on the first plane.
  • the arc of the upper and lower edges corresponding to the mapping angle on the display screen is determined according to the angle bisector using the user's direction as the preset mapping angle.
  • 1330 uses the arc area enclosed by the arc to determine the display area of the display screen, and controls the display area to display.
  • the directional display method of this embodiment uses a camera module to detect the user's position.
  • the display area is determined according to the user's direction and a predetermined mapping angle for directional display, so that the audio device can follow the changes in the user's position in real time and dynamically Adjust the visual display area, enhance the human-computer interaction effect, and enhance the user experience.
  • the user direction of user A is the user direction indicated by the line L7 between the angular position A of user A relative to the projection circle and the horizontal projection center position O of the display screen.
  • the preset angle is ⁇
  • the angle bisector with the connection line L7 as the mapping angle ⁇ determines the arc of the upper and lower edges of the mapping angle ⁇ on the display screen Respectively, arc ML and arc NI, then arc area MLIN enclosed by arc ML and arc NI and the straight line MN and straight line LI between the two arcs is determined as the display area.
  • a method of the present invention provides a directional display device for audio equipment suitable for multi-person interaction.
  • the audio device includes a camera module and a display screen distributed circumferentially on the side of the audio device.
  • FIG. 17 is a schematic structural diagram of an audio device directional display device according to an embodiment of the present invention. As shown in FIG. 17, the device in this embodiment includes:
  • the first detection unit 171 is configured to start the camera module to take a panoramic shot in response to the acquired start signal to detect the user position;
  • the first calculation unit 172 is used to determine the display area of the display screen according to the positional relationship between the multiple users and the horizontal projection center position of the display screen when multiple users are detected;
  • the first control unit 173 is used to control the display area for display.
  • the horizontal projection center position of the display screen in this embodiment includes the position of the center of the projection circle formed by the projection of the display screen on the first plane.
  • the first detection unit in the directional display device of this embodiment uses the camera module to detect the user position.
  • the display area is determined according to the relationship between the multiple users and the center position of the display screen.
  • the first control unit controls the part of the display area for display to ensure that multiple users are all within the display area of the audio device, thereby improving the visual experience of the audio device during multi-person interaction.
  • the first detection unit 171 is used to continuously take pictures using the camera module to obtain a panoramic image; according to the change of the position of the target in the panoramic image at different times relative to the background, the target in the panoramic image is determined to be the detected user ; Determine the projection angle of the user relative to the projection circle according to the user's position in the panoramic image and the proportional relationship between the length of the panoramic image and the circumference of the projection circle.
  • the first calculation unit 172 is used to group multiple users according to the projection angle of the user relative to the projection circle, and each group corresponds to the arc length range of the angle set by the projection circle; according to the number and location of the multiple users The positional relationship between the groups determines the display area.
  • the first calculation unit 172 is used for multiple groups where multiple users are located. If the multiple groups are not adjacent to each other in position, the display area is determined to be a full-screen display; if the multiple groups are between The positions are close to each other, and the display area is determined according to the horizontal projection center position of the display screen and the projection angle of the user relative to the projection circle; that is, according to the grouping direction of the arc length angle corresponding to the grouping, from small to large, many users are located Sort by groups, and the multiple groups where multiple users are located include the first group and the second group; when the second group is close to the first group relative to the direction of the group, the position of the user with the smallest projection angle in the first group is obtained The first angle formed by the first connection line with the horizontal projection center position of the display screen and the second group corresponding to the user with the largest projection angle and the second connection line with the horizontal projection center position of the display screen on the horizontal plane, according to The arc area enclosed by the arcs corresponding to the upper and lower edges of
  • the first calculation unit 172 is specifically used when multiple users include a first user, a second user, and a third user, and the first user, the second user, and the third user are in three groups, respectively, or the first user, the third user
  • the second user and the third user are in two groups, but when the two groups where the three users are located are not adjacent to each other, the display area is determined to be full-screen display; when the first user and the second user are in the first group, the first When three users are in the second group,
  • the second group is close to the first group in position relative to the direction of the group, obtain the first connection between the user's position corresponding to the projection circle and the horizontal projection center of the display screen and the user's position and display corresponding to the third user's projection circle
  • the angle formed by the second line of the horizontal projection center of the screen on the horizontal plane is the first angle
  • the arc area surrounded by the arcs on the upper and lower edges of the display screen is determined as the display area according to the first angle ;
  • the reverse direction of the second group relative to the direction of the group is close to the first group in position, obtain a third connection line between the user's position corresponding to the projection circle and the horizontal projection center position of the display screen and the user corresponding to the third circle's projection circle
  • the angle formed by the fourth line between the position and the horizontal projection center position of the display screen on the horizontal plane is the second included angle, which is determined according to the arc area surrounded by the arcs on the upper and lower edges of the display screen according to the second included angle Is a display area; wherein, the angle of the first user corresponding to the projection circle is smaller than the angle of the second user corresponding to the projection circle.
  • the first calculation unit 172 is used to obtain a fifth line corresponding to the position of the user with the smallest projection angle and the horizontal projection center position of the display screen and the largest corresponding projection angle when multiple users are in the same group
  • the third angle formed by the sixth line between the user ’s position and the horizontal projection center of the display screen on the horizontal plane, and the arc area enclosed by the arcs on the upper and lower edges of the display screen is determined as the display according to the third angle region.
  • the first calculation unit 172 is specifically configured to obtain the user position corresponding to the projection circle of the first user and the level of the display screen when multiple users include the first user and the second user, and the first user and the second user are in the same group
  • the angle formed by the fifth line of the projection center position and the second user corresponding to the projection circle's user position and the sixth line of the horizontal projection center position of the display screen on the horizontal plane is the third angle, according to the third angle
  • the arc area enclosed by the arcs on the upper and lower edges of the display screen is determined as the display area.
  • An apparatus of the present invention provides an audio equipment directional display apparatus suitable for a single-person situation.
  • the audio device in this embodiment includes a camera module and a display screen distributed on the side of the audio device in a circle, and the projection of the display screen on the horizontal plane corresponds to a circle.
  • FIG. 18 is a schematic structural diagram of an audio device directional display device according to an embodiment of the present invention. As shown in FIG. 18, the device in this embodiment includes:
  • the second detection unit 181 is configured to start the camera module to take a panoramic shot to detect the user position in response to the acquired start signal, and the user position includes the angle position of the user relative to the projection circle and the center position of the horizontal projection surface of the display screen The user's direction indicated by the connection of
  • the second calculation unit 182 is used to determine the arc of the upper and lower edges of the corresponding mapping angle on the display screen according to the angle bisector with the user direction as the preset mapping angle when a single user is detected;
  • the second control unit 183 is used to determine the display area of the display screen by using the arc area enclosed by the arc, and control the display area to display;
  • the horizontal projection center position of the display screen includes the position of the center of the projection circle formed by the projection of the display screen on the first plane.
  • the second detection unit in the directional display device of this embodiment uses the camera module to detect the user's position.
  • the display area is determined according to the user's direction and a preset mapping angle, and the second control unit controls The display area is displayed, so that the audio device can dynamically adjust the visual display area in real time in accordance with the change of the user's position, enhance the human-computer interaction effect, and improve the user experience.
  • the relevant parts can be referred to the description of the method embodiments.
  • the device embodiments described above are only schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located One place, or can be distributed to multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement without paying creative labor.
  • Another aspect of the invention provides an audio device.
  • the audio device includes: a camera module and a display screen distributed circumferentially on the side of the audio device, and further includes a processor and machine executable instructions stored therein
  • the machine-readable storage medium by reading and executing the machine-executable instructions in the machine-readable storage medium, the processor can execute the audio device directional display method described above.
  • Another aspect of the invention provides a system.
  • the system provided by this application may be implemented by software, or by hardware or a combination of hardware and software.
  • the system provided by the present application may include a processor 1801 and a machine-readable storage medium 2002 storing machine-executable instructions.
  • the processor 2001 and the machine-readable storage medium 2002 can communicate via a system bus 2003. And, by reading and executing machine executable instructions corresponding to the audio device directional display logic in the machine-readable storage medium 2002, the processor 2001 can execute the audio device directional display method described above.
  • Another aspect of the invention provides a machine-readable storage medium.
  • a machine-readable storage medium stores machine-executable instructions.
  • the audio device directional display method described above is implemented.
  • readable storage medium of the embodiment of the present invention may be any medium capable of containing, storing, transmitting, propagating, or transmitting instructions.
  • readable storage media may include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, devices, or propagation media.
  • Specific examples of readable storage media include: magnetic storage devices such as magnetic tapes or hard disks (HDD); optical storage devices such as compact disks (CD-ROM); memories such as random access memory (RAM) or flash memory; and / or wired / Wireless communication link.
  • the machine-readable storage medium may include a computer program, and the computer program may include code / computer-executable instructions, which when executed by the processor, cause the processor to perform, for example, the audio device directional display method flow described above and any variations thereof.
  • the computer program may be configured to have, for example, computer program code including computer program modules.
  • the code in the computer program may include one or more program modules. It should be noted that the division mode and number of modules are not fixed, and those skilled in the art may use appropriate program modules or program module combinations according to actual conditions.
  • the processor may execute, for example The flow of the audio device directional display method described above and any variations thereof.
  • the words “first” and “second” are used to distinguish the same or similar items with basically the same functions and functions. Personnel can understand that the words “first” and “second” do not limit the number and execution order.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

本发明公开一种音频设备定向显示方法、装置和音频设备。音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，本发明的方法包括：响应于获取的启动信号，启动摄像头模组进行全景拍摄以检测用户位置；在检测到多个用户时，根据多个用户与显示屏的水平投射中心位置之间的位置关系，确定显示屏的显示区域；控制显示区域进行显示。本发明利用摄像头模组检测到多个用户的用户位置时，根据多个用户与显示屏的水平投射中心位置之间的关系确定显示区域，通过控制该部分显示区域进行显示，保证多用户都处于音频设备的显示区域内，提升音频设备多人交互时的视觉体验。

Description

一种音频设备定向显示方法、装置和音频设备
本申请要求于2018年10月29日提交中国专利局、申请号为201811270177.8、发明名称为“一种音频设备定向显示方法、装置和音频设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及一种音频设备定向显示方法、装置和音频设备。
背景技术
随着生活水平的提高，智能家居越来越多的出现在人们的日常生活中，而智能音箱作为其中的一类产品广受大众欢迎。市场上的一些智能多媒体设备大多设置有显示屏，显示屏不仅可以用于显示相关信息，还可以通过触控显示屏实现智能音箱的人机交互控制。
目前，智能音箱的显示屏的显示方向一般是固定的，不能实时调整，以实时跟踪用户进行定向显示，使得用户在观看显示屏或者进行触控操作时，都需要移动至显示屏的对面或手动对音箱进行移动，导致人机交互效果差，影响用户体验。
发明内容
本发明提供了一种音频设备定向显示方法、装置和音频设备，以解决现有技术方案中显示屏无法精准朝向用户导致人机交互效果差的问题。
本发明的一个方面提供了一种音频设备定向显示方法，音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，本发明的方法包括：响应于获取的启动信号，启动摄像头模组进行全景拍摄以检测用户位置；在检测到多个用户时，根据多个用户与显示屏的水平投射中心位置之间的位置关系，确定显示屏的显示区域；控制显示区域进行显示。
优选地，摄像头模组包括至少一个全景摄像头或至少一组双目摄像头或具有多个摄像头的摄像头球形阵列。
优选地，显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的投影圆的圆心位置。
优选地，启动摄像头模组进行全景拍摄以检测用户位置，包括：利用摄像头模组进行连续拍照，获取全景图像；根据不同时刻的全景图像中目标相对背景的位置变化，确定全景图像中目标为检测到的用户；根据用户在全景图像中的位置，以及全景图像的长度与所述投影圆的圆周长之间的比例关系，确定用户相对投影圆的投影角度。
优选地，启动摄像头模组进行全景拍摄以检测用户位置，包括：利用摄像头模组进行连续拍照，获取全景图像；根据不同时刻的全景图像中用户相对背景的位置变化，确定全景图像中存在的用户；根据用户在全景图像中的位置，以及全景图像的长度与投影圆的圆周长之间的比例关系，确定用户相对投影圆的投影角度。
优选地，根据多个用户所在分组的个数和所在分组之间的位置关系，确定显示区域，包括：当多个用户所在的多个分组中，若多个分组之间在位置上没有相互临近，确定显示区域为全屏显示；若多个分组之间在位置上相互临近，根据显示屏的水平投射中心位置和用户相对投影圆的投影角度确定显示区域。
优选地，若多个分组之间在位置上相互临近，根据显示屏的水平投射中心位置和用户相对投影圆的投影角度确定显示区域，包括：按照分组对应的弧长角度由小到大的分组方向，对多个用户所在的多个分组进行排序，多个用户所在的多个分组包括第一分组和第二分组；当第二分组相对分组方向在位置上临近第一分组时，获取第一分组中对应投影角度最小的用户位置与显示屏的水平投射中心位置的第一连线和第二分组中对应投影角度最大的用户位置与显示屏的水平投射中心位置的第二连线在水平面上所形成的第一夹角，根据第一夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为所述显示区域；当第二分组相对所述分组方向的逆方向在位置上临近第一分组时，获取第一分组中对应投影角度最大的用户位置与显示屏的水平投射中心位置的第三连线和第二分组中对应投影角度最小的用户位置与显示屏的水平投射中心位置的第四连线在水平面上所形成的第二夹角，根据第二夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域。
优选地，当多个用户包括第一用户、第二用户和第三用户时，根据多个用户所在分组的个数和所在分组之间的位置关系，确定显示区域，包括：当第一用户、第二用户和第三用户分别在三个分组中时，或者当第一用户、第二用户和第三用户处于两个分组，但三个用户所在的两个分组在位置上没有相互临近时，确定显示区域为全屏显示；当第一用户与第二用户在第一分组中，第三用户在第二分组中时，若第二分组相对分组方向在位置上临近第一分组，获取第一用户对应投影圆的用户位置与显示屏的水平投射中心位置的第一连线和第三用户对应投影圆的用户位置与显示屏的水平投射中心位置的第二连线在水平面上所形成的夹角为第一夹角，根据第一夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域；若第二分组相对分组方向的逆方向在位置上临近第一分组，获取第二用户对应投影圆的用户位置与显示屏的水平投射中心位置的第三连线和第三用户对应投影圆的用户位置与显示屏的水平投射中心位置的第四连线在水平面上所形成的夹角为所述第二 夹角，根据第二夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域；其中，第一用户对应投影圆的角度小于第二用户对应投影圆的角度。优选地，根据多个用户所在分组的个数和所在分组之间的位置关系，确定显示区域，包括：当多个用户在同一个分组中时，获取对应投影角度最小的用户位置与显示屏的水平投射中心位置的第五连线和对应投影角度最大的用户位置与显示屏的水平投射中心位置的第六连线在水平面上形成的第三夹角；根据第三夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域。
优选地，当多个用户包括第一用户和第二用户时，根据所述多个用户所在分组的个数和所在分组之间的位置关系，确定显示区域，包括：当第一用户和第二用户在同一个分组中时，获取第一用户对应投影圆的用户位置与显示屏的水平投射中心位置的第七连线和第二用户对应投影圆的用户位置与显示屏的水平投射中心位置的第八连线在水平面上形成夹角为第四夹角，根据第四夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域。
本发明的定向显示方法利用摄像头模组检测用户位置，当检测到多个用户时，根据多个用户与显示屏中心位置之间的关系确定显示区域，通过控制该部分显示区域进行显示，保证多用户都处于音频设备的显示区域内，提升音频设备多人交互时的视觉体验。
本发明的一个方面提供了一种音频设备定向显示方法，音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，本发明的方法包括：响应于获取的启动信号，启动摄像头模组进行全景拍摄以检测用户位置，用户位置包括用户相对投影圆的角度位置与显示屏的水平投射中心位置之间的连线所指示的用户方向；在检测到单个用户时，根据将用户方向作为预先设定的映射角度的角平分线，确定映射角度在所述显示屏上对应的上下边缘的圆弧；利用圆弧围成的弧形区域确定显示屏的显示区域，控制显示区域进行显示；其中，显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的投影圆的圆心位置。
本发明的定向显示方法利用摄像头模组检测用户位置，当检测到单个用户时，根据用户方向与预先设定的映射角度确定显示区域进行定向显示，使音频设备能够跟随用户位置的变化实时动态调整可视显示区域，加强人机交互效果，提升用户体验。
本发明的另一个方面提供了一种音频设备定向显示装置，音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，本发明的装置包括：第一检测单元，用于响应于获取的启动信号，启动摄像头模组进行全景拍摄以检测用户位置；第一计算单元，用于在检测到多个用户时，根据多个用户与显示屏的水平投射中心位置之间的位置关系，确定显示屏的显示区域；第一 控制单元，用于控制显示区域进行显示。
本发明定向显示装置中的第一检测单元利用摄像头模组检测用户位置，当第一计算单元确定检测到多个用户时，根据多个用户与显示屏中心位置之间的关系确定显示区域，第一控制单元通过控制该部分显示区域进行显示，保证多用户都处于音频设备的显示区域内，提升音频设备多人交互时的视觉体验。
本发明的另一个方面提供了一种音频设备定向显示装置，音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，本发明的装置包括：第二检测单元，用于响应于获取的启动信号，启动摄像头模组进行全景拍摄以检测用户位置，用户位置包括用户相对投影圆的角度位置与显示屏的水平投射面中心位置之间的连线所指示的用户方向；第二计算单元，用于在检测到单个用户时，根据将用户方向作为预先设定的映射角度的角平分线，确定映射角度在显示屏上对应的上下边缘的圆弧；第二控制单元，用于利用圆弧围成的弧形区域确定显示屏的显示区域，控制显示区域进行显示；其中，显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的投影圆的圆心位置。
本发明定向显示装置中的第二检测单元利用摄像头模组检测用户位置，当第二计算单元检测到单个用户时，根据用户方向与预先设定的映射角度确定显示区域，第二控制单元控制显示区域进行显示，使音频设备能够跟随用户位置的变化实时动态调整可视显示区域，加强人机交互效果，提升用户体验。
本发明的另一个方面提供了一种音频设备，包括：包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，还包括处理器和存储有机器可执行指令的机器可读存储介质，通过读取并执行机器可读存储介质中的机器可执行指令，处理器可执行前述的音频设备定向显示方法。
本发明的另一个方面提供了一种机器可读存储介质，存储有机器可执行指令，机器可执行指令被处理器执行时以实现前述音频设备定向显示方法。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一部分附图，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据提供的附图获得其他的附图。
图1为本发明实施例示出的音频设备定向显示方法的流程图；
图2为本发明实施例示出的根据显示屏的水平投射中心位置建立的空间坐标系示意图；
图3为本发明实施例示出的三用户所在分组相互临近的示意图；
图4为本发明实施例示出的不同时刻的全景图像示意图；
图5为本发明实施例示出的全景图像中三用户相对投影圆的角度示意图；
图6为本发明实施例示出的显示区域示意图；
图7为本发明实施例示出的三用户所在分组没有相互临近的示意图；
图8为本发明实施例示出的全景图像中三用户相对投影圆的角度示意图；
图9为本发明实施例示出的显示区域示意图；
图10为本发明实施例示出的两个用户同在一个分组的示意图；
图11为本发明实施例示出的两个用户相对投影圆的角度示意图；
图12为本发明实施例示出的显示区域示意图；
图13为本发明实施例示出的音频设备定向显示方法的流程图；
图14为本发明实施例示出的单个用户相对投影圆的角度示意图；
图15为本发明实施例示出的全景图像中单个用户在显示屏圆周的位置示意图；
图16为本发明实施例示出的显示区域示意图；
图17为本发明实施例示出的音频设备定向显示装置的结构示意图；
图18为本发明实施例示出的音频设备定向显示装置的结构示意图；
图19为本发明实施例示出的音频设备的结构框图；
图20为本发明实施例示出的系统硬件结构示意图。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚，下面将结合附图对本发明实施方式作进一步地详细描述。
以下，将参照附图来描述本发明的实施例。但是应该理解，这些描述只是示例性的，而并非要限制本发明的范围。此外，在以下说明中，省略了对公知结构和技术的描述，以避免不必要地混淆本发明的概念。
在此使用的术语仅仅是为了描述具体实施例，而并非意在限制本发明。这里使用的词语“一”、“一个(种)”和“该”等也应包括“多个”、“多种”的意思，除非上下文另外明确指出。此外，在此使用的术语“包括”、“包含”等表明了所述特征、步骤、操作和/或部件的存在，但是并不排除存在或添加一个或多个其他特征、步骤、操作或部件。
在此使用的所有术语(包括技术和科学术语)具有本领域技术人员通常所理解的含义，除非另外定义。应注意，这里使用的术语应解释为具有与本说明书的上下文相一致的含义，而不应以理想化或过于刻板的方式来解释。
附图中示出了一些方框图和/或流程图。应理解，方框图和/或流程图中的 一些方框或其组合可以由计算机程序指令来实现。这些计算机程序指令可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器，从而这些指令在由该处理器执行时可以创建用于实现这些方框图和/或流程图中所说明的功能/操作的装置。
因此，本发明的技术可以硬件和/或软件(包括固件、微代码等)的形式来实现。另外，本发明的技术可以采取存储有指令的计算机可读介质上的计算机程序产品的形式，该计算机程序产品可供指令执行系统使用或者结合指令执行系统使用。在本发明的上下文中，计算机可读介质可以是能够包含、存储、传送、传播或传输指令的任意介质。例如，计算机可读介质可以包括但不限于电、磁、光、电磁、红外或半导体系统、装置、器件或传播介质。计算机可读介质的具体示例包括：磁存储装置，如磁带或硬盘(HDD)；光存储装置，如光盘(CD-ROM)；存储器，如随机存取存储器(RAM)或闪存；和/或有线/无线通信链路。
本发明的一个方法提供了一种适用多人交互情况的音频设备定向显示方法。
在本实施例中，音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，显示屏在水平面上的投影对应为圆周。
图1为本发明实施例示出的音频设备定向显示方法的流程图，如图1所示，本实施例的方法包括：
S110，响应于获取的启动信号，启动摄像头模组进行全景拍摄以检测用户位置。
S120，在检测到多个用户时，根据多个用户与显示屏的水平投射中心位置之间的位置关系，确定显示屏的显示区域。
其中，显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的投影圆的圆心位置，可以理解的是，显示屏在第一平面上投影形成投影圆的圆周，显示屏的水平投射中心位置位于该圆周的圆心位置上。
S130，控制显示区域进行显示。
本实施例利用摄像头模组检测用户位置，当检测到多个用户时，根据多个用户与显示屏中心位置之间的关系确定显示区域，通过控制该部分显示区域进行显示，保证多用户都处于音频设备的显示区域内，提升音频设备多人交互时的视觉体验。
以下结合图2-15对上述步骤S110-S130进行详细的说明。
首先，执行步骤S110，即响应于获取的启动信号，启动摄像头模组进行全景拍摄以检测用户位置。
在实施例中，启动信号包括根据携带预设关键词的语音信号生成的电信号，可以通过音频设备中的麦克风阵列拾取语音信号并将语音信号转换为电 信号，在语音信号携带预设关键词时，根据所携带的预设关键词启动检测器阵列。例如，预设关键词包括“小智”，所接收的语音信号为“hello，小智”，通过语音识别可以得到语音信号携带预设关键词“小智”，此时可以根据由语音信号生成的电信号启动音频设备摄像头模组进行全景拍摄来检测用户位置。其中，摄像头模组包括至少一个全景摄像头或至少一组双目摄像头或具有多个摄像头的摄像头球形阵列，以能够进行全景拍摄，获得全景图像，基于对全景图像的分析检测用户位置。
本实施例中获取的启动信号可以为周期性信号，按照启动信号的周期特性，周期性启动摄像头模组进行全景拍摄以检测用户位置。例如，在首次启动摄像头模组进行全景拍摄后关闭摄像头模式，利用拍摄得到的全景图像检测用户位置，并获得用户位置与显示屏的水平投射中心位置之间的关系，基于用户位置与显示屏的水平投射中心位置之间的关系确定显示屏的显示区域以进行显示之后，在下个周期节点时，重新启动摄像头模组进行全景拍摄，基于全景图像分析用户变化情况，基于用户变换情况和用户位置与显示屏的水平投射中心位置之间的关系确定显示屏的显示区域以进行显示。在设置启动信号的周期时，需要考虑摄像头模组耗用的电能以及显示屏定向跟踪用户位置的准确性，例如周期可以设定为5-20分钟。
本实施例通过下述方式检测用户位置：首先利用摄像头模组进行连续拍照，获取全景图像；接着根据不同时刻的全景图像中目标相对背景的位置变化，确定全景图像中的目标为检测到的用户；然后根据用户在全景图像中的位置，以及全景图像的长度与投影圆的圆周长之间的比例关系，确定用户相对投影圆的投影角度。
如图4所示，摄像头模组通过连续拍照，进行不同时刻的照片对比，分析音频设备周围是否存在用户，以及所存在用户的人数。用户在任何时刻都不是绝对静止的，高清晰度的摄像头模组可以完美的捕捉用户的移动。例如，图4中目标A、B、C与音频设备同时位于空间内，摄像头模组拍摄完成后，获取t0时刻和t1时刻的两张全景图像，通过对比两张全景图像中同一目标的位置变换情况即可确定目标是否为用户。以目标A为例，在t0时刻，目标A位于Ia0位置，在t1时刻，目标A位于Ia1位置，即可确定目标A在t0与t1时刻存在位移差ΔIa，说明此时在相同的背景中，目标A发生了移动，目标A为用户。同样的，在t0与t1时刻，目标B和C相对全景图像的背景存在位置差ΔIb和ΔIc，目标B和C都是检测到的用户。
在分析不同时刻的全景图像确定全景图像中存在用户后，根据全景图像的长度与投影圆的圆周长之间的比例关系，即可确定用户相对投影圆的投影 角度。参考图4，显示屏在第一平面上投影形成的投影圆的圆周展开后为具有一定长度的线段，图4中该线段的长度和全景图像的长度均为L。以该线段的一端为基点，假设该线段的基点对应全景图像的右端，确定t1时刻的全景图像中用户A～C在全景图像中与全景图像右端之间距离依次为Ia1，Ib1，Ic1，那么根据公式
Figure PCTCN2018125256-appb-000001
可以分别确定用户A相对投影圆的投影角度为α，用户B相对投影圆的投影角度为β，用户C相对投影圆的投影角度为γ。
在检测用户位置之后，继续执行步骤S120，即在检测到多个用户时，根据多个用户与显示屏的水平投射中心位置之间的位置关系，确定显示屏的显示区域。
为便于计算显示屏的显示区域减少计算量，简化计算步骤，本实施例预先设定显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的投影圆的圆心位置。
本实施例通过下述方式确定显示屏的显示区域：首先根据用户相对显示屏的水平投射中心位置的角度将多个用户进行分组，每个分组对应投影圆设定角度的弧长范围；然后根据多个用户所在分组的个数和所在分组之间的位置关系确定显示区域。具体是：当多个用户所在的多个分组中，若多个分组之间在位置上没有相互临近，确定显示区域为全屏显示；若多个分组之间在位置上相互临近，根据用户相对投影圆的角度和显示屏的水平投射中心位置确定显示区域，即按照分组对应的弧长角度由小到大的分组方向，对多个用户所在的分组进行排序，此时多个用户所在的多个分组包括第一分组和第二分组，当第二分组相对分组方向在位置上临近第一分组时，获取第一分组中对应投影角度最小的用户位置与显示屏的水平投射中心位置的第一连线和第二分组中对应投影角度最大的用户位置与显示屏的水平投射中心位置的第二连线在水平面上所形成的第一夹角，此时根据第一夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域；当第二分组相对所述分组方向的逆方向在位置上临近第一分组时，获取第一分组中对应投影角度最大的用户位置与显示屏的水平投射中心位置的第三连线和第二分组中对应投影角度最小的用户位置与显示屏的水平投射中心位置的第四连线在水平面上所形成的第二夹角，此时根据第二夹角对应在显示屏上下边缘的圆弧所围成的弧形 区域确定为显示区域。
为便于说明，如图2所示，以显示屏的水平投射中心位置为坐标原点O，以音频设备的空间中垂线为Z轴，以第一平面上相互垂直的两条直线分别为X轴和Y轴建立空间直角坐标系。由于显示屏在第一平面上投影形成的投影圆的圆周长是确定值，那么投影圆的圆周上任一点相当于显示屏的水平投射中心位置(即坐标原点O)的投影角度是确定的，因此，可以根据投影圆的圆周长与全景图像长度的比例关系、全景图像中各用户位置在图像中的位置关系，既可以确定用户相对投影圆的投影角度，也即可以确定用户相对显示屏的水平投射中心位置的投影角度。参考图2，本实施例规定利用图2中数字1234表示XOY平面的四个象限，即利用数字1表示第一象限，利用数字2表示第二象限，利用数字3表示第三象限，利用数字4表示第四象限。
本实施例假设每个分组对应投影圆的弧长范围为90°，即本实施例假设存在四个分组，按照分组对应的弧长角度由小到大的分组方向，即本实施例设定分组方向为顺时针方向，显然也可以通过其它方式设定分组方向，对此不作具体限定。投影圆的弧长范围为0～90°对应一个分组范围，对应投影圆的弧长范围为90°～180°对应一个分组范围，投影圆的弧长范围为180°～270°对应一个分组范围，投影圆的弧长范围为270°～360°对应一个分组范围，如图2所示四个分组分别对应XOY平面上的第一象限至第四象限。
基于上述分组方式，在本实施例的一个示例中，当多个用户包括第一用户、第二用户和第三用户时，通过下述三种方式的任一种来确定显示区域。
方式一
当第一用户、第二用户和第三用户分别在三个分组中时，或者，当第一用户、第二用户和第三用户处于两个分组，但三个用户所在的两个分组在位置上没有相互临近时，确定显示区域为全屏显示。
参考图4，假设对t0时刻和t1时刻的全景图像分析后，检测出音频设备四周存在三个用户A～C，确定出用户A～C相对投影圆的投影角度分别为α＝π/4，β＝π3/4，γ＝π5/4后。那么，可以确定第一用户A、第二用户B和第三用户C处于不同分组中，此时确定显示区域为全屏显示。
假设第一用户A、第二用户B和第三用户C相对音频设备的位置如图7所示，基于对不同时刻的全景图像分析后，检测出音频设备周围存在三个用户。如图8所示，第一用户A相对投影圆的投影角度为α，第二用户B相对投影圆的投影角度为β，第三用户C相对投影圆的投影角度为γ，α＜β＜γ。根据三个用户相对投影圆的投影角度，以及每个分组对应的投影圆的弧长范围，确定第一用户A和第二用户B处于第一象限所在第一分组中，第三用户C处于第三象限所在第二分组中，由于第二分组与第一分组之间间隔一个分组，即第二分组和第一分组在位置上没有相互临近，此时确定显示区域为全屏显 示。
本实施例中多个用户所在分组之间在位置上没有相互临近，应理解为如果存在任两个分组在位置上没有临近则这多个用户所在分组之间在位置上没有相互临近。假设用户A在第一分组，用户B在第二分组，用户C在第三分组，由于第一分组与第三分组在位置上被第二分组间隔，此时确定用户A～C所在分组在位置上没有相互临近。
方式二
当第一用户与第二用户在第一分组中，第三用户在第二分组中时，若第二分组相对分组方向在位置上临近第一分组，获取第一用户对应投影圆的用户位置与显示屏的水平投射中心位置的第一连线和第三用户对应投影圆的用户位置与显示屏的水平投射中心位置的第二连线在水平面上所形成的夹角为第一夹角，根据第一夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域；其中，第一用户对应投影圆的角度小于第二用户对应投影圆的角度。
假设第一用户A、第二用户B和第三用户C相对音频设备的位置如图3所示，基于对不同时刻的全景图像分析后，检测出音频设备周围存在三个用户。如图5所示，第一用户A相对投影圆的投影角度为α，第二用户B相对投影圆的投影角度为β，第三用户C相对投影圆的投影角度为γ，α＜β＜γ。根据三个用户相对投影圆的投影角度，以及每个分组对应的投影圆的弧长范围，确定第一用户A和第二用户B处于第一象限所在第一分组中，第三用户C处于第二象限所在第二分组中，由于第二分组相对分组方向在位置上临近第一分组，即第二分组相对于顺时针方向临近第一分组，此时获取第一用户A对应投影圆的用户位置A与显示屏的水平投射中心位置O的第一连线L1和第三用户C对应投影圆的用户位置C与显示屏的水平投射中心位置O的第二连线L2在水平面上所形成的夹角为第一夹角θ，θ＝γ-α。如图6所示，根据第一夹角θ对应在显示屏上下边缘的圆弧AC、圆弧ED，以及直线AE和直线CD所围成的弧形区域确定为显示区域，即弧形区域ACDE为显示区域。
方式三
当第一用户与第二用户在第一分组中，第三用户在第二分组中时，若第二分组相对分组方向的逆方向在位置上临近第一分组，获取第二用户对应投影圆的用户位置与显示屏的水平投射中心位置的第三连线和第三用户对应投影圆的用户位置与显示屏的水平投射中心位置的第四连线在水平面上所形成的夹角为第二夹角，根据第二夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域；其中，第一用户对应投影圆的角度小于第二用户对应投影圆的角度。
假设图5中，根据三个用户相对投影圆的角度，以及每个分组对应的投 影圆的弧长范围，确定第一用户A和第二用户B处于第一象限所在第一分组中，第三用户C处于第四象限所在第二分组中，由于第二分组相对分组方向的逆方向在位置上临近第一分组，即第二分组相对逆时针方向临近第一分组，此时获取第二用户B对应投影圆的用户位置B与显示屏的水平投射中心位置O的第三连线和第三用户C对应投影圆的用户位置C与显示屏的水平投射中心位置O的第四连线在水平面上所形成的夹角为第二夹角，根据第二夹角对应在显示屏上下边缘的两个圆弧，以及两个圆弧之间的两条直线所围成的弧形区域确定为显示区域。
本实施例中，在对多个用户进行分组时，存在多个用户处于同一分组的情况，在此种情况下，通过获取对应投影角度最小的用户位置与显示屏的水平投射中心位置的第五连线和对应投影角度最大的用户位置与显示屏的水平投射中心位置的第六连线在水平面上所形成的第三夹角，根据第三夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定显示区域。
在一个示例中，假设多个用户包括第一用户A和第二用户B两个用户，第一用户A和第二用户B相对音频设备的位置如图10所示，基于对不同时刻的全景图像分析后，检测出音频设备周围存在两个用户。如图11所示，第一用户A相对投影圆的投影角度为α，第二用户B相对投影圆的投影角度为β，α＜β，根据两个用户相对投影圆的投影角度，以及每个分组对应的投影圆的弧长范围，确定第一用户A和第二用户B处于第一象限所在第一分组中，由于检测到的所有用户处于同一分组中，此时获取第一用户A对应投影圆的用户位置A与显示屏的水平投射中心位置O的第五连线L5和第二用户B对应投影圆的用户位置B与显示屏的水平投射中心位置O的第六连线L6在水平面上所形成的夹角为第三夹角η，η＝β-α。如图12所示，根据第三夹角η对应在显示屏上下边缘的圆弧AB、圆弧FE，以及直线AF和直线BE所围成的弧形区域确定为显示区域，即弧形区域ABEF为显示区域。
在确定显示区域之后，继续执行步骤S130，即控制显示区域进行显示，可以理解为控制显示区域进行工作，例如在显示区域为全屏显示时，如图9所示，整个显示屏都处于工作状态，进行信息显示和/或通过触控进行人机交互；在显示区域为非全屏显示时，弧形显示区域部分进行信息显示和/或通过触控进行人机交互，显示屏的其余部分处于待机或低功耗模式。
本发明的一个方法提供了一种适用于单人情况的音频设备定向显示方法。
本实施例中的音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，显示屏在水平面上的投影对应为圆周。
图13为本发明实施例示出的音频设备定向显示方法的流程图，如图13所示，本实施例的方法包括：
S1310响应于获取的启动信号，启动摄像头模组进行全景拍摄以检测用户位置，用户位置包括用户相对投影圆的角度位置与显示屏的水平投射中心位置之间的连线所指示的用户方向。
其中，显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的投影圆的圆心位置。
S1320在检测到单个用户时，根据将用户方向作为预先设定的映射角度的角平分线，确定映射角度在所述显示屏上对应的上下边缘的圆弧。
1330利用圆弧围成的弧形区域确定显示屏的显示区域，控制显示区域进行显示。
本实施例的定向显示方法利用摄像头模组检测用户位置，当检测到单个用户时，根据用户方向与预先设定的映射角度确定显示区域进行定向显示，使音频设备能够跟随用户位置的变化实时动态调整可视显示区域，加强人机交互效果，提升用户体验。
如图14-16所示，在通过分析不同时刻的全景图像确定音频设备周围存在单个用户A时，根据用户A在全景图像中的位置，以及全景图像长度与投影圆的圆周长之间的比例关系，确定用户A相对投影圆的投影角度为α。
如图15所示，用户A的用户方向为用户A相对投影圆的角度位置A与显示屏的水平投射中心位置O之间的连线L7所指示的用户方向。如图16所示，假设预设角度为σ，那么在第一平面即XOY平面上，以连线L7为映射角度σ的角平分线确定映射角度σ在显示屏上对应的上下边缘的圆弧分别为圆弧ML和圆弧NI，那么圆弧ML和圆弧NI以及两圆弧之间的直线MN与直线LI所围成的弧形区域MLIN确定为显示区域。
本发明的一个方法提供了一种适用多人交互情况的音频设备定向显示装置。
在本实施例中，音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏。
图17为本发明实施例示出的音频设备定向显示装置的结构示意图，如图17所示，本实施例的装置包括：
第一检测单元171，用于响应于获取的启动信号，启动摄像头模组进行全景拍摄以检测用户位置；
第一计算单元172，用于在检测到多个用户时，根据多个用户与显示屏的水平投射中心位置之间的位置关系，确定显示屏的显示区域；
第一控制单元173，用于控制显示区域进行显示。
本实施例中显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的投影圆的圆心位置。
本实施例定向显示装置中的第一检测单元利用摄像头模组检测用户位 置，当第一计算单元确定检测到多个用户时，根据多个用户与显示屏中心位置之间的关系确定显示区域，第一控制单元通过控制该部分显示区域进行显示，保证多用户都处于音频设备的显示区域内，提升音频设备多人交互时的视觉体验。
在一个实施例中，第一检测单元171用于利用摄像头模组进行连续拍照，获取全景图像；根据不同时刻的全景图像中目标相对背景的位置变化，确定全景图像中该目标为检测到的用户；根据用户在全景图像中的位置，以及全景图像的长度与投影圆的圆周长之间的比例关系，确定用户相对投影圆的投影角度。
相应的，第一计算单元172用于根据用户相对投影圆的投影角度将多个用户进行分组，每个分组对应投影圆设定角度的弧长范围；根据多个用户所在分组的个数和所在分组之间的位置关系，确定显示区域。
一个实施例中，第一计算单元172用于当多个用户所在的多个分组中，若多个分组之间在位置上没有相互临近，确定显示区域为全屏显示；若多个分组之间在位置上相互临近，根据显示屏的水平投射中心位置和用户相对投影圆的投影角度确定所述显示区域；即按照分组对应的弧长角度由小到大的分组方向，对多个用户所在的多个分组进行排序，多个用户所在的多个分组包括第一分组和第二分组；当第二分组相对分组方向在位置上临近第一分组时，获取第一分组中对应投影角度最小的用户位置与显示屏的水平投射中心位置的第一连线和第二分组中对应投影角度最大的用户位置与显示屏的水平投射中心位置的第二连线在水平面上所形成的第一夹角，根据第一夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域；当第二分组相对分组方向的逆方向在位置上临近第一分组时，获取第一分组中对应投影角度最大的用户位置与显示屏的水平投射中心位置的第三连线和第二分组中对应投影角度最小的用户位置与显示屏的水平投射中心位置的第四连线在水平面上所形成的第二夹角，根据第二夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域。
第一计算单元172具体用于当多个用户包括第一用户、第二用户和第三用户，第一用户、第二用户和第三用户分别在三个分组中时，或者第一用户、第二用户和第三用户处于两个分组，但三个用户所在的两个分组在位置上没有相互临近时，确定显示区域为全屏显示；当第一用户与第二用户在第一分组中，第三用户在第二分组中时，
若第二分组相对分组方向在位置上临近第一分组，获取第一用户对应投影圆的用户位置与显示屏的水平投射中心位置的第一连线和第三用户对应投影圆的用户位置与显示屏的水平投射中心位置的第二连线在水平面上所形成的夹角为第一夹角，根据第一夹角对应在显示屏上下边缘的圆弧所围成的弧 形区域确定为显示区域；
若第二分组相对分组方向的逆方向在位置上临近第一分组，获取第二用户对应投影圆的用户位置与显示屏的水平投射中心位置的第三连线和第三用户对应投影圆的用户位置与显示屏的水平投射中心位置的第四连线在水平面上所形成的夹角为第二夹角，根据第二夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域；其中，第一用户对应投影圆的角度小于第二用户对应投影圆的角度。
一个实施例中，第一计算单元172用于当多个用户在同一个分组中时，获取对应投影角度最小的用户位置与显示屏的水平投射中心位置的第五连线和对应投影角度最大的用户位置与显示屏的水平投射中心位置的第六连线在水平面上所形成的第三夹角，根据第三夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域。
第一计算单元172具体用于当多个用户包括第一用户和第二用户，第一用户和第二用户在同一个分组中时，获取第一用户对应投影圆的用户位置与显示屏的水平投射中心位置的第五线和第二用户对应投影圆的用户位置与显示屏的水平投射中心位置的第六连线在水平面上所形成的夹角为第三夹角，根据第三夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为显示区域。
本发明的一个装置提供了一种适用于单人情况的音频设备定向显示装置。
本实施例中的音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，显示屏在水平面上的投影对应为圆周。
图18为本发明实施例示出的音频设备定向显示装置的结构示意图，如图18所示，本实施例的装置包括：
第二检测单元181，用于响应于获取的启动信号，启动所述摄像头模组进行全景拍摄以检测用户位置，用户位置包括用户相对投影圆的角度位置与显示屏的水平投射面中心位置之间的连线所指示的用户方向；
第二计算单元182，用于在检测到单个用户时，根据将用户方向作为预先设定的映射角度的角平分线，确定映射角度在显示屏上对应的上下边缘的圆弧；
第二控制单元183，用于利用圆弧围成的弧形区域确定显示屏的显示区域，控制显示区域进行显示；
其中，显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的投影圆的圆心位置。
本实施例定向显示装置中的第二检测单元利用摄像头模组检测用户位置，当第二计算单元检测到单个用户时，根据用户方向与预先设定的映射角 度确定显示区域，第二控制单元控制显示区域进行显示，使音频设备能够跟随用户位置的变化实时动态调整可视显示区域，加强人机交互效果，提升用户体验。
对于装置实施例而言，由于其基本对应于方法实施例，所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下，即可以理解并实施。
本发明的另一个方面提供了一种音频设备。
图19为本发明实施例示出的音频设备的结构框图，如图19所示音频设备包括：摄像头模组和呈圆周分布在音频设备侧面的显示屏，还包括处理器和存储有机器可执行指令的机器可读存储介质，通过读取并执行机器可读存储介质中的机器可执行指令，处理器可执行前文描述的音频设备定向显示方法。
本发明的另一个方面提供了一种系统。
本申请提供的系统可以通过软件实现，也可以通过硬件或者软硬件结合的方式实现。以软件实现为例，参照图20所示，本申请提供的系统可包括处理器1801、存储有机器可执行指令的机器可读存储介质2002。处理器2001与机器可读存储介质2002可经由系统总线2003通信。并且，通过读取并执行机器可读存储介质2002中与音频设备定向显示逻辑对应的机器可执行指令，处理器2001可执行前文描述的音频设备定向显示方法。
本发明的另一个方面提供了一种机器可读存储介质。
本发明实施例的机器可读存储介质，存储有机器可执行指令，机器可执行指令被处理器执行时以实现前文描述的音频设备定向显示方法。
需要说明的是，本发明实施例的可读存储介质，例如可以是能够包含、存储、传送、传播或传输指令的任意介质。例如，可读存储介质可以包括但不限于电、磁、光、电磁、红外或半导体系统、装置、器件或传播介质。可读存储介质的具体示例包括：磁存储装置，如磁带或硬盘(HDD)；光存储装置，如光盘(CD-ROM)；存储器，如随机存取存储器(RAM)或闪存；和/或有线/无线通信链路。
机器可读存储介质可以包括计算机程序，该计算机程序可以包括代码/计算机可执行指令，其在由处理器执行时使得处理器执行例如前文所描述的音频设备定向显示方法流程及其任何变形。
计算机程序可被配置为具有例如包括计算机程序模块的计算机程序代 码。例如，在示例实施例中，计算机程序中的代码可以包括一个或多个程序模块。应当注意，模块的划分方式和个数并不是固定的，本领域技术人员可以根据实际情况使用合适的程序模块或程序模块组合，当这些程序模块组合被处理器执行时，使得处理器可以执行例如上文所描述的音频设备定向显示方法流程及其任何变形。
为了便于清楚描述本发明实施例的技术方案，在发明的实施例中，采用了“第一”、“第二”等字样对功能和作用基本相同的相同项或相似项进行区分，本领域技术人员可以理解“第一”、“第二”等字样并不对数量和执行次序进行限定。
以上所述，仅为本发明的具体实施方式，在本发明的上述教导下，本领域技术人员可以在上述实施例的基础上进行其他的改进或变形。本领域技术人员应该明白，上述的具体描述只是更好的解释本发明的目的，本发明的保护范围应以权利要求的保护范围为准。

Claims (15)

  1. 一种音频设备定向显示方法，音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，所述方法包括：
    响应于获取的启动信号，启动所述摄像头模组进行全景拍摄以检测用户位置；
    在检测到多个用户时，根据多个用户与显示屏的水平投射中心位置之间的位置关系，确定所述显示屏的显示区域；
    控制所述显示区域进行显示。
  2. 根据权利要求1所述的方法，其特征在于，所述摄像头模组包括至少一个全景摄像头或至少一组双目摄像头或具有多个摄像头的摄像头球形阵列。
  3. 根据权利要求1所述的方法，其特征在于，所述显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的投影圆的圆心位置。
  4. 根据权利要求3所述的方法，其特征在于，所述启动所述摄像头模组进行全景拍摄以检测用户位置，包括：
    利用摄像头模组进行连续拍照，获取全景图像；
    根据不同时刻的全景图像中目标相对背景的位置变化，确定全景图像中所述目标为检测到的用户；
    根据用户在全景图像中的位置，以及全景图像的长度与所述投影圆的圆周长之间的比例关系，确定用户相对所述投影圆的投影角度。
  5. 根据权利要求4所述的方法，其特征在于，所述在检测到多个用户时，根据多个用户与显示屏的水平投射中心位置之间的位置关系，确定所述显示屏的显示区域，包括：
    根据用户相对所述投影圆的投影角度将所述多个用户进行分组，每个分组对应所述投影圆设定角度的弧长范围；
    根据所述多个用户所在分组的个数和所在分组之间的位置关系，确定所述显示区域。
  6. 根据权利要求5所述的方法，其特征在于，所述根据所述多个用户所在分组的个数和所在分组之间的位置关系，确定所述显示区域，包括：
    当所述多个用户所在的多个分组中，若所述多个分组之间在位置上没有相互临近，确定所述显示区域为全屏显示；若所述多个分组之间在位置上相互临近，根据显示屏的水平投射中心位置和用户相对所述投影圆的投影角度确定所述显示区域。
  7. 根据权利要求6所述的方法，其特征在于，所述若所述多个分组之间 在位置上相互临近，根据显示屏的水平投射中心位置和用户相对所述投影圆的投影角度确定显示区域，包括：
    按照分组对应的弧长角度由小到大的分组方向，对多个用户所在的多个分组进行排序，所述多个用户所在的多个分组包括第一分组和第二分组；
    当所述第二分组相对所述分组方向在位置上临近所述第一分组时，获取第一分组中对应投影角度最小的用户位置与显示屏的水平投射中心位置的第一连线和第二分组中对应投影角度最大的用户位置与显示屏的水平投射中心位置的第二连线在水平面上所形成的第一夹角；根据所述第一夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为所述显示区域；
    当所述第二分组相对所述分组方向的逆方向在位置上临近所述第一分组时，获取第一分组中对应投影角度最大的用户位置与显示屏的水平投射中心位置的第三连线和第二分组中对应投影角度最小的用户位置与显示屏的水平投射中心位置的第四连线在水平面上所形成的第二夹角；根据所述第二夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为所述显示区域。
  8. 根据权利要求7所述的方法，其特征在于，当所述多个用户包括第一用户、第二用户和第三用户时，所述根据所述多个用户所在分组的个数和所在分组之间的位置关系，确定所述显示区域，包括：
    当所述第一用户、第二用户和第三用户分别在三个分组中时，或者当所述第一用户、第二用户和第三用户处于两个分组，但三个用户所在的两个分组在位置上没有相互临近时，确定所述显示区域为全屏显示；当第一用户与第二用户在第一分组中，所述第三用户在第二分组中时，
    若第二分组相对所述分组方向在位置上临近第一分组，获取第一用户对应投影圆的用户位置与显示屏的水平投射中心位置的所述第一连线和第三用户对应投影圆的用户位置与显示屏的水平投射中心位置的所述第二连线在水平面上所形成的夹角为所述第一夹角，根据所述第一夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为所述显示区域；
    若第二分组相对所述分组方向的逆方向在位置上临近第一分组，获取第二用户对应投影圆的用户位置与显示屏的水平投射中心位置的所述第三连线和第三用户对应投影圆的用户位置与显示屏的水平投射中心位置的所述第四连线在水平面上所形成的夹角为所述第二夹角，根据所述第二夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为所述显示区域；
    其中，第一用户对应投影圆的角度小于第二用户对应投影圆的角度。
  9. 根据权利要求5所述的方法，其特征在于，所述根据所述多个用户所在分组的个数和所在分组之间的位置关系，确定所述显示区域，包括：
    当所述多个用户在同一个分组中时，获取对应投影角度最小的用户位置与显示屏的水平投射中心位置的第五连线和对应投影角度最大的用户位置与显示屏的水平投射中心位置的第六连线在水平面上形成的第三夹角；
    根据所述第三夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为所述显示区域。
  10. 根据权利要求9所述的方法，其特征在于，当所述多个用户包括第一用户和第二用户时，所述根据所述多个用户所在分组的个数和所在分组之间的位置关系，确定所述显示区域，包括：
    当第一用户和第二用户在同一个分组中时，获取第一用户对应投影圆的用户位置与显示屏的水平投射中心位置的所述第五连线和第二用户对应投影圆的用户位置与显示屏的水平投射中心位置的所述第六连线在水平面上形成夹角为所述第三夹角；
    根据所述第三夹角对应在显示屏上下边缘的圆弧所围成的弧形区域确定为所述显示区域。
  11. 一种音频设备定向显示方法，所述音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，所述方法包括：
    响应于获取的启动信号，启动所述摄像头模组进行全景拍摄以检测用户位置，所述用户位置包括用户相对投影圆的角度位置与显示屏的水平投射中心位置之间的连线所指示的用户方向；
    在检测到单个用户时，根据将所述用户方向作为预先设定的映射角度的角平分线，确定所述映射角度在所述显示屏上对应的上下边缘的圆弧；
    利用所述圆弧围成的弧形区域确定显示屏的显示区域，控制所述显示区域进行显示；
    其中，所述显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的所述投影圆的圆心位置。
  12. 一种音频设备定向显示装置，所述音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，所述装置包括：
    第一检测单元，用于响应于获取的启动信号，启动所述摄像头模组进行全景拍摄以检测用户位置；
    第一计算单元，用于在检测到多个用户时，根据多个用户与显示屏中心位置之间的位置关系，确定所述显示屏的显示区域；
    第一控制单元，用于控制所述显示区域进行显示。
  13. 一种音频设备定向显示装置，所述音频设备包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，所述装置包括：
    第二检测单元，用于响应于获取的启动信号，启动所述摄像头模组进行全景拍摄以检测用户位置，所述用户位置包括用户相对投影圆的角度位置与显示屏的水平投射面中心位置之间的连线所指示的用户方向；
    第二计算单元，用于在检测到单个用户时，根据将所述用户方向作为预先设定的映射角度的角平分线，确定所述映射角度在所述显示屏上对应的上下边缘的圆弧；
    第二控制单元，用于利用所述圆弧围成的弧形区域确定显示屏的显示区域，控制所述显示区域进行显示；
    其中，所述显示屏的水平投射中心位置包括显示屏在第一平面上投影形成的所述投影圆的圆心位置。
  14. 一种音频设备，包括摄像头模组和呈圆周分布在音频设备侧面的显示屏，还包括处理器和存储有机器可执行指令的机器可读存储介质，通过读取并执行机器可读存储介质中的机器可执行指令，处理器可执行如权利要求1-10或权利要求11任一项所述的音频设备显示屏的控制方法。
  15. 一种机器可读存储介质，存储有机器可执行指令，机器可执行指令被处理器执行时以实现如权利要求1-10或权利要求11任一项所述的音频设备显示屏的控制方法。
PCT/CN2018/125256 2018-10-29 2018-12-29 一种音频设备定向显示方法、装置和音频设备 WO2020087748A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/309,137 US11670200B2 (en) 2018-10-29 2018-12-29 Orientated display method and apparatus for audio device, and audio device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811270177.8A CN109460073B (zh) 2018-10-29 2018-10-29 一种音频设备定向显示方法、装置和音频设备
CN201811270177.8 2018-10-29

Publications (1)

Publication Number Publication Date
WO2020087748A1 true WO2020087748A1 (zh) 2020-05-07

Family

ID=65608704

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/125256 WO2020087748A1 (zh) 2018-10-29 2018-12-29 一种音频设备定向显示方法、装置和音频设备

Country Status (3)

Country Link
US (1) US11670200B2 (zh)
CN (2) CN112367592B (zh)
WO (1) WO2020087748A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220013080A1 (en) * 2018-10-29 2022-01-13 Goertek Inc. Directional display method and apparatus for audio device and audio device

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110139154B (zh) * 2019-05-15 2021-08-31 京东方科技集团股份有限公司 一种显示设备控制方法及装置、系统
CN112217975A (zh) * 2020-09-29 2021-01-12 星络智能科技有限公司 智能音箱控制方法、系统、计算机设备及计算机可读存储介质
CN114489539A (zh) * 2022-01-04 2022-05-13 佛山市顺德区美的饮水机制造有限公司 显示设备、显示方法和存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0669782A2 (en) * 1994-02-25 1995-08-30 Kabushiki Kaisha Kenwood Speaker system and its support legs
WO2015042897A1 (zh) * 2013-09-29 2015-04-02 中兴通讯股份有限公司 一种控制方法、控制装置及控制设备
CN106155200A (zh) * 2016-06-30 2016-11-23 联想(北京)有限公司 一种电子设备及显示方法
CN107423021A (zh) * 2017-07-28 2017-12-01 联想(北京)有限公司 一种智能设备及智能控制方法
CN107643886A (zh) * 2017-09-29 2018-01-30 联想(北京)有限公司 一种多媒体设备及控制方法
CN108563410A (zh) * 2018-01-02 2018-09-21 联想(北京)有限公司 一种显示控制方法及电子设备
CN108614583A (zh) * 2018-04-28 2018-10-02 北京小米移动软件有限公司 智能终端及智能终端的控制方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0432376A (ja) * 1990-05-29 1992-02-04 Nec Corp 画像追尾方式
JP5358280B2 (ja) * 2009-05-12 2013-12-04 日立コンシューマエレクトロニクス株式会社 投写ボード装置、及びこれに用いる透過型スクリーン
CN102033549B (zh) * 2009-09-30 2014-02-05 三星电子（中国）研发中心 显示设备的视角调整装置
US20180032997A1 (en) * 2012-10-09 2018-02-01 George A. Gordon System, method, and computer program product for determining whether to prompt an action by a platform in connection with a mobile device
CN106959831A (zh) * 2016-01-11 2017-07-18 黎凯华 一种同屏多任务分割显示的车载智能后视镜设计方法
CN206894784U (zh) * 2017-04-19 2018-01-16 东莞市隆锐行电子有限公司 一种视频会议系统的一体化全无线终端
CN107844287A (zh) * 2017-11-15 2018-03-27 深圳市沃特沃德股份有限公司 导航显示方法和车载系统
CN108513207B (zh) * 2018-03-30 2019-08-09 百度在线网络技术（北京）有限公司 音箱控制方法、装置、设备及计算机可读介质
CN108666355B (zh) * 2018-05-21 2020-12-04 武汉华星光电半导体显示技术有限公司 Amoled模组及其弯折状态的显示方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0669782A2 (en) * 1994-02-25 1995-08-30 Kabushiki Kaisha Kenwood Speaker system and its support legs
WO2015042897A1 (zh) * 2013-09-29 2015-04-02 中兴通讯股份有限公司 一种控制方法、控制装置及控制设备
CN106155200A (zh) * 2016-06-30 2016-11-23 联想(北京)有限公司 一种电子设备及显示方法
CN107423021A (zh) * 2017-07-28 2017-12-01 联想(北京)有限公司 一种智能设备及智能控制方法
CN107643886A (zh) * 2017-09-29 2018-01-30 联想(北京)有限公司 一种多媒体设备及控制方法
CN108563410A (zh) * 2018-01-02 2018-09-21 联想(北京)有限公司 一种显示控制方法及电子设备
CN108614583A (zh) * 2018-04-28 2018-10-02 北京小米移动软件有限公司 智能终端及智能终端的控制方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220013080A1 (en) * 2018-10-29 2022-01-13 Goertek Inc. Directional display method and apparatus for audio device and audio device
US11551633B2 (en) * 2018-10-29 2023-01-10 Goeriek Inc. Directional display method and apparatus for audio device and audio device

Also Published As

Publication number Publication date
CN109460073A (zh) 2019-03-12
CN112367592A (zh) 2021-02-12
CN109460073B (zh) 2020-11-27
US11670200B2 (en) 2023-06-06
US20220013047A1 (en) 2022-01-13
CN112367592B (zh) 2022-08-16

Similar Documents

Publication Publication Date Title
WO2020087748A1 (zh) 一种音频设备定向显示方法、装置和音频设备
WO2020087747A1 (zh) 一种音频设备定向显示方法、装置和音频设备
US7599561B2 (en) Compact interactive tabletop with projection-vision
CN110097576B (zh) 图像特征点的运动信息确定方法、任务执行方法和设备
US8398246B2 (en) Real-time projection management
US20160195935A1 (en) Identification of a gesture
US20110254832A1 (en) Compact Interactive Tabletop with Projection-Vision
US20120281129A1 (en) Camera control
WO2016145755A1 (zh) 智能终端的图片旋转的方法及智能终端
KR20150130383A (ko) 콘텍스트 인식 로컬화, 매핑, 및 트래킹
US20130286049A1 (en) Automatic adjustment of display image using face detection
WO2014113951A1 (zh) 屏幕显示模式确定方法及终端设备
TW201342202A (zh) 利用多個屏幕聯合顯示影片的影片播放系統和相關的電腦程式產品
CN110084797B (zh) 平面检测方法、装置、电子设备和存储介质
JP6260241B2 (ja) ユーザの入力を受け付けるシステム、プログラムおよび方法
US10755678B2 (en) Reformatting image data using device sensing
CN109191547A (zh) 元素吸附方法、装置、设备和存储介质
WO2014086205A1 (zh) 一种触摸屏响应的方法及终端
CN106292163A (zh) 全息投影装置及全息投影装置的操作方法
CN104731541A (zh) 一种控制方法、电子设备及系统
CN110096133A (zh) 红外手势识别装置及方法
US10026177B2 (en) Compact interactive tabletop with projection-vision
WO2020087751A1 (zh) 一种音频设备定向显示方法、装置和音频设备
WO2018171363A1 (zh) 一种位置信息确定方法、投影设备和计算机存储介质
US20220075477A1 (en) Systems and/or methods for parallax correction in large area transparent touch interfaces

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18939096

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18939096

Country of ref document: EP

Kind code of ref document: A1