WO2019214216A1 - Dispositif multimédia intelligent et son procédé d'affichage - Google Patents

Dispositif multimédia intelligent et son procédé d'affichage Download PDF

Info

Publication number
WO2019214216A1
WO2019214216A1 PCT/CN2018/118566 CN2018118566W WO2019214216A1 WO 2019214216 A1 WO2019214216 A1 WO 2019214216A1 CN 2018118566 W CN2018118566 W CN 2018118566W WO 2019214216 A1 WO2019214216 A1 WO 2019214216A1
Authority
WO
WIPO (PCT)
Prior art keywords
microphone
display area
display
microphones
determining
Prior art date
Application number
PCT/CN2018/118566
Other languages
English (en)
Chinese (zh)
Inventor
董学会
刘鲁松
Original Assignee
歌尔股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歌尔股份有限公司 filed Critical 歌尔股份有限公司
Publication of WO2019214216A1 publication Critical patent/WO2019214216A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones

Definitions

  • the invention relates to an intelligent multimedia device and a display method thereof.
  • intelligent multimedia devices such as smart speakers
  • Some intelligent multimedia devices on the market are mostly equipped with a display screen, and the display screen can not only display related information, but also realize intelligent multimedia control through the touch display screen.
  • the display screen of the intelligent multimedia device is generally fixed, and cannot be adjusted in real time for directional display to align with the direction of the person, so that the user needs to move to the opposite side of the display or manually when viewing the display screen or performing a touch operation. Moving the device results in poor human-computer interaction and affects the user experience.
  • the invention provides an intelligent multimedia device and a display method thereof, so as to solve the problem that the display screen of the prior art has a fixed orientation and causes a poor human-computer interaction effect.
  • An aspect of the present invention provides a display method of an intelligent multimedia device including a plurality of display areas disposed on a side thereof, and a ring microphone array disposed on a surface thereof, and a plurality of microphones and a plurality of microphones in the ring microphone array Corresponding relationship between the display areas, the method comprising: determining a first microphone according to a sound signal received by each microphone in the ring microphone array; determining and comparing according to a correspondence between the plurality of microphones and the plurality of display areas a first display area corresponding to a microphone; controlling the first display area for display.
  • An aspect of the present invention also provides a display method of a smart multimedia device, comprising: a dynamic display area disposed on a side thereof, and a ring microphone array disposed on a surface thereof, comprising: receiving according to each microphone in the ring microphone array The sound signal determines a first microphone; determines a correspondence relationship between the first microphone and the display area; and controls the first sub-area of the display area to perform dynamic display according to the correspondence relationship.
  • an intelligent multimedia device including a plurality of display areas disposed on a side thereof, and a ring microphone array disposed on a surface thereof, between a plurality of microphones and a plurality of display areas in the ring microphone array Corresponding relationship, further comprising: a first signal processing unit, configured to determine a first microphone according to a sound signal received by each microphone in the ring microphone array; and a first analysis processing unit configured to use the plurality of microphones and the plurality of display areas Corresponding relationship between the first display area corresponding to the first microphone; the first on-screen display control unit is configured to control the first display area for display.
  • Another aspect of the present invention also provides an intelligent multimedia device comprising a dynamic display area disposed on a side thereof, and a ring microphone array disposed on a surface thereof, further comprising: a second signal processing unit, according to each of the ring microphone arrays a sound signal received by the microphone determines a first microphone; a second analysis processing unit is configured to determine a correspondence between the first microphone and the dynamic display area; and a second on-screen display control unit is configured to control the dynamic display area according to the corresponding relationship The first sub-area is displayed.
  • Still another aspect of the present invention provides an intelligent multimedia system comprising: one or more storage units for storing executable instructions; and one or more processing units for executing executable instructions to implement the above-described intelligent multimedia The display method of the device.
  • the intelligent multimedia device and the display method thereof are provided.
  • a corresponding relationship between each display area and a corresponding microphone is preset, and when the visual display area of the intelligent multimedia is adjusted, according to the microphone array
  • the signal characteristics of the sound signals received by the respective microphones determine the first microphone that can identify the position/direction of the sound source, and then determine the first display area corresponding to the first microphone according to the correspondence between the microphone and the display area, thereby realizing the intelligence of the intelligent multimedia device.
  • the directional display enables it to automatically adjust the visual display area in real time following the change of the direction/position of the sound source, enhance the human-computer interaction effect, and enhance the user experience.
  • the dynamic display area can be dynamically divided into a plurality of sub-areas, and when the visual display area of the intelligent multimedia is adjusted, the first Corresponding relationship between a microphone and a dynamic display area, dynamically determining a first sub-area corresponding to the first microphone on the dynamic display area of the smart multimedia device, and controlling the first sub-area for display, thereby implementing intelligent orientation display of the intelligent multimedia device, It enables it to dynamically adjust the visual display area in real time following the change of direction/position of the sound source, enhance the human-computer interaction effect and enhance the user experience.
  • FIG. 1 is a schematic diagram of a three-dimensional structure of an intelligent multimedia according to an embodiment of the present invention
  • FIG. 2 is an exploded perspective view of an intelligent multimedia according to an embodiment of the present invention.
  • FIG. 3 is a schematic cross-sectional view of an intelligent multimedia according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of multiple display areas of smart multimedia on the side of a prism body according to an embodiment of the present invention
  • FIG. 5 is a flowchart of a display method of an intelligent multimedia device according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a determining manner of a first display area according to an embodiment of the present invention.
  • FIG. 7 is a flowchart of a display method of another smart multimedia device according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of mapping a first sub-area on a dynamic display area according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram showing a correspondence relationship between a first microphone and a first sub-area according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram showing a first sub-area dynamically changing with a change of a first microphone according to an embodiment of the present invention.
  • FIG. 11 is a structural block diagram of a smart multimedia device according to an embodiment of the present invention.
  • FIG. 12 is a structural block diagram of another intelligent multimedia device according to an embodiment of the present invention.
  • the techniques of this disclosure may be implemented in the form of hardware and/or software (including firmware, microcode, etc.). Additionally, the techniques of this disclosure may take the form of a computer program product on a computer readable medium storing instructions for use by or in connection with an instruction execution system.
  • a computer readable medium can be any medium that can contain, store, communicate, propagate or transport the instructions.
  • a computer readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium.
  • the computer readable medium include: a magnetic storage device such as a magnetic tape or a hard disk (HDD); an optical storage device such as a compact disk (CD-ROM); a memory such as a random access memory (RAM) or a flash memory; and/or a wired /Wireless communication link.
  • a magnetic storage device such as a magnetic tape or a hard disk (HDD)
  • an optical storage device such as a compact disk (CD-ROM)
  • a memory such as a random access memory (RAM) or a flash memory
  • RAM random access memory
  • the present invention sets a plurality of display areas on the side of the smart multimedia device.
  • the side of the smart multimedia is an annular side
  • the number of the ring side can be set.
  • Display area when the side of the smart multimedia is composed of the surface of the polyhedron, the display area can be set on each surface of the polyhedron; and the corresponding relationship between the microphone and the display area is set, and the sound source can be identified by analyzing the characteristics of the picked-up sound signal.
  • the first microphone of the position/direction controls the display area of the display area corresponding to the first microphone, and the other display areas do not display the screen to save energy and realize the adjustable visual position of the display screen.
  • the intelligent multimedia of the embodiment of the invention includes, but is not limited to, a smart speaker, a smart TV and the like.
  • FIG. 1 is a schematic perspective view of an intelligent multimedia according to an embodiment of the present invention
  • FIG. 2 is an exploded perspective view of the smart multimedia according to an embodiment of the present invention
  • FIG. 3 is a schematic cross-sectional view of the smart multimedia according to an embodiment of the present invention, as shown in FIG. 3,
  • the intelligent multimedia device of the embodiment of the present invention includes: an upper case 1, a housing 7, a first PCB board 2, a display screen 3, a second PCB board 4, a microphone array and a speaker module 6;
  • the upper casing 1 is fastened on the outer casing 7 and encloses a smart multimedia casing with the outer casing 7.
  • the first PCB board 2 is fixed on the lower side of the upper casing 1, and the microphone array is disposed on the first PCB board 2 and the upper casing 1. Meanwhile, the upper casing 1 is provided with a microphone hole a corresponding to the position of the microphone b in the microphone array, and the microphone b in the microphone array picks up the sound signal of the external sound source through the microphone hole a.
  • the second PCB board 4 is a main control board of intelligent multimedia, and is fixed in the outer casing 7.
  • the display screen 3 is disposed 360 degrees outside the outer casing 7 around the outer casing, and the speaker module 6 is disposed between the second PCB board 4 and the bottom of the outer casing 7.
  • the horn module 6 transmits sound to the outside through the horn hole c on the outer casing 7, and the outer casing 7 is sleeved with a transparent outer casing 5, and the display screen 3 is disposed on the outer casing 7 and between the transparent outer casing 5 and the outer casing 7.
  • the display screen may be composed of a complete display screen, or may be formed by splicing a plurality of display screens, which is not specifically limited in the embodiment of the present invention.
  • components corresponding to each function may be integrated on the second PCB board 4, such as an audio processor, a microprocessor, a screen control module, etc., disposed on the second PCB board 4, and the microphone is picked up by the audio processor.
  • the sound signal is subjected to noise reduction, dereverberation, etc., and the processed sound signal is transmitted to the microprocessor, and the microprocessor determines the intensity value of the sound signal picked up by each microphone, thereby determining the sound source direction and driving the screen.
  • the control module displays the display area corresponding to the direction of the sound source.
  • the microprocessor is configured to perform logic control, such as when the intelligent multimedia device supports the conference work.
  • the screen control module is driven to display the respective display areas corresponding to the plurality of sound source directions, and the microprocessor enters the general working mode.
  • the screen control module is driven to control the display orientation display.
  • FIGS. 1 to 3 are only exemplarily showing a smart multimedia device having a cylindrical side, and the display screen includes a cylindrical side of the circumference, in which case the display screen can be divided into a plurality of display areas, according to the sound source. The location selects the corresponding display area for display.
  • the smart multimedia device can also be a prismatic side. As shown in FIG. 4, a display screen can be provided on each side of the prism, and the smart multimedia device includes five display areas.
  • the smart multimedia device can also be the display side of other shape geometry. The embodiment of the present invention does not limit the shape of the display side of the smart multimedia device.
  • the setting position of each microphone in the microphone array has a corresponding relationship with the display area of the intelligent multimedia device.
  • the display area for human-computer interaction determined by the sound source position is determined to be converted into the display area for human-computer interaction according to the position of the first microphone capable of identifying the sound source position.
  • the present invention specifically describes a display method of an intelligent multimedia device by the following embodiments.
  • One aspect of the present invention provides a display method of a smart multimedia device.
  • FIG. 5 is a flowchart of a display method of a smart multimedia device according to an embodiment of the present invention, wherein the smart multimedia device includes a plurality of display areas disposed on a side thereof, and a ring microphone array disposed on a surface thereof, wherein the ring microphone array is The plurality of microphones have a corresponding relationship with the plurality of display areas, such as a correspondence relationship between the plurality of microphones and the plurality of display areas.
  • the method of the embodiment of the present invention includes:
  • S510 Determine a first microphone according to a sound signal received by each microphone in the ring microphone array.
  • the embodiment of the present invention is based on the fact that the signal strength of the microphone receiving sound signal is related to the sound source position/direction, and the sound signal picked up by the microphone close to the sound source is large, and the ring microphone of the intelligent multimedia device is utilized.
  • Each microphone in the array picks up a sound signal of the sound source, and determines a first microphone capable of indicating a sound source position/direction from among a plurality of microphones picked up to the sound signal, for example, the microphone having the highest received sound signal strength is the first microphone, or
  • the plurality of microphones whose received sound signal strength exceeds the preset intensity value are the first microphones to determine a display area for human-computer interaction corresponding to the first microphone according to the correspondence between the plurality of microphones and the plurality of display areas.
  • S520 Determine a first display area corresponding to the first microphone according to a correspondence between the plurality of microphones and the plurality of display areas.
  • the corresponding relationship between the plurality of display areas and the plurality of microphones is initialized according to the position of each display area of the intelligent multimedia device and the setting position of each microphone in the ring microphone array, for example, one microphone corresponds to one The display area, or multiple microphones corresponding to the same display area. Therefore, after the first microphone is determined, the first display area corresponding to the first microphone may be determined according to the correspondence.
  • a plurality of display areas of the intelligent multimedia setting are preset, and each display area has a corresponding relationship with a corresponding microphone.
  • the sound signals are received according to the respective microphones in the microphone array.
  • the signal feature determines a first microphone that can identify the position/direction of the sound source, and then determines the first display area corresponding to the first microphone according to the correspondence between the microphone and the display area, thereby implementing intelligent orientation display of the intelligent multimedia device, so that the Follow the change of direction/position of the sound source to automatically adjust the visual display area in real time, enhance the human-computer interaction effect and enhance the user experience.
  • the correspondence between the microphone and the display area in the ring microphone array includes a correspondence relationship between the positions of the plurality of microphones and the plurality of display areas. After the sound signal of the sound source is picked up by each microphone in the ring microphone array, the microphone with the highest intensity of the sound signal received in the ring microphone array is determined as the first microphone according to the characteristics of the sound signal, and the set position of the first microphone is obtained, and then according to the microphone. Determining, by the correspondence relationship between the position and the setting position of the first microphone, the first microphone corresponds to the first display area.
  • the first display area is determined.
  • the set position of the first microphone is on the boundary of two adjacent display areas, one of the two adjacent display areas is randomly determined as the first display area, or the display area corresponding to the set rule is determined to be the first display Area, or not responding.
  • the setting rule in the embodiment of the present invention includes, but is not limited to, determining the first display area in the forward/counterclockwise direction of the reference position, and the reference position may be the set position of the first microphone.
  • the above is an example of determining a first display area from a plurality of display areas of a smart multimedia device having a cylindrical side, and it is apparent that the first display area is determined from a plurality of display areas of the smart multimedia device having other shaped sides.
  • the method is similar or identical to the above, and the present invention will not be described again.
  • FIG. 6 is a schematic diagram of a method for determining a first display area according to an embodiment of the present invention.
  • a smart multimedia device includes four display areas, and each of the display areas is provided with eight microphones, and FIG. 6 uses a circle. The dot indicates the microphone.
  • the sound signals of the five microphones A7, B0, B1, B2, and B3 indicated by the black solid dots in the smart multimedia device picked up to the sound source exceed the preset intensity value, and the sound signal picked up by the microphone B1.
  • the display area 2 is determined to be the first display area.
  • the display area 1 is determined to be the first display area.
  • the intensity of the sound signal picked up by the microphone B0 is maximum, Determining that the display area 1 or the display area 2 is the first display area, and determining the first display area according to the setting rule, for example, setting the display area 2 of the clockwise direction when the first microphone B0 is located at the boundary of the adjacent display area It is determined as the first display area, and it is also possible to re-enter the sound pickup without responding.
  • the embodiment of the present invention determines the first microphone according to the microphone with the highest sound signal strength picked up in the microphone array, and determines the first display area corresponding to the first microphone according to the correspondence between the plurality of microphones and the plurality of display areas, which is simple and fast.
  • the advantage is that it is convenient to adjust the visual display area of the intelligent multimedia device in real time.
  • the embodiment of the present invention may further determine the first microphone according to the plurality of microphones whose sound signal intensity picked up in the microphone array exceeds the preset intensity value, the first microphone includes a plurality of reference microphones, and then according to the distribution of the plurality of reference microphones in the display area The situation determines the first display area.
  • the correspondence between the plurality of microphones and the plurality of display areas in the ring microphone array includes a correspondence relationship between the positions of the plurality of microphones and the plurality of display areas.
  • the plurality of reference microphones whose sound signal strength received in the ring microphone array exceeds the preset intensity value is determined according to the characteristics of the sound signal, multiple Referring to the set position of the microphone, the first display area is determined according to the correspondence relationship between the set position between the microphone and the display area and the set position of the plurality of reference microphones.
  • the display area in which the number of reference microphones is larger than the number of reference microphones on the other display areas is the first display area.
  • one display area having the largest number of reference microphones among the three display areas is determined as the first A display area.
  • the first display area is randomly determined from the display area where the set positions of the plurality of reference microphones are located, or the setting rule is determined.
  • the display area is the first display area or does not respond.
  • the setting rule includes: but is not limited to, the display area where the reference microphone with the highest intensity of the sound signal is picked up is the first display area, or the first display area is determined by the forward/counterclockwise direction of the reference position, and the reference position may be some The setting position of the reference microphones.
  • any one of the three display areas is randomly determined as the first Display area.
  • the first display area may also be determined according to a setting rule, for example, the display area where the reference microphone having the highest sound signal intensity is picked up is the first display area.
  • the intensity of the sound signals picked up by the five microphones A7, B0, B1, B2, and B3 indicated by the black solid dots in the smart multimedia device exceeds the preset intensity value, and the five microphones are reference microphones.
  • the microphone A7 is located in the display area 1
  • the four microphones B0, B1, B2, and B3 are located in the display area 2, and it can be determined that the display area 2 is the first display area.
  • the intensity of the sound signal determined by the embodiment is the average value of the amplitude of the sound signal picked up by the corresponding microphone in the ring microphone array in a preset time, so that the determined first microphone can accurately represent the direction of the sound source/ position.
  • the foregoing embodiment of the present invention provides two schemes for determining a first display area.
  • the first scheme determines the first display area according to the intensity of the sound signal picked up by the microphone, which is simple and fast; the second scheme is based on the distribution of the reference microphone and the reference microphone.
  • the intensity of the picked up sound signal determines the first display area, and the determined first display area is more representative of the sound source position/direction.
  • FIG. 7 is a flowchart of a display method of another smart multimedia device according to an embodiment of the present invention.
  • the smart multimedia device includes a dynamic display area disposed on a side thereof, and the dynamic display area can be dynamically divided into multiple sub-areas and disposed on the same.
  • the method of the embodiment of the present invention includes:
  • S710 Determine a first microphone according to a sound signal received by each microphone in the ring microphone array.
  • the embodiment of the present invention is based on the fact that the signal strength of the microphone receiving sound signal is related to the sound source position/direction, and the sound signal picked up by the microphone close to the sound source is large, and the ring microphone of the intelligent multimedia device is utilized.
  • the microphone in the array picks up the sound signal of the sound source, and determines a first microphone capable of indicating the position/direction of the sound source from the plurality of microphones picked up to the sound signal, and then determines the number for human-computer interaction according to the set position of the first microphone.
  • a display area A display area.
  • the corresponding relationship between the first microphone and the dynamic display area includes, but is not limited to, the set position of the first microphone corresponds to the center line of the first sub-area of the dynamic display area, and the boundary line of the first sub-area
  • the apex angle enclosed by the body center point of the intelligent multimedia device has a set angle.
  • the first sub-area of the display area is controlled to be displayed according to the correspondence relationship.
  • the embodiment of the present invention may map the first sub-region corresponding to the first microphone on the display area according to the correspondence between the first microphone and the dynamic display area, thereby controlling the first sub-area to perform human-computer interaction display.
  • a first microphone capable of identifying a sound source position is determined according to a signal characteristic of a sound signal received by each microphone in the microphone array, and the dynamic relationship between the first microphone and the first sub-area is dynamically displayed on the dynamic display area of the intelligent multimedia device. Determining the first sub-region corresponding to the first microphone, and controlling the first sub-region to display, realizing intelligent orientation display of the intelligent multimedia device, so that it can automatically adjust the visual display region in real time following the change of the direction/position of the sound source, and enhance Human-computer interaction effects enhance user experience.
  • the microphone that picks up the sound source in the ring microphone array is used to determine that the microphone with the highest intensity of the received sound signal in the ring microphone array is the first microphone, according to the positional relationship between the first microphone and the dynamic display area. And determining a first sub-area of the dynamic display area, where the first microphone is disposed on a center line of the first sub-area, and the first sub-area is a bottom surface of the cone with the center point of the intelligent multimedia device as a vertex.
  • the above is an example of determining a first sub-area from a dynamic display area of a smart multimedia device having a cylindrical side, and determining the first sub-area from the dynamic display area of the smart multimedia device having other shape sides is the same as the above method. , will not repeat them here.
  • FIG. 8 is a schematic diagram of mapping a first sub-area on a dynamic display area according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram showing a correspondence between a first microphone and a first sub-area according to an embodiment of the present invention, as shown in FIG. 8-9.
  • the microphone A is determined to be the first microphone according to the intensity of the sound signal picked up by the microphone, and according to the set positional relationship between the first microphone and the dynamic display area, determining that the straight line of the setting position of the first microphone on the dynamic display area is AF,
  • the straight line AF is the center line of the first sub-area
  • the first sub-area is the bottom surface BCDE of the cone O-BCDE with the body center point O of the intelligent multimedia device as the apex
  • the arc corresponding to the arc BC of the bottom surface BCDE is ⁇ .
  • the first area when determining the first sub-area, if the dynamic display area is a cylinder or a spherical surface, the first area may be set as a curved surface having a set arc. If the dynamic display area is a plane, the first area may be set as A plane with a set length or width.
  • FIG. 10 is a schematic diagram showing a first sub-area dynamically changing with a change of a first microphone according to an embodiment of the present invention.
  • the microphone A is determined to be the first microphone according to the sound signal strength picked up by the microphone.
  • the microphone A′ is determined to be the first microphone according to the sound signal strength picked up by the microphone.
  • the first sub-region corresponding to the microphone A′ is the microphone B′A′C.
  • the location of the present invention can be seen that the first sub-area can be dynamically adjusted based on the determined position of the first microphone, so that the visual display area of the intelligent multimedia device can be dynamically adjusted in real time based on the position/direction of the sound source.
  • the display method of the embodiment of the invention is particularly applicable to the case where the sound source position is frequently moved.
  • Yet another aspect of the present invention provides an intelligent multimedia device.
  • FIG. 11 is a structural block diagram of a smart multimedia device according to an embodiment of the present invention.
  • the intelligent multimedia device of the embodiment of the present invention includes a plurality of display areas disposed on a side thereof, and a ring microphone array disposed on a surface thereof, and the plurality of microphones in the ring microphone array have a corresponding relationship with the plurality of display areas.
  • the intelligent multimedia device of the embodiment of the present invention further includes:
  • the first signal processing unit 111 is configured to determine the first microphone according to the sound signal received by each microphone in the ring microphone array;
  • a first analysis processing unit 112 configured to determine, according to a correspondence between the plurality of microphones and the plurality of display areas, a first display area corresponding to the first microphone;
  • the first on-screen display control unit 113 is configured to control the first display area for display.
  • the first signal processing unit 111 is specifically configured to determine that the microphone having the highest intensity of the received sound signal in the ring microphone array is the first microphone, wherein the intensity of the sound signal is a corresponding microphone in the ring microphone array within a preset time period. Pick the average of the amplitude of the sound signal.
  • the correspondence between the plurality of microphones and the plurality of display areas includes a correspondence between the positions of the plurality of microphones and the plurality of display areas
  • the first analysis processing unit 112 is configured to use the plurality of microphones and the plurality of Determining a first display area by determining a positional relationship between the display areas and a set position of the first microphone; wherein, when the set position of the first microphone is on the first display area, determining the first display area; When the setting position of the microphone is on the boundary of two adjacent display areas, one of the two adjacent display areas is randomly determined as the first display area; or, the display area corresponding to the setting rule is determined to be the first display area; Or, no response.
  • the first signal processing unit 111 is further configured to determine that the plurality of microphones whose received sound signal strength exceeds a preset intensity value in the circular microphone array is a first microphone, and the first microphone includes a plurality of reference microphones, wherein the sound The intensity of the signal is the average of the amplitudes of the sound signals picked up by the corresponding microphones in the ring microphone array within a preset time period.
  • the correspondence between the plurality of microphones and the plurality of display areas includes a correspondence between the positions of the plurality of microphones and the plurality of display areas
  • the first analysis processing unit 112 is configured to use the plurality of microphones and the plurality of Determining a first display area by determining a positional relationship between the display areas and a plurality of reference microphones; wherein, when the number of the plurality of reference microphone setting positions on the plurality of display areas is different, determining the number of reference microphones a display area larger than the number of reference microphones on the other display areas is the first display area; when the number of the plurality of reference microphone setting positions on the plurality of display areas is the same, randomly from the display area where the set positions of the plurality of reference microphones are located Determining the first display area; or determining that the display area corresponding to the set rule is the first display area; or, not responding.
  • FIG. 12 is a structural block diagram of another intelligent multimedia device according to an embodiment of the present invention.
  • the intelligent multimedia device of the embodiment of the invention comprises a dynamic display area disposed on a side thereof, and an annular microphone array disposed on a surface thereof.
  • the intelligent multimedia device of the embodiment of the present invention further includes:
  • a second signal processing unit 121 configured to determine a first microphone according to a sound signal received by each microphone in the ring microphone array
  • a second analysis processing unit 122 configured to determine a correspondence between the first microphone and the dynamic display area
  • the second on-screen display control unit 123 is configured to control the first sub-area of the dynamic display area to perform display according to the correspondence relationship.
  • the second signal processing unit 121 is specifically configured to determine that the microphone with the highest received sound signal strength in the ring microphone array is the first microphone, wherein the intensity of the sound signal is corresponding to the ring microphone array in a preset time. The average of the amplitude of the sound signal picked up by the microphone.
  • the second analysis processing unit 122 is specifically configured to determine a first sub-area of the dynamic display area according to a set positional relationship between the first microphone and the dynamic display area, where the set position of the first microphone is at a center line of the first sub-area
  • the first sub-area is a bottom surface of the cone set with the center point of the intelligent multimedia device body as a vertex.
  • Yet another aspect of the present invention provides an intelligent multimedia system.
  • the intelligent multimedia system of the embodiment of the present invention includes: one or more storage units for storing executable instructions; and one or more processing units for executing executable instructions to implement the display method of the intelligent multimedia device described above.
  • Yet another aspect of the present invention provides a readable storage medium.
  • the readable storage medium of the embodiment of the present invention stores executable instructions, and when the executable instructions are executed by the processor, the display method of the intelligent multimedia device described above can be implemented.
  • the readable storage medium of the embodiments of the present invention may be, for example, any medium capable of containing, storing, transmitting, transmitting, or transmitting instructions.
  • a readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium.
  • Specific examples of the readable storage medium include: a magnetic storage device such as a magnetic tape or a hard disk (HDD); an optical storage device such as a compact disk (CD-ROM); a memory such as a random access memory (RAM) or a flash memory; and/or a wired /Wireless communication link.
  • the readable storage medium can include a computer program, which can include code/computer executable instructions that, when executed by a processor, cause the processor to perform, for example, the method flow described above and any variations thereof.
  • the computer program can be configured to have, for example, computer program code comprising a computer program module.
  • the code in a computer program can include one or more program modules. It should be noted that the division manner and number of modules are not fixed, and those skilled in the art may use suitable program modules or program module combinations according to actual situations. When these program module combinations are executed by the processor, the processor may execute, for example, The method flow described above and any variations thereof.
  • the words “first” and “second” are used to distinguish the same items or similar items whose functions and functions are substantially the same. Personnel can understand that the words “first” and “second” do not limit the quantity and order of execution.

Abstract

L'invention concerne un dispositif multimédia intelligent et son procédé d'affichage ; ledit dispositif multimédia intelligent comprend une pluralité de régions d'affichage disposées sur une face latérale dudit dispositif et un réseau de microphones en forme d'anneau disposé sur une surface dudit dispositif, le procédé correspondant comprenant les étapes suivantes : selon un signal sonore reçu par chaque microphone dans le réseau de microphones en forme d'anneau, déterminer un premier microphone (S510) ; en fonction de la corrélation entre la pluralité de microphones et la pluralité de régions d'affichage, déterminer une première région d'affichage correspondant au premier microphone (S520) ; commander la première région d'affichage pour effectuer un affichage (S530). Un autre type de dispositif multimédia intelligent comprend une région d'affichage dynamique agencée sur une face latérale dudit dispositif et un réseau de microphones en forme d'anneau disposé sur une surface dudit dispositif, le procédé correspondant comprenant les étapes suivantes : selon un signal sonore reçu par chaque microphone dans le réseau de microphones en forme d'anneau, déterminer un premier microphone (S710) ; déterminer une corrélation entre le premier microphone et la région d'affichage dynamique (S720) ; selon ladite corrélation, commander une première sous-région de la région d'affichage dynamique pour effectuer un affichage (S730). Le dispositif multimédia intelligent est capable d'ajuster automatiquement la région d'affichage visuel en temps réel suite à des changements dans la direction/l'emplacement de la source sonore.
PCT/CN2018/118566 2018-05-08 2018-11-30 Dispositif multimédia intelligent et son procédé d'affichage WO2019214216A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810431760.6 2018-05-08
CN201810431760.6A CN108595139B (zh) 2018-05-08 2018-05-08 智能多媒体设备及其显示方法

Publications (1)

Publication Number Publication Date
WO2019214216A1 true WO2019214216A1 (fr) 2019-11-14

Family

ID=63636038

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/118566 WO2019214216A1 (fr) 2018-05-08 2018-11-30 Dispositif multimédia intelligent et son procédé d'affichage

Country Status (2)

Country Link
CN (1) CN108595139B (fr)
WO (1) WO2019214216A1 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108595139B (zh) * 2018-05-08 2022-09-23 歌尔科技有限公司 智能多媒体设备及其显示方法
WO2020133061A1 (fr) * 2018-12-27 2020-07-02 深圳市柔宇科技有限公司 Procédé de commande et terminal d'affichage
CN111857619A (zh) * 2019-04-26 2020-10-30 深圳市冠旭电子股份有限公司 音箱屏幕的显示控制方法、显示控制装置及音箱
CN112309380B (zh) * 2019-07-26 2024-02-06 北京新能源汽车股份有限公司 一种语音控制方法、系统、设备及汽车

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102820022A (zh) * 2011-06-09 2012-12-12 宏碁股份有限公司 显示装置及其操作方法
CN107589760A (zh) * 2017-08-31 2018-01-16 重庆海尔制冷电器有限公司 一种转动控制台
CN107636696A (zh) * 2016-06-16 2018-01-26 深圳市柔宇科技有限公司 多用户交互方法、装置及陪护机器人
CN108595139A (zh) * 2018-05-08 2018-09-28 歌尔科技有限公司 智能多媒体设备及其显示方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102281233B1 (ko) * 2013-03-14 2021-07-23 삼성전자 주식회사 화면 제어 방법 및 장치
JP6268909B2 (ja) * 2013-10-21 2018-01-31 株式会社Ｓｏｋｅｎ 音響システムおよび超音波フィルタ
TWI544807B (zh) * 2014-07-18 2016-08-01 緯創資通股份有限公司 具喇叭模組的顯示裝置
KR102344045B1 (ko) * 2015-04-21 2021-12-28 삼성전자주식회사 화면을 표시하는 전자 장치 및 그 제어 방법
CN107222798B (zh) * 2017-07-19 2023-08-25 歌尔科技有限公司 一种智能音箱显示装置
CN107643886A (zh) * 2017-09-29 2018-01-30 联想(北京)有限公司 一种多媒体设备及控制方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102820022A (zh) * 2011-06-09 2012-12-12 宏碁股份有限公司 显示装置及其操作方法
CN107636696A (zh) * 2016-06-16 2018-01-26 深圳市柔宇科技有限公司 多用户交互方法、装置及陪护机器人
CN107589760A (zh) * 2017-08-31 2018-01-16 重庆海尔制冷电器有限公司 一种转动控制台
CN108595139A (zh) * 2018-05-08 2018-09-28 歌尔科技有限公司 智能多媒体设备及其显示方法

Also Published As

Publication number Publication date
CN108595139A (zh) 2018-09-28
CN108595139B (zh) 2022-09-23

Similar Documents

Publication Publication Date Title
WO2019214216A1 (fr) Dispositif multimédia intelligent et son procédé d'affichage
US10528154B2 (en) System for projecting content to a display surface having user-controlled size, shape and location/direction and apparatus and methods useful in conjunction therewith
US20190058942A1 (en) Remote Control With Presence Sensor
US20160306422A1 (en) Virtual reality system with a finger-wearable control
US10360876B1 (en) Displaying instances of visual content on a curved display
CN109460074B (zh) 一种音频设备定向显示方法、装置和音频设备
KR102523919B1 (ko) 오디오 재생 및 수집 방법, 장치 및 디바이스 및 판독 가능한 저장 매체
US11806862B2 (en) Robots, methods, computer programs, computer-readable media, arrays of microphones and controllers
KR102565977B1 (ko) 시선에 기반한 관심 영역 검출 방법 및 이를 위한 전자 장치
CN107643886A (zh) 一种多媒体设备及控制方法
US20220083382A1 (en) System With Multiple Electronic Devices
WO2019192061A1 (fr) Procédé, dispositif, support de stockage lisible par ordinateur pour identifier et générer un code graphique
US20110032354A1 (en) Remote-controlled Pointing
AU2011219427A1 (en) A system for projecting content to a display surface having user-controlled size, shape and location/direction and apparatus and methods useful in conjunction therewith
TWI676130B (zh) 顯示裝置
CN109151659B (zh) 一种音频设备定向发声方法、装置和音频设备
US9942660B2 (en) Sound output device
JP2023549843A (ja) コンテンツをキャストするためのシステムおよび方法
CN107479250B (zh) 一种发光装置及电子设备
US20230082748A1 (en) Method and device to display extended screen of mobile device
US11907494B2 (en) Electronic device comprising expandable display, and method for providing content of electronic device
WO2022193883A1 (fr) Procédé et appareil de réponse à une voix de commande, terminal, support de stockage et produit-programme
US11216233B2 (en) Methods and systems for replicating content and graphical user interfaces on external electronic devices
US20230188818A1 (en) Display backplate to facilitate camera magnet attachment to a display panel
US20240069644A1 (en) System and method for enhancing functionality of electronic devices

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18918186

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18918186

Country of ref document: EP

Kind code of ref document: A1