WO2021238550A1 - 音视频播放系统及播放方法、播放装置 - Google Patents

音视频播放系统及播放方法、播放装置 Download PDF

Info

Publication number
WO2021238550A1
WO2021238550A1 PCT/CN2021/090202 CN2021090202W WO2021238550A1 WO 2021238550 A1 WO2021238550 A1 WO 2021238550A1 CN 2021090202 W CN2021090202 W CN 2021090202W WO 2021238550 A1 WO2021238550 A1 WO 2021238550A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
audio
directional
output
display area
Prior art date
Application number
PCT/CN2021/090202
Other languages
English (en)
French (fr)
Inventor
张小牤
彭项君
史天阔
赵晨曦
张硕
侯一凡
孙炎
田丽
刘静
孙伟
姬治华
习艳会
Original Assignee
京东方科技集团股份有限公司
北京京东方光电科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司, 北京京东方光电科技有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US17/785,717 priority Critical patent/US11941318B2/en
Publication of WO2021238550A1 publication Critical patent/WO2021238550A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/12Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14Display of multiple viewports
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/403Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers loud-speakers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303Tracking of listener position or orientation
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/02Improving the quality of display appearance
    • G09G2320/0261Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2203/00Details of circuits for transducers, loudspeakers or microphones covered by H04R3/00 but not provided for in any of its subgroups
    • H04R2203/12Beamforming aspects for stereophonic sound reproduction with loudspeaker arrays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2217/00Details of magnetostrictive, piezoelectric, or electrostrictive transducers covered by H04R15/00 or H04R17/00 but not provided for in any of their subgroups
    • H04R2217/03Parametric transducers where sound is generated or captured by the acoustic demodulation of amplitude modulated ultrasonic waves
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10General applications
    • H04R2499/15Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops

Definitions

  • This application relates to the field of multimedia playback technology, in particular to an audio and video playback system, playback method, and playback device.
  • the picture of each film source carries its own audio source corresponding to the film source being played, and how to ensure that the viewer can effectively listen to the film source he is watching
  • the sound of the picture makes the watched picture correspond to the sound heard, which is a technical problem that needs to be solved when the picture is displayed in a partition.
  • One of the embodiments of the present application provides an audio and video playback system, which includes:
  • Display device including display screen
  • the sound directional output module is configured to output directional sound signals
  • the tracking element is configured to monitor the target visible area in the visible range of a viewer located in the visible range of the display screen, and to monitor that when the viewer is watching the display screen, The target display area on the display screen;
  • the processor is respectively connected to the sound directional output module and the tracking element, and is configured to obtain the first audio and video data to be output in the target display area, and display the image information of the first audio and video data In the target display area, the sound information of the first audio and video data is output to the sound directional output module, so that the sound directional output module outputs a directional sound signal toward the target visible area.
  • the audio and video playback system wherein the number of the sound directional output modules is at least two, and at least two of the sound directional output modules and at least two within the visible range
  • the target visual area corresponds to the target visual area one-to-one
  • the processor is configured to output the sound information of the first audio and video data to the sound orientation corresponding to the target visual area where the viewer is located Output module.
  • the audio and video playback system wherein the target display area is a first display area of the display screen, and the processor is further configured to obtain the first display area on the display screen.
  • the second audio and video data to be output in the second display area outside the area displays the image of the second audio and video data in the second display area.
  • the processor is further configured to: when it is determined that the target display area is switched from the first display area to the second display area, switch the first display area to the second display area.
  • the sound information of the audio and video data is output to the sound directional output module corresponding to the target visible area where the viewer is located, and the sound information of the second audio and video data is output to the sound information of the viewer.
  • the sound directional output module corresponding to the target visible area at the location.
  • the audio and video playback system wherein the processor is outputting the sound information of the first audio and video data to the sound corresponding to the target visual area where the viewer is located.
  • the processor is further configured to output sound information of the second audio and video data to a second sound directional output module;
  • the transmission direction of the directional sound signal output by the second sound directional output module is different from the transmission direction of the directional sound signal output by the first sound directional output module.
  • the processor is further configured to obtain a plurality of audio and video data input to the display device, and according to the plurality of the audio and video data, to the display screen
  • the display area is divided, and the target display area and the first audio and video data output in the target display area are determined.
  • the processor is further configured to:
  • the transmission directions of the directional sound signals output by the sound directional output modules corresponding to different display areas are different.
  • the sound directional output module includes an ultrasonic directional sounder and/or a phased speaker array
  • the processor is also configured to:
  • the transmission directions of the directional sound signals output by the ultrasonic directional sounder group and/or the phased speaker array group corresponding to different display areas are different.
  • the sound directional output module includes an ultrasonic directional sounder and/or a phased speaker array.
  • the tracking element includes:
  • the first camera module is configured to collect images in the visible range, and obtain the target visible area where the viewer is located in the visible range according to the collected images;
  • the second camera module is configured to perform eye tracking on the viewer to obtain eye state information;
  • the target display area is configured to perform eye tracking on the viewer to obtain eye state information;
  • the second camera module includes an infrared camera element.
  • Another embodiment of the present application further provides a playback method of an audio and video playback system, wherein the audio and video playback system includes a display device and a sound directional output module capable of outputting directional sound signals, and the method includes:
  • the display screen of the display device When the viewer is within the visible range of the display screen of the display device, obtain the target visible area where the viewer is within the visible range, and when the viewer is watching the display screen , The target display area on the display screen;
  • the sound directional output module outputs a directional sound signal toward the target visible area.
  • the playback method wherein, when the number of the sound directional output modules is at least two, at least two of the sound directional output modules and at least two in the visible range
  • the outputting the sound information of the first audio and video data to the sound directional output module includes:
  • the sound information of the first audio and video data is output to the sound directional output module corresponding to the target visible area where the viewer is located.
  • the playback method wherein, when the target display area is the first display area of the display screen, the method further includes:
  • the playback method wherein the outputting the sound information of the first audio and video data to the sound directional output module includes:
  • the method also includes:
  • the transmission direction of the directional sound signal output by the second sound directional output module is different from the transmission direction of the directional sound signal output by the first sound directional output module.
  • An embodiment of the present application also provides a playback device of an audio and video playback system, wherein the audio and video playback system includes a display device and a sound directional output module capable of outputting directional sound signals, and the device includes:
  • the information acquisition module is used to acquire the target visual area where the viewer is located within the visual range when the viewer is located within the visual range of the display screen of the display device, and where the viewer is When watching the display screen, the target display area on the display screen;
  • the processing module is configured to display the image information of the first audio and video data to be output in the target display area in the target display area, and output the sound information of the first audio and video data to the sound orientation
  • the output module enables the sound directional output module to output a directional sound signal toward the target visible area.
  • FIG. 1 is a schematic structural diagram of an audio and video playback system according to an embodiment of the application
  • FIG. 2 is a schematic diagram of the structure of the sound directional output module including multiple groups of phased speaker arrays in the audio-visual playback system of the application;
  • FIG. 3 is a schematic structural diagram of one of the partition modes of the display screen in the audio-visual playback system described in this application;
  • FIG. 4 is a schematic structural diagram of another partition mode of the display screen in the audio-visual playback system of the application.
  • FIG. 5 is a schematic flowchart of a playback method according to an embodiment of the application.
  • FIG. 6 is a schematic diagram of the structure of the playback device according to an embodiment of the application.
  • an embodiment of the present application provides an audio and video playback system with a tracking element and a sound directional output module.
  • Group can determine the target visual area where the viewer is and when watching the display screen, in the target display area on the display screen, the processor outputs the image of the first audio and video data to the target display area, and makes the sound directional output model
  • the group outputs the directional sound signal of the first audio data to the target visual area, ensuring that the viewer can effectively listen to the sound of the picture source (first audio and video data) played in the target display area that he is watching, so that the watched picture is consistent with Corresponding to the sound heard.
  • an audio and video playback system As shown in FIG. 1, the audio and video playback system includes:
  • the display device 100 includes a display screen 101;
  • the sound directional output module 102 is configured to output directional sound signals
  • the tracking element 103 is configured to monitor the target visible area 1 in the visible range of the viewer located in the visible range of the display screen 101, and to monitor the viewer (referred to as P1 or P2 indicates) the target display area 2 on the display screen 101 when viewing the display screen 101;
  • the processor respectively connected to the sound directional output module 102 and the tracking element 103, is configured to obtain the first audio and video data to be output in the target display area 2, and display the image information of the first audio and video data in the target display area 2. , Output the sound information of the first audio and video data to the sound directional output module 102, so that the sound directional output module 102 outputs a directional sound signal toward the target visible area 1.
  • the audio and video playback system described in the embodiment of the application can monitor the target visual area where the viewer is located and the target display area on the display screen when watching the display screen by setting the tracking element; by setting the sound directional output module, It can output a directional sound signal to the target visible area, so that the processor can display the image of the first audio and video data to be output on the target display area in the target display area, and output the sound information to the sound directional output module to make the sound
  • the directional output module outputs the sound signal of the first audio and video data to the target visual area to ensure that the viewer located in the target visual area can effectively receive the audio and video played in the target display area when watching the target display area
  • the sound of the data makes the viewed picture correspond to the heard sound.
  • the sound directional output module 102, the tracking element 103, and the processor are all installed on the display device 100.
  • the audio and video playback system integrates a sound directional output module 102 and a tracking element 103, which can follow the viewer’s viewing position and watching gaze, and transmit the sound information corresponding to the image and screen watched by the viewer.
  • the viewing position of the viewer The viewing position of the viewer.
  • the target display area 2 is the first display area of the display screen 101, that is, a part of the display area of the display screen 101, and the processor is further configured to obtain the second display area on the display screen 101.
  • the second audio and video data to be output in the display area displays the image of the second audio data in the second display area.
  • the display screen 101 may include multiple display areas, and each display area may respectively output and display an image frame corresponding to one piece of audio and video data, and different display areas may display image frames of different audio and video data.
  • the target display area 2 is any one of the multiple display areas of the display screen 101 (for example, including the four display areas W1, W2, W3, and W4 in FIG. 1), and the target visible area 1 is the display Any area within the visible range of the screen.
  • image frames of different audio and video data are displayed in sections, and each audio and video data includes corresponding sound information.
  • the viewer is located in any area within the visible range of the display screen 101. , When viewing one of the display areas of the display screen, you can listen to the sound signal corresponding to the image frame you are viewing.
  • the processor when the processor outputs the sound information of the first audio and video data to the sound orientation output module, it outputs the sound information of the first audio and video data to the first sound orientation of the at least two sound orientation output modules.
  • the output module the processor is further configured to output the sound information of the second audio and video data to the second sound directional output module;
  • the transmission direction of the directional sound signal output by the second sound directional output module is different from the transmission direction of the directional sound signal output by the first sound directional output module.
  • different sound directional output modules can simultaneously output different sound signals to different visual areas, so as to meet the corresponding synchronous sound acquisition requirements of different viewers when watching different screen images at the same time.
  • the processor is further configured to:
  • the sound information of the first audio and video data is output to the sound directional output module 102, and the sound information of the second audio and video data is output to Sound directional output module 102.
  • the audio and video playback system can track the display area viewed by the viewer on the display screen 101, and when the display area to be viewed is determined to be switched, the sound information output to the sound directional output module 102 is switched to make the sound
  • the directional output module 102 switches the sound output to the target visible area, and the viewer located in the target visible area can listen to the sound corresponding to the currently viewed image frame in real time.
  • the number of the sound directional output modules 102 is at least two, and the at least two sound directional output modules 102 correspond to at least two visible areas within the visible range on a one-to-one basis.
  • the processor outputs the sound information of the first audio and video data to the sound directional output module 102, it is configured to output the sound information of the first audio and video data to the target visual area 1 where the viewer is located. Sound directional output module 102.
  • different sound directional output modules 102 are configured to be able to output directional sound signals to different visible areas within the visible range.
  • each sound directional output module corresponds to a visual area
  • the sound directional output module is used to output directional sound signals to the corresponding visual area.
  • the processor is configured to record the corresponding relationship between the sound directional output module and the visible area, and when outputting the sound information of the first audio and video data to the sound directional output module, the first audio and video The sound information of the data is output to the sound directional output module corresponding to the target visual area.
  • the processor can output the sound information of the first audio and video data to the first visible area corresponding to the first visible area.
  • a sound directional output module which switches the output to the second sound directional output module corresponding to the second visual area, so that viewers who move to the second visual area can continue to effectively listen to the sound in the second visual area.
  • the sound signal corresponding to the image frame of the target display area being viewed.
  • different sound directional output modules can be used to output directional sound signals to the corresponding visual areas, so that viewers in different visual areas Respectively, the sound signal corresponding to the viewed image can be obtained.
  • the display screen may be divided into at least two display areas, and the at least two display areas also have a corresponding relationship with multiple visible areas within the visible range, and each display area is associated with At least one viewable area has a corresponding relationship, and of course, it may also have a corresponding relationship with at least two viewable areas.
  • multiple viewers located in the same viewable area can obtain corresponding sound signals when simultaneously watching the image screen displayed in the corresponding display area.
  • the viewer when one of the viewing areas includes multiple viewers, and one of the viewers in the same viewing area expects to watch a display area that does not correspond to the viewing area, the viewer’s viewing and the viewing area
  • the processor can be configured to send a reminder to the viewer
  • the information function is used to remind the viewer that if they want to watch a display area that does not correspond to the visible area, they can move to the visible area corresponding to the desired display area, so as to obtain the display area in the visible area.
  • the sound signal corresponding to the image frame of the desired display area.
  • the first display area of the display screen has a corresponding relationship with the first viewable area in the viewable range
  • the second display area of the display screen has a corresponding relationship with the second viewable area in the viewable range.
  • the first display area has a corresponding relationship with the first sound directional output module
  • the second display area has a corresponding relationship with the second sound directional output module.
  • the first sound directional output module can obtain the sound signal corresponding to the image frame displayed in the first display area;
  • this status can be monitored by the tracking element to ensure that other viewers in the first viewing area can be normal Obtain the sound signal corresponding to the image frame displayed in the first display area.
  • the processor can send a reminder to the viewer to remind the viewer to move to the second viewable area, so that the viewer can be in the second viewable area.
  • Watch the image frame of the second display area and listen to the sound signal corresponding to the image frame of the second display area through the second sound directional output module.
  • the reminder information can be sent out through a common speaker provided on the display device; alternatively, the reminder information can also be sent out through the first sound directional output module.
  • the sound directional output module includes an ultrasonic directional sounder.
  • the ultrasonic directional sounder uses ultrasonic waves to propagate outwards in a cylindrical shape and has good directivity characteristics. Ultrasound is selected as the carrier, and the audible sound signal is modulated onto the ultrasonic carrier signal through the radio amplitude modulation technology, and is transmitted through the transducer Amplitude modulation wave realizes the directional propagation of sound signal.
  • the specific principle is: according to the acoustic parameter technology, because when two ultrasonic waves propagate in the air, a variety of harmonics are generated. Except for the difference frequency sound wave, the other harmonics are inaudible ultrasonic waves with high frequencies, but different During the propagation of ultrasonic waves of different frequencies in the air, due to the non-linear acoustic effect of the air, ultrasonic signals of different frequencies will interact and self-demodulate, thereby generating new waves with frequencies including the sum and difference frequencies of the original ultrasonic waves. On this basis, if the ultrasonic wave is selected properly, the difference frequency sound wave can fall in the audible sound domain.
  • the difference frequency wave generated by the interaction during the propagation process also has high directivity, so as to realize the sound
  • the directional propagation of the signal that is, the directional sound. Further, using the principle of constant-amplitude ultrasonic and amplitude-modulated ultrasonic interference, using ordinary audio to achieve fixed-point sound.
  • the audible audio signal of the human ear is modulated into an ultrasonic signal, which is transmitted and propagated through an ultrasonic transducer, and the nonlinear effect of air can be used to restore the same original audio signal.
  • the sound that human ears can hear, its directivity can achieve basically the same effect as the 40kHz ultrasonic signal.
  • the ultrasonic directional sounder includes an ultrasonic generating circuit, a modulation circuit, a filter circuit, a power amplifier circuit, an ultrasonic transducer, and the like.
  • the sound directional output module includes an ultrasonic directional sounder, by outputting the played sound information to the ultrasonic directional sounder, by modulating the sound information into an ultrasonic signal, and using the ultrasonic transducer to transmit and propagate, That is, the sound information can be directionally transmitted to the target visual area.
  • the sound directional output module includes a phased speaker array.
  • a single speaker unit generally radiates omnidirectionally, and adding a horn to the speaker unit can make the sound field of the sound emitted by the speaker unit have a certain directivity.
  • the structural optimization of the horn can be achieved to a certain extent.
  • the main beam width of a single speaker unit is still relatively large, and the energy of the sound field propagates in all directions.
  • multiple speaker units are required to work together for occasions that require high-power sound energy.
  • the speaker array can control the sound field energy radiation within a certain range.
  • the corresponding signal processing algorithm is used to control the direction of the spatial sound field to form a specific sound field, such as improving directivity and radiation width. Therefore, by improving the sound field radiation area and directivity of the array speaker system, the sound experience of the listeners can be greatly improved.
  • an array speaker system is formed by arranging multiple speaker units according to a certain geometric structure (such as a one-dimensional linear array, a two-dimensional array or a three-dimensional array), and combining the speakers arranged according to the geometric structure Array, which performs signal processing on the electrical signal applied by the speaker unit, including processing electrical characteristics such as amplitude, phase, frequency, etc., to obtain different spatial sound field distributions.
  • a certain geometric structure such as a one-dimensional linear array, a two-dimensional array or a three-dimensional array
  • the played sound information is output to the phased speaker array, and a certain sound signal processing method is used to The sound information is processed to form a sound signal with high directivity that can be transmitted to the viewer's position.
  • the phase-controlled speaker array provided by the audio and video playback system may be a group, including multiple speaker units.
  • the processor may output the output in the target display area
  • the sound information of the first audio and video data is transmitted to the phase-controlled speaker array, so that the phase-controlled speaker array outputs a directional sound signal toward the determined target visual area.
  • the processor will display the first audio and video data to be output in the target display area While transmitting the sound information to the phase-controlled speaker array, it also sends a direction switching signal to the phase-controlled speaker array, so that the directional sound signal output by the phase-controlled speaker array is switched from the first visible area to the second visible area.
  • phased loudspeaker array set by the audio and video playback system can be a group, if it is detected that there are multiple viewers in the visible area, and they are in different areas, the phased loudspeaker can be made to radiate omnidirectionally , To meet the voice receiving needs of different viewers.
  • the phased speaker array can be used in many occasions, such as news hearings, churches, etc.
  • the phase-controlled speaker array provided in the audio and video playback system may be at least two groups, and the phase-controlled speaker array of each group includes a plurality of speaker units, as shown in FIG.
  • the array is formed as a sound directional output module 102, and the multiple groups of phased speaker arrays correspond to at least two visible areas in the visible range, so that the multiple groups of phased speaker arrays can be used for different visible areas.
  • the area outputs sound information corresponding to different image frames to satisfy the sound reception of viewers located in different viewing areas when watching different display areas.
  • the processor is further configured to obtain multiple audio and video data input to the display device, and divide the display area of the display screen 101 according to the multiple audio and video data to determine the target display area. And the first audio and video data output in the target display area.
  • the processor determines the number of partitions of the display area according to the number of audio and video data input to the display device 100, and divides the display area.
  • the processor divides the display area into three display areas as shown in FIG. 3;
  • the processor can form four display areas as shown in FIG. 4 after performing area division in the display area.
  • the tracking element 103 includes:
  • the first camera module is configured to collect images in the visible range, and obtain the target visible area of the viewer located in the visible range according to the collected images;
  • the second camera module is configured to perform eye tracking on the viewer to obtain eyeball state information; and, according to the eyeball state information, obtain the target display area on the display screen when the viewer is watching the display screen.
  • the first camera module is used to collect images in the visible range, and the collected images are compared and analyzed with pre-stored images in the visible range to determine the target visible area where the viewer is located.
  • the second camera module is used to track the eyeball of the viewer to obtain eyeball status information. According to the eyeball status information, the target display area on the display screen of the viewer can be determined when viewing the display screen.
  • the second camera module includes, but is not limited to, only an infrared camera element.
  • the first camera module and the second camera module can integrate image acquisition functions and image analysis and processing functions; in another embodiment, the first camera module and the second camera module have an image
  • the acquisition function and the image analysis and processing function can be independent, for example, the chip with the image analysis and processing function can be separated from the first camera module and the second camera module, such as integrated on the processor.
  • the audio and video playback system described in the embodiment of the application can realize the partition display of multiple scenes on the display screen. According to the different scenes the viewer is watching, the sound of the watched scene can be transmitted to the area where the viewer is located in real time, so as to realize the viewing.
  • the user-centric audio-visual linkage effect ensures that the sound is synchronized with the picture and image being viewed, and at the same time avoids the problems of sound reverberation and low privacy caused by the omnidirectional radiation of ordinary speakers.
  • corresponding sound directional output modules are set corresponding to different visual areas, and by switching the sound signals of the sound directional output modules, the demand for appreciating different image scenes in the same visual area can be met.
  • Another embodiment of the present application also provides a playback method of an audio and video playback system, wherein the audio and video playback system includes a display device and a sound directional output module capable of outputting directional sound signals, as shown in FIG. 5, Methods include:
  • S510 When the viewer is located within the visible range of the display screen of the display device, acquire the target visible area where the viewer is located within the visible range, and when the viewer is watching the display Screen, the target display area on the display screen;
  • S520 Display the image information of the first audio and video data to be output in the target display area in the target display area, and output the sound information of the first audio and video data to the sound directional output module , Enabling the sound directional output module to output a directional sound signal toward the target visible area.
  • the outputting the sound information of the first audio and video data to the sound directional output module includes:
  • the sound information of the first audio and video data is output to the sound directional output module corresponding to the target visible area where the viewer is located.
  • the playback method wherein, when the target display area is the first display area of the display screen, the method further includes:
  • step S520 the outputting the sound information of the first audio and video data to the sound directional output module includes:
  • the method further includes:
  • the transmission direction of the directional sound signal output by the second sound directional output module is different from the transmission direction of the directional sound signal output by the first sound directional output module.
  • the method further includes:
  • the sound information of the first audio and video data is output to the sound directional output module, and the second display area is switched to The sound information of the audio and video data is output to the sound directional output module.
  • Another embodiment of the present application also provides a playback device of an audio and video playback system, wherein the audio and video playback system includes a display device and a sound directional output module capable of outputting directional sound signals, as shown in FIG.
  • the device includes:
  • the information acquisition module 610 is configured to acquire the target visual area where the viewer is located within the visual range when the viewer is within the visual range of the display screen of the display device, and the viewer When viewing the display screen, the target display area on the display screen;
  • the processing module 620 is configured to display the image information of the first audio and video data to be output in the target display area in the target display area, and output the sound information of the first audio and video data to the sound
  • the directional output module enables the sound directional output module to output a directional sound signal toward the target visible area.
  • the playback device wherein the number of the sound directional output modules is at least two, and at least two of the sound directional output modules are connected to at least two of the sound directional output modules within the visible range.
  • the processing module 620 outputs the sound information of the first audio and video data to the sound directional output module, including:
  • the sound information of the first audio and video data is output to the sound directional output module corresponding to the target visible area where the viewer is located.
  • the processing module 620 is further configured to:
  • the processing module 620 outputs the sound information of the first audio and video data to the sound directional output module, including:
  • the processing module 620 is also used for:
  • the transmission direction of the directional sound signal output by the second sound directional output module is different from the transmission direction of the directional sound signal output by the first sound directional output module.
  • processing module 620 is further configured to:
  • the sound information of the first audio and video data is output to the sound directional output module, and the second display area is switched to The sound information of the audio and video data is output to the sound directional output module.
  • Using the playback method and playback device described in the embodiments of the present application can ensure that the viewer located in the target visible area, when watching the target display area, effectively receives the sound of the audio and video data played in the target display area, so that the viewer The picture corresponds to the sound heard.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • General Health & Medical Sciences (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

一种音视频播放系统及播放方法、播放装置。该系统包括:显示装置(100);声音定向输出模组(102),被配置为输出定向声音信号;跟踪元件(103),被配置为监测位于显示屏幕(101)的可视范围内的观看者在可视范围内所处的目标可视区域(1),以及监测观看者在观看所述显示屏幕(101)时,在显示屏幕(101)上的目标显示区域(2);处理器,与声音定向输出模组(102)和跟踪元件(103)分别连接,被配置为获取在目标显示区域(2)待输出的第一音视频数据,将第一音视频数据的图像信息显示在目标显示区域(2),将第一音视频数据的声音信息输出至所述声音定向输出模组(102),使声音定向输出模组(102)朝目标可视区域(1)输出定向声音信号。

Description

音视频播放系统及播放方法、播放装置
相关申请的交叉引用
本申请主张在2020年5月26日在中国提交的中国专利申请号No.202010455829.6的优先权,其全部内容通过引用包含于此。
技术领域
本申请涉及多媒体播放技术领域,尤其是指一种音视频播放系统及播放方法、播放装置。
背景技术
随着显示技术的发展,大屏幕显示装置逐步应用于家庭、公园及车站等多种场所,响应大屏幕显示装置在公共场所多个人员的不同观看需求,分区显示不同片源的画面成为大屏幕显示装置的技术发展趋势。
在大屏幕显示装置分区显示至少两个片源的画面时,每一个片源的画面都分别携带自已本身与所播放片源对应的音源,而如何保证观看者能够有效收听到自己所观看片源画面的声音,使所观看画面与收听到的声音对应,为分区显示画面时所需要解决的技术问题。
发明内容
本申请其中一实施例提供一种音视频播放系统,其中,包括:
显示装置,包括显示屏幕;
声音定向输出模组,被配置为输出定向声音信号;
跟踪元件,被配置为监测位于所述显示屏幕的可视范围内的观看者在所述可视范围内所处的目标可视区域,以及监测所述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域;
处理器,与所述声音定向输出模组和所述跟踪元件分别连接,被配置为获取在所述目标显示区域待输出的第一音视频数据,将所述第一音视频数据的图像信息显示在所述目标显示区域,将所述第一音视频数据的声音信息输 出至所述声音定向输出模组,使所述声音定向输出模组朝所述目标可视区域输出定向声音信号。
可选地,所述的音视频播放系统,其中,所述声音定向输出模组的数量为至少两个,至少两个的所述声音定向输出模组与所述可视范围内的至少两个的所述目标可视区域一一对应,所述处理器被配置为将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组。
可选地,所述的音视频播放系统,其中,所述目标显示区域为所述显示屏幕的第一显示区域,所述处理器还被配置为获取在所述显示屏幕上所述第一显示区域外的第二显示区域待输出的第二音视频数据,将所述第二音视频数据的图像显示在所述第二显示区域。
可选地,所述的音视频播放系统,其中,所述处理器还被配置为:在确定所述目标显示区域由所述第一显示区域切换为第二显示区域时,将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组,切换为将所述第二音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组。
可选地,所述的音视频播放系统,其中,所述处理器在将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组时,将所述第一音视频数据的声音信息输出到至少两个声音定向输出模组中的与观看者所处的所述目标可视区域相对应的第一声音定向输出模组,所述处理器还被配置为将所述第二音视频数据的声音信息输出至第二声音定向输出模组;
其中,所述第二声音定向输出模组所输出定向声音信号的传输方向与所述第一声音定向输出模组所输出定向声音信号的传输方向不同。
可选地,所述的音视频播放系统,其中,所述处理器还被配置为获取输入至所述显示装置的多个音视频数据,根据多个所述音视频数据,对所述显示屏幕进行显示区域划分,确定所述目标显示区域和在所述目标显示区域输出的所述第一音视频数据。
可选地,所述的音视频播放系统,其中,所述处理器还被配置为:
按照多个所述音视频数据的数量将所述显示屏幕划分为同等数量的显示区域,并令每一显示区域对应至少一个所述声音定向输出模组;
获取每一显示区域的待输出的音视频数据,将每一显示区域待输出的音视频数据的图像信息显示在每一显示区域,并将每一显示区域待输出的音视频数据的声音信息输出至每一显示区域所对应的至少一个所述声音定向输出模组。
可选地,所述的音视频播放系统,其中,对应不同显示区域的所述声音定向输出模组所输出定向声音信号的传输方向不同。
可选地,所述的音视频播放系统,其中,所述声音定向输出模组包括超声定向发声器和/或相控扬声器阵列;
所述处理器还被配置为:
按照多个所述音视频数据的数量将所述显示屏幕划分为同等数量的显示区域,并将所述超声定向发声器和/或相控扬声器阵列划分为同等数量的超声定向发声器组和/或相控扬声器阵列组;
获取每一显示区域的待输出的音视频数据,将每一显示区域待输出的音视频数据的图像信息显示在每一显示区域,并将每一显示区域待输出的音视频数据的声音信息输出至每一显示区域所对应的超声定向发声器组和/或相控扬声器阵列组。
可选地,所述的音视频播放系统,其中,对应不同显示区域的所述超声定向发声器组和/或相控扬声器阵列组所输出定向声音信号的传输方向不同。
可选地,所述的音视频播放系统,其中,所述声音定向输出模组包括超声定向发声器和/或相控扬声器阵列。
可选地,所述的音视频播放系统,其中,所述跟踪元件包括:
第一摄像模组,被配置为采集所述可视范围内的图像,根据所采集的图像获得位于所述可视范围内的观看者所处的目标可视区域;
第二摄像模组,被配置为对所述观看者进行眼球追踪,获得眼球状态信息;以及根据所述眼球状态信息,获得所述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域。
可选地,所述的音视频播放系统,其中,所述第二摄像模组包括红外摄 像元件。
本申请另一实施例还提供一种音视频播放系统的播放方法,其中,所述音视频播放系统包括显示装置和能够输出定向声音信号的声音定向输出模组,所述方法包括:
在观看者位于所述显示装置的显示屏幕的可视范围内时,获取所述观看者在所述可视范围内所处的目标可视区域,以及所述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域;
将在所述目标显示区域待输出的第一音视频数据的图像信息,显示在所述目标显示区域,以及将所述第一音视频数据的声音信息输出至所述声音定向输出模组,使所述声音定向输出模组朝所述目标可视区域输出定向声音信号。
可选地,所述的播放方法,其中,在所述声音定向输出模组的数量为至少两个,至少两个的所述声音定向输出模组与所述可视范围内的至少两个的所述目标可视区域一一对应时,所述将所述第一音视频数据的声音信息输出至所述声音定向输出模组,包括:
将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组。
可选地,所述的播放方法,其中,在目标显示区域为所述显示屏幕的第一显示区域时,所述方法还包括:
获取在所述显示屏幕上所述第一显示区域外的第二显示区域待输出的第二音视频数据,将所述第二音视频数据的图像显示在所述第二显示区域。
可选地,所述的播放方法,其中,所述将所述第一音视频数据的声音信息输出至所述声音定向输出模组,包括:
将所述第一音视频数据的声音信息输出到至少两个声音定向输出模组中的与观看者所处的所述目标可视区域相对应的第一声音定向输出模组;
所述方法还包括:
将所述第二音视频数据的声音信息输出至第二声音定向输出模组;
其中,所述第二声音定向输出模组所输出定向声音信号的传输方向与所述第一声音定向输出模组所输出定向声音信号的传输方向不同。
本申请实施例还提供一种音视频播放系统的播放装置,其中,所述音视频播放系统包括显示装置和能够输出定向声音信号的声音定向输出模组,所述装置包括:
信息获取模块,用于在观看者位于所述显示装置的显示屏幕的可视范围内时,获取所述观看者在所述可视范围内所处的目标可视区域,以及所述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域;
处理模块,用于将在所述目标显示区域待输出的第一音视频数据的图像信息,显示在所述目标显示区域,以及将所述第一音视频数据的声音信息输出至所述声音定向输出模组,使所述声音定向输出模组朝所述目标可视区域输出定向声音信号。
附图说明
图1为本申请实施例所述音视频播放系统的结构示意图;
图2为本申请所述音频视播放系统中,声音定向输出模组包括多组相控扬声器阵列的结构示意图;
图3为本申请所述音频视播放系统中,显示屏幕的其中一分区方式的结构示意图;
图4为本申请所述音频视播放系统中,显示屏幕的另一分区方式的结构示意图;
图5为本申请实施例所述播放方法的流程示意图;
图6为本申请实施例所述播放装置的结构示意图。
具体实施方式
为使本申请要解决的技术问题、技术方案和优点更加清楚,下面将结合附图及具体实施例进行详细描述。
为保证观看者能够有效收听到自己所观看片源画面的声音,不受其他片源画面播放所输出声音的干扰,本申请实施例提供一种音视频播放系统,设置跟踪元件和声音定向输出模组,能够确定观看者所处的目标可视区域和在观看显示屏幕时,在显示屏幕上的目标显示区域,处理器向目标显示区域输 出第一音视频数据的图像,并使声音定向输出模组朝目标可视区域输出第一音频数据的定向声音信号,保证观看者能够有效收听到自己所观看的目标显示区域所播放片源(第一音视频数据)画面的声音,使所观看画面与收听到的声音对应。
本申请一实施例提供一种音视频播放系统,如图1所示,该音视频播放系统包括:
显示装置100,包括显示屏幕101;
声音定向输出模组102,被配置为输出定向声音信号;
跟踪元件103,被配置为监测位于所述显示屏幕101的可视范围内的观看者在所述可视范围内所处的目标可视区域1,以及监测观看者(在图1中以P1或P2表示)在观看显示屏幕101时,在显示屏幕101上的目标显示区域2;
处理器,与声音定向输出模组102和跟踪元件103分别连接,被配置为获取在目标显示区域2待输出的第一音视频数据,将第一音视频数据的图像信息显示在目标显示区域2,将第一音视频数据的声音信息输出至声音定向输出模组102,使声音定向输出模组102朝目标可视区域1输出定向声音信号。
本申请实施例所述音视频播放系统,通过设置跟踪元件能够监测观看者所处的目标可视区域和在观看显示屏幕时,在显示屏幕上的目标显示区域;通过设置声音定向输出模组,能够朝目标可视区域输出定向声音信号,这样处理器能够将目标显示区域上待输出的第一音视频数据的图像显示在目标显示区域,并将声音信息输出至声音定向输出模组,使声音定向输出模组朝目标可视区域输出该第一音视频数据的声音信号,保证位于该目标可视区域内的观看者在观看目标显示区域时,能够有效收到该目标显示区域所播放音视频数据的声音,使所观看画面与收听到的声音对应。
本申请实施例中,可选地,所述的音视频播放系统,其中,声音定向输出模组102、跟踪元件103和处理器均安装于显示装置100上。
采用该实施方式,音视频播放系统集成有声音定向输出模组102和跟踪元件103,能够实现观看者的观看位置和观看目光的跟随,将观看者所观看 图像画面相对应的声音信息定向传输至观看者所处的观看位置处。
本申请实施例中,可选地,目标显示区域2为显示屏幕101的第一显示区域,也即为显示屏幕101的其中一部分显示区域,处理器还被配置为获取在显示屏幕101上第二显示区域待输出的第二音视频数据,将第二音频数据的图像显示在第二显示区域。
可选地,显示屏幕101可以包括多个显示区域,每一个显示区域可以分别输出显示一个音视频数据所对应的图像画面,不同的显示区域可以显示不同音视频数据的图像画面。
其中,目标显示区域2为显示屏幕101的多个显示区域(如包括图1中的W1、W2、W3和W4,该四个显示区域)中的任一显示区域,目标可视区域1为显示屏幕的可视范围内的任一区域。
采用该实施方式,在显示屏幕101上,分区显示不同音视频数据的图像画面,每一音视频数据分别包括对应的声音信息,位于显示屏幕101的可视范围内的任一区域内的观看者,在观看显示屏幕的其中一显示区域时,能够收听到与所观看的图像画面相对应的声音信号。
可选地,处理器在将第一音视频数据的声音信息输出至声音定向输出模组时,将第一音视频数据的声音信息输出到至少两个声音定向输出模组中的第一声音定向输出模组,处理器还被配置为将第二音视频数据的声音信息输出至第二声音定向输出模组;
其中,第二声音定向输出模组所输出定向声音信号的传输方向与第一声音定向输出模组所输出定向声音信号的传输方向不同。
采用该实施方式,不同的声音定向输出模组可以同时向不同的可视区域输出不同的声音信号,以能够满足不同观看者在同时观看不同画面图像时相对应的同步声音获取需求。
本申请实施例中,可选地,处理器还被配置为:
在确定目标显示区域2由第一显示区域切换为第二显示区域时,将第一音视频数据的声音信息输出至声音定向输出模组102,切换为将第二音视频数据的声音信息输出至声音定向输出模组102。
采用该实施方式,音视频播放系统能够跟踪观看者在显示屏幕101上观 看的显示区域,在确定所观看的显示区域切换时,对输出至声音定向输出模组102的声音信息进行切换,使声音定向输出模组102朝目标可视区域输出的声音切换,位于该目标可视区域的观看者能够实时地收听到当前所观看图像画面相对应的声音。
本申请实施例中,可选地,声音定向输出模组102的数量为至少两个,至少两个的声音定向输出模组102与可视范围内的至少两个的可视区域一一对应,处理器在将第一音视频数据的声音信息输出至声音定向输出模组102时,被配置为将第一音视频数据的声音信息输出至与观看者所处的目标可视区域1相对应的声音定向输出模组102。
可选地,至少两个的声音定向输出模组102中,不同的声音定向输出模组102被配置为能够朝可视范围内的不同可视区域输出定向声音信号。
如图1所示,设定显示屏幕的可视范围内包括可视区域A1、A2、A3、…、A9,共9个可视区域时,则可以在显示装置100上设置S1、S2、S3、…、S9,共9个声音定向输出模组,每一声音定向输出模组分别对应一个可视区域,声音定向输出模组用于向相对应的可视区域输出定向声音信号。
采用该实施方式,处理器被配置为记录声音定向输出模组与可视区域之间的对应关系,在将第一音视频数据的声音信息输出至声音定向输出模组时,将第一音视频数据的声音信息输出至与目标可视区域相对应的声音定向输出模组。
进一步地,在观看目标显示区域的观看者由第一可视区域移动至第二可视区域时,处理器能够将第一音视频数据的声音信息由输出至与第一可视区域对应的第一声音定向输出模组,切换输出至与第二可视区域对应的第二声音定向输出模组,使移动至第二可视区域的观看者能够在第二可视区域继续有效地收听到与所观看的目标显示区域的图像画面相对应的声音信号。
此外,采用该实施结构,对于位于可视范围内不同可视区域的观看者,可以通过不同的声音定向输出模组分别向相应的可视区域输出定向声音信号,使不同可视区域的观看者分别能够获得相应所观看的图像画面的声音信号。
可选地,本申请实施例中,显示屏幕可以被划分为至少两个显示区域,且至少两个的显示区域与可视范围内的多个可视区域也具有对应关系,每一 显示区域与至少一个可视区域具有对应关系,当然也可以与至少两个可视区域具有对应关系。
采用该实施方式,位于同一可视区域的多个观看者同时观看相对应显示区域所显示图像画面时,均能够获得相对应的声音信号。可选地,当其中一可视区域内包括多个观看者,在位于同一可视区域内的其中一观看者期望观看与该可视区域不相对应的显示区域,该观看者观看与该可视区域不相对应的显示区域的状态被跟踪元件监测到时,为保证每一观看者均能够观看到图像画面,并收听到相对应的声音信号,处理器可以被配置为向观看者发出提示信息的功能,用于提示观看者若期望观看与该可视区域不相对应的显示区域,则可以移动至与所期望观看的显示区域相对应的可视区域,以在该可视区域获得与所期望观看的显示区域的图像画面相对应的声音信号。
举例说明,显示屏幕的第一显示区域与可视范围内的第一可视区域具有对应关系,显示屏幕的第二显示区域与可视范围内的第二可视区域具有对应关系,进一步地,第一显示区域与第一声音定向输出模组具有对应关系,第二显示区域与第二声音定向输出模组具有对应关系。当观看者位于第一可视区域内观看第一显示区域的图像画面时,通过第一声音定向输出模组可以获得与第一显示区域所显示的图像画面相对应的声音信号;当第一可视区域内包括多个观看者时,若其中一观看者当前在观看第二显示区域的图像画面,该状态可以被跟踪元件所监测到,为保证第一可视区域内的其他观看者能够正常获得与第一显示区域所显示的图像画面相对应的声音信号,此时处理器可以向观看者发出提醒观看者移动至第二可视区域的提醒信息,使观看者在第二可视区域能够观看第二显示区域的图像画面,并通过第二声音定向输出模组收听到与第二显示区域的图像画面相对应的声音信号。可选地,可以通过显示装置上设置的普通扬声器发出提醒信息;可选地,也可以通过第一声音定向输出模组发出提醒信息。
本申请实施例所述音视频播放系统的其中一实施方式,所述声音定向输出模组包括超声定向发声器。
超声定向发声器利用超声波呈柱状向外传播,具有很好的指向性的特性,选用超声波作为载波,通过无线电调幅技术,将可听声音信号调制到超声载 波信号之上,并经换能器发射调幅波,实现声音信号的定向传播。
具体原理为:根据声学参量技术,由于当两束超声波在空气传播的过程中,产生多种谐波,除了差频声波外,其他谐波者是听不见的频率都很高的超声波,但不同频率的超声波在空气中传播的过程中,由于空气的非线性声学效应,不同频率的超声波信号会发生交互作用和自解调,进而产生频率为包括原超声波的和频及差频的新波。在此基础上,若超声波选取合适,则差频声波可落在可听声域,由于超声波具有高指向性,因此在传播过程中相互作用产生的差频波亦具有高的指向性,从而实现声音信号的定向传播,即定向发声。进一步地,利用等幅超声波和调幅调制超声波干涉原理,使用普通音频可实现声音定点发声。
因此,利用上述原理,采用无线电调幅技术,将人耳可听见的音频信号调制为超声波信号,通过超声波换能器进行发射、传播,并利用空气的非线性作用,可还原得到与原始音频信号相同、人耳可以听到的声音,其指向性可以达到与40kHz的超声波信号基本相同的效果。
可选地,超声定向发声器包括超声波发生电路、调制电路、滤波电路、功率放大电路和超声波换能器等。
根据以上,当声音定向输出模组包括超声定向发声器时,通过将所播放的声音信息输出至超声定向发声器,通过将声音信息调制为超声波信号,并利用超声波换能器进行发射、传播,即能够将声音信息定向传输至目标可视区域。
本申请实施例所述音视频播放系统的另一实施方式,所述声音定向输出模组包括相控扬声器阵列。
需要说明的是,单个扬声器单元一般是全向辐射,而对扬声器单元增加号筒后,可以使扬声器单元所发出声音的声场具有一定的指向性,对号筒进行结构上的优化,可以在一定程度上提高单个扬声器的声场指向性,特别是在高频段声音的声场指向性。但是,在低频段时,单个扬声器单元的主波束宽度依然比较大,声场的能量向着各个方向传播。同时,由于单个扬声器单元辐射的功率有限,因此对于需要大功率声能量的场合,需要多个扬声器单元协同工作。而扬声器阵列能够将声场能量辐射控制在一定的范围。基于特 定几何结构的扬声器阵列,采用相应的信号处理算法实现对空间声场指向的控制,形成特定的声场,例如改善指向性以及辐射宽度。因此通过改善阵列扬声器系统的声场辐射区域,以及指向性可以大大改善听众的声音感受。
根据以上原理,通过将多个扬声器单元按照一定的几何结构排列(如排列为一维线阵、二维面阵或三维体阵等形式)组成阵列式扬声器系统,并结合依据几何结构排列的扬声器阵列,对扬声器单元施加的电信号进行信号处理,包括对振幅、相位、频率等电气特性量进行处理,即可得到不同的空间声场分布。
因此,本申请实施例所述音视频播放系统中,在确定发声目标位置和观看者位置的基础上,通过将所播放的声音信息输出至相控扬声器阵列,并采用一定的声音信号处理方法对声音信息进行处理,则形成能够传输至观看者位置具有高指向性的声音信号。
本申请实施例中,可选地,音视频播放系统所设置的相控扬声器阵列可以为一组,包括多个扬声器单元,通过所设置的该相控扬声器阵列,在利用跟踪元件监测到观看者在所述可视范围内所处的目标可视区域,以及观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域后,处理器可以将在所述目标显示区域待输出的第一音视频数据的声音信息传输至相控扬声器阵列,使相控扬声器阵列朝所确定的目标可视区域输出定向声音信号。
在此基础上,当利用跟踪元件监测到观看者在可视范围内由第一可视区域移动至第二可视区域后,处理器将在所述目标显示区域待输出的第一音视频数据的声音信息传输至相控扬声器阵列的同时,还向相控扬声器阵列发送方向切换信号,使相控扬声器阵列输出的定向声音信号由第一可视区域切换至第二可视区域。
可选地,当音视频播放系统所设置的相控扬声器阵列可以为一组时,若检测到可视区域内的观看者为多个,分别在不同区域,则可以使相控扬声器全向辐射,以满足不同观看者的声音接收需求。
在大型的室内封闭环境,普通的声源因为空间容积大,造成混响的时间长,最后得到的声场语音清晰度下降,浑浊不清,对声音信息的传播不利。而扬声器阵列对声场的重构能力可以对该问题进行缓解和改善。由于扬声器 阵列可以形成指向性很高的声场,将声音的辐射模式从球面波辐射改变为近似柱型波的辐射方式,因此,声音能量的衰减更缓慢,有效改善了近场声压特别大、远场声压特别小的情况。基于该些优势,相控扬声器阵列可以在很多场合进行运用,比如新闻听证会、教堂等。
可选地,音视频播放系统所设置的相控扬声器阵列可以为至少两组,每一组的相控扬声器阵列分别包括多个扬声器单元,如图2所示,其中每一组的相控扬声器阵列形成为一个声音定向输出模组102,多组的相控扬声器阵列与可视范围内的至少两个的可视区域一一对应,这样利用多组的相控扬声器阵列能够向不同的可视区域输出不同图像画面相对应的声音信息,满足位于不同可视区域的观看者在观看不同显示区域时的声音接收。
本申请实施例中,可选地,处理器还被配置为获取输入至所述显示装置的多个音视频数据,根据多个音视频数据,对显示屏幕101进行显示区域划分,确定目标显示区域和在目标显示区域输出的所述第一音视频数据。
需要说明的是,多个音视频数据分别对应不同的场景图像画面,处理器根据输入至显示装置100的音视频数据的数量确定显示区域的分区数,并对显示区域进行划分。
举例说明,在输入至显示装置100的音视频数据的数量为3个时,处理器在显示区域进行区域划分后,可以形成为如图3所示的三个显示区域;在输入至显示装置100的音视频数据的数量为4个时,处理器在显示区域进行区域划分后,可以形成为如图4所示的四个显示区域。
上述对显示区域进行区域划分的结构形式仅为举例说明,具体并不以此为限。
本申请实施例中,可选地,如图1所示,跟踪元件103包括:
第一摄像模组,被配置为采集可视范围内的图像,根据所采集的图像获得位于可视范围内的观看者所处的目标可视区域;
第二摄像模组,被配置为对观看者进行眼球追踪,获得眼球状态信息;以及根据所述眼球状态信息,获得观看者在观看所述显示屏幕时,在显示屏幕上的目标显示区域。
具体地,利用第一摄像模组采集可视范围内的图像,并将所采集的图像 与预先存储的可视范围的图像进行对比分析,可以确定观看者所处的目标可视区域。
利用第二摄像模组对观看者的眼球进行追踪,获得眼球状态信息,根据该眼球状态信息,可以确定观看者在观看显示屏幕时在显示屏幕上的目标显示区域。
可选地,所述第二摄像模组包括但并不限于仅能够包括红外摄像元件。
可选地,其中一实施方式,第一摄像模组和第二摄像模组可以集成图像采集功能和图像分析处理功能;另一实施方式,第一摄像模组和第二摄像模组上,图像采集功能和图像分析处理功能可以分别独立,如可以将具备图像分析处理功能的芯片从第一摄像模组和第二摄像模组上分离出来,如集成于处理器上。
需要说明的是,本领域技术人员根据本申请实施例所述音视频播放系统,应该能够了解通过第二摄像模组进行眼球追踪,确定观看者在观看显示屏幕时在显示屏幕上的目标显示区域的具体方式,在此不再详细说明。
本申请实施例所述音视频播放系统,能够实现显示屏幕上多场景的分区显示,根据观看者所注视场景的不同,实时地将所注视场景的声音传输至该观看者所在区域,实现以观看者为中心的视听联动效果,保证声音与所观看画面图像的同步,同时达到避免普通扬声器全向辐射导致的声音混响和私密性低的问题。此外,对应不同可视区域分别设置相应的声音定向输出模组,通过切换声音定向输出模组的声音信号,可以满足在同一可视区域鉴赏不同的影像场景的需求。
本申请另一实施例还提供一种音视频播放系统的播放方法,其中,所述音视频播放系统包括显示装置和能够输出定向声音信号的声音定向输出模组,如图5所示,所述方法包括:
S510,在观看者位于所述显示装置的显示屏幕的可视范围内时,获取所述观看者在所述可视范围内所处的目标可视区域,以及所述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域;
S520,将在所述目标显示区域待输出的第一音视频数据的图像信息,显示在所述目标显示区域,以及将所述第一音视频数据的声音信息输出至所述 声音定向输出模组,使所述声音定向输出模组朝所述目标可视区域输出定向声音信号。
可选地,在所述声音定向输出模组的数量为至少两个,至少两个的所述声音定向输出模组与所述可视范围内的至少两个的所述目标可视区域一一对应时,在步骤S520,所述将所述第一音视频数据的声音信息输出至所述声音定向输出模组,包括:
将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组。
可选地,所述的播放方法,其中,在目标显示区域为所述显示屏幕的第一显示区域时,所述方法还包括:
获取在所述显示屏幕上所述第一显示区域外的第二显示区域待输出的第二音视频数据,将所述第二音视频数据的图像显示在所述第二显示区域。
可选地,所述的播放方法,其中,在步骤S520,所述将所述第一音视频数据的声音信息输出至所述声音定向输出模组,包括:
将所述第一音视频数据的声音信息输出到至少两个声音定向输出模组中的第一声音定向输出模组;
可选地,所述方法还包括:
将所述第二音视频数据的声音信息输出至第二声音定向输出模组;
其中,所述第二声音定向输出模组所输出定向声音信号的传输方向与所述第一声音定向输出模组所输出定向声音信号的传输方向不同。
可选地,所述方法还包括:
在确定所述目标显示区域由所述第一显示区域切换为第二显示区域时,将所述第一音视频数据的声音信息输出至所述声音定向输出模组,切换为将所述第二音视频数据的声音信息输出至所述声音定向输出模组。
本申请另一实施例还提供一种音视频播放系统的播放装置,其中,所述音视频播放系统包括显示装置和能够输出定向声音信号的声音定向输出模组,如图6所示,所述装置包括:
信息获取模块610,用于在观看者位于所述显示装置的显示屏幕的可视范围内时,获取所述观看者在所述可视范围内所处的目标可视区域,以及所 述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域;
处理模块620,用于将在所述目标显示区域待输出的第一音视频数据的图像信息,显示在所述目标显示区域,以及将所述第一音视频数据的声音信息输出至所述声音定向输出模组,使所述声音定向输出模组朝所述目标可视区域输出定向声音信号。
可选地,所述的播放装置,其中,在所述声音定向输出模组的数量为至少两个,至少两个的所述声音定向输出模组与所述可视范围内的至少两个的所述目标可视区域一一对应时,所述处理模块620将所述第一音视频数据的声音信息输出至所述声音定向输出模组,包括:
将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组。
可选地,所述的播放装置,其中,在目标显示区域为所述显示屏幕的第一显示区域时,处理模块620还用于:
获取在所述显示屏幕上所述第一显示区域外的第二显示区域待输出的第二音视频数据,将所述第二音视频数据的图像显示在所述第二显示区域。
可选地,所述的播放装置,其中,处理模块620将所述第一音视频数据的声音信息输出至所述声音定向输出模组,包括:
将所述第一音视频数据的声音信息输出到至少两个声音定向输出模组中的第一声音定向输出模组;
处理模块620还用于:
将所述第二音视频数据的声音信息输出至第二声音定向输出模组;
其中,所述第二声音定向输出模组所输出定向声音信号的传输方向与所述第一声音定向输出模组所输出定向声音信号的传输方向不同。
可选地,处理模块620还用于:
在确定所述目标显示区域由所述第一显示区域切换为第二显示区域时,将所述第一音视频数据的声音信息输出至所述声音定向输出模组,切换为将所述第二音视频数据的声音信息输出至所述声音定向输出模组。
采用本申请实施例所述播放方法和播放装置,能够保证位于该目标可视区域内的观看者在观看目标显示区域时,有效收到该目标显示区域所播放音 视频数据的声音,使所观看画面与收听到的声音对应。
以上所述的是本申请的可选实施方式,应当指出对于本技术领域的普通人员来说,在不脱离本申请所述原理前提下,还可以作出若干改进和润饰,这些改进和润饰也应视为本申请的保护范围。

Claims (18)

  1. 一种音视频播放系统,包括:
    显示装置,包括显示屏幕;
    声音定向输出模组,被配置为输出定向声音信号;
    跟踪元件,被配置为监测位于所述显示屏幕的可视范围内的观看者在所述可视范围内所处的目标可视区域,以及监测所述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域;
    处理器,与所述声音定向输出模组和所述跟踪元件分别连接,被配置为获取在所述目标显示区域待输出的第一音视频数据,将所述第一音视频数据的图像信息显示在所述目标显示区域,将所述第一音视频数据的声音信息输出至所述声音定向输出模组,使所述声音定向输出模组朝所述目标可视区域输出定向声音信号。
  2. 根据权利要求1所述的音视频播放系统,其中,所述声音定向输出模组的数量为至少两个,至少两个的所述声音定向输出模组与所述可视范围内的至少两个的所述目标可视区域一一对应,所述处理器被配置为将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组。
  3. 根据权利要求1或2所述的音视频播放系统,其中,所述目标显示区域为所述显示屏幕的第一显示区域,所述处理器还被配置为获取在所述显示屏幕上所述第一显示区域外的第二显示区域待输出的第二音视频数据,将所述第二音视频数据的图像显示在所述第二显示区域。
  4. 根据权利要求3所述的音视频播放系统,其中,所述处理器还被配置为:在确定所述目标显示区域由所述第一显示区域切换为第二显示区域时,将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组,切换为将所述第二音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应的所述声音定向输出模组。
  5. 根据权利要求3所述的音视频播放系统,其中,所述处理器在将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视区域相对应 的所述声音定向输出模组时,将所述第一音视频数据的声音信息输出到至少两个声音定向输出模组中的与观看者所处的所述目标可视区域相对应的第一声音定向输出模组,所述处理器还被配置为将所述第二音视频数据的声音信息输出至第二声音定向输出模组;
    其中,所述第二声音定向输出模组所输出定向声音信号的传输方向与所述第一声音定向输出模组所输出定向声音信号的传输方向不同。
  6. 根据权利要求1所述的音视频播放系统,其中,所述处理器还被配置为获取输入至所述显示装置的多个音视频数据,根据多个所述音视频数据,对所述显示屏幕进行显示区域划分,确定所述目标显示区域和在所述目标显示区域输出的所述第一音视频数据。
  7. 根据权利要求6所述的音视频播放系统,其中,所述处理器还被配置为:
    按照多个所述音视频数据的数量将所述显示屏幕划分为同等数量的显示区域,并令每一显示区域对应至少一个所述声音定向输出模组;
    获取每一显示区域的待输出的音视频数据,将每一显示区域待输出的音视频数据的图像信息显示在每一显示区域,并将每一显示区域待输出的音视频数据的声音信息输出至每一显示区域所对应的至少一个所述声音定向输出模组。
  8. 根据权利要求7所述的音视频播放系统,其中,对应不同显示区域的所述声音定向输出模组所输出定向声音信号的传输方向不同。
  9. 根据权利要求6所述的音视频播放系统,其中,所述声音定向输出模组包括超声定向发声器和/或相控扬声器阵列;
    所述处理器还被配置为:
    按照多个所述音视频数据的数量将所述显示屏幕划分为同等数量的显示区域,并将所述超声定向发声器和/或相控扬声器阵列划分为同等数量的超声定向发声器组和/或相控扬声器阵列组;
    获取每一显示区域的待输出的音视频数据,将每一显示区域待输出的音视频数据的图像信息显示在每一显示区域,并将每一显示区域待输出的音视频数据的声音信息输出至每一显示区域所对应的超声定向发声器组和/或相 控扬声器阵列组。
  10. 根据权利要求9所述的音视频播放系统,其中,对应不同显示区域的所述超声定向发声器组和/或相控扬声器阵列组所输出定向声音信号的传输方向不同。
  11. 根据权利要求1或2所述的音视频播放系统,其中,所述声音定向输出模组包括超声定向发声器和/或相控扬声器阵列。
  12. 根据权利要求1或2所述的音视频播放系统,其中,所述跟踪元件包括:
    第一摄像模组,被配置为采集所述可视范围内的图像,根据所采集的图像获得位于所述可视范围内的观看者所处的目标可视区域;
    第二摄像模组,被配置为对所述观看者进行眼球追踪,获得眼球状态信息;以及根据所述眼球状态信息,获得所述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域。
  13. 根据权利要求12所述的音视频播放系统,其中,所述第二摄像模组包括红外摄像元件。
  14. 一种音视频播放系统的播放方法,其中,所述音视频播放系统包括显示装置和能够输出定向声音信号的声音定向输出模组,所述方法包括:
    在观看者位于所述显示装置的显示屏幕的可视范围内时,获取所述观看者在所述可视范围内所处的目标可视区域,以及所述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域;
    将在所述目标显示区域待输出的第一音视频数据的图像信息,显示在所述目标显示区域,以及将所述第一音视频数据的声音信息输出至所述声音定向输出模组,使所述声音定向输出模组朝所述目标可视区域输出定向声音信号。
  15. 根据权利要求14所述的播放方法,其中,在所述声音定向输出模组的数量为至少两个,至少两个的所述声音定向输出模组与所述可视范围内的至少两个的所述目标可视区域一一对应,所述将所述第一音视频数据的声音信息输出至所述声音定向输出模组,包括:
    将所述第一音视频数据的声音信息输出至与观看者所处的所述目标可视 区域相对应的所述声音定向输出模组。
  16. 根据权利要求14或15所述的播放方法,其中,在目标显示区域为所述显示屏幕的第一显示区域时,所述方法还包括:
    获取在所述显示屏幕上所述第一显示区域外的第二显示区域待输出的第二音视频数据,将所述第二音视频数据的图像显示在所述第二显示区域。
  17. 根据权利要求16所述的播放方法,其中,所述将所述第一音视频数据的声音信息输出至所述声音定向输出模组,包括:
    将所述第一音视频数据的声音信息输出到至少两个声音定向输出模组中的与观看者所处的所述目标可视区域相对应的第一声音定向输出模组;
    所述方法还包括:
    将所述第二音视频数据的声音信息输出至第二声音定向输出模组;
    其中,所述第二声音定向输出模组所输出定向声音信号的传输方向与所述第一声音定向输出模组所输出定向声音信号的传输方向不同。
  18. 一种音视频播放系统的播放装置,其中,所述音视频播放系统包括显示装置和能够输出定向声音信号的声音定向输出模组,所述装置包括:
    信息获取模块,用于在观看者位于所述显示装置的显示屏幕的可视范围内时,获取所述观看者在所述可视范围内所处的目标可视区域,以及所述观看者在观看所述显示屏幕时,在所述显示屏幕上的目标显示区域;
    处理模块,用于将在所述目标显示区域待输出的第一音视频数据的图像信息,显示在所述目标显示区域,以及将所述第一音视频数据的声音信息输出至所述声音定向输出模组,使所述声音定向输出模组朝所述目标可视区域输出定向声音信号。
PCT/CN2021/090202 2020-05-26 2021-04-27 音视频播放系统及播放方法、播放装置 WO2021238550A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/785,717 US11941318B2 (en) 2020-05-26 2021-04-27 Audio and video playing system, playing method and playing device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010455829.6A CN111580678A (zh) 2020-05-26 2020-05-26 音视频播放系统及播放方法、播放装置
CN202010455829.6 2020-05-26

Publications (1)

Publication Number Publication Date
WO2021238550A1 true WO2021238550A1 (zh) 2021-12-02

Family

ID=72114113

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/090202 WO2021238550A1 (zh) 2020-05-26 2021-04-27 音视频播放系统及播放方法、播放装置

Country Status (3)

Country Link
US (1) US11941318B2 (zh)
CN (1) CN111580678A (zh)
WO (1) WO2021238550A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111580678A (zh) 2020-05-26 2020-08-25 京东方科技集团股份有限公司 音视频播放系统及播放方法、播放装置
CN114860030A (zh) * 2021-01-20 2022-08-05 维沃移动通信有限公司 电子设备、音频播放方法、装置及可读存储介质
CN113630650B (zh) * 2021-10-12 2022-08-09 深圳佳力拓科技有限公司 基于音视频切换的数字电视播放方法、装置和计算机设备
TWI794002B (zh) * 2022-01-28 2023-02-21 緯創資通股份有限公司 多媒體系統以及多媒體操作方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101010981A (zh) * 2004-08-31 2007-08-01 皇家飞利浦电子股份有限公司 具有超声的视听装置
CN102724604A (zh) * 2012-06-06 2012-10-10 北京中自科技产业孵化器有限公司 一种视频会议的声音处理方法
US20130121515A1 (en) * 2010-04-26 2013-05-16 Cambridge Mechatronics Limited Loudspeakers with position tracking
CN106603947A (zh) * 2016-12-28 2017-04-26 深圳Tcl数字技术有限公司 电视机伴音播放的控制方法及装置
CN111580678A (zh) * 2020-05-26 2020-08-25 京东方科技集团股份有限公司 音视频播放系统及播放方法、播放装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012000745A1 (de) * 2011-04-07 2012-10-11 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Wiedergabegerät für Ton und Bild
US10831268B1 (en) * 2019-03-15 2020-11-10 Facebook Technologies, Llc Systems and methods for using eye tracking to improve user interactions with objects in artificial reality

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101010981A (zh) * 2004-08-31 2007-08-01 皇家飞利浦电子股份有限公司 具有超声的视听装置
US20130121515A1 (en) * 2010-04-26 2013-05-16 Cambridge Mechatronics Limited Loudspeakers with position tracking
CN102724604A (zh) * 2012-06-06 2012-10-10 北京中自科技产业孵化器有限公司 一种视频会议的声音处理方法
CN106603947A (zh) * 2016-12-28 2017-04-26 深圳Tcl数字技术有限公司 电视机伴音播放的控制方法及装置
CN111580678A (zh) * 2020-05-26 2020-08-25 京东方科技集团股份有限公司 音视频播放系统及播放方法、播放装置

Also Published As

Publication number Publication date
US20230075878A1 (en) 2023-03-09
US11941318B2 (en) 2024-03-26
CN111580678A (zh) 2020-08-25

Similar Documents

Publication Publication Date Title
WO2021238550A1 (zh) 音视频播放系统及播放方法、播放装置
CN101990075B (zh) 显示装置和音频输出装置
CN1187906C (zh) 用于产生离开声源一定距离的虚拟的扬声器的方法和装置
US8139797B2 (en) Directional electroacoustical transducing
EP1705955B1 (en) Audio signal supplying apparatus for speaker array
US6118876A (en) Surround sound speaker system for improved spatial effects
CN109391895B (zh) 调整固体电影屏幕上的音频图像的感知提升的系统和方法
EP1651008A2 (en) Method and apparatus for recording sound, and method and apparatus for reproducing sound
US20050271230A1 (en) Array speaker apparatus with projection screen
US20070296818A1 (en) Audio/visual Apparatus With Ultrasound
JPH11262084A (ja) スピーカ装置及びオーディオ信号送信装置
WO2007127762A2 (en) Method and system for sound beam- forming using internal device speakers in conjunction with external speakers
WO2006132136A1 (ja) オーディオ装置及び音声ビーム制御方法
CN101878660A (zh) 包括窄指向性和宽指向性扬声器的音频重现系统
JP2013123266A (ja) 音響再生装置
US10299064B2 (en) Surround sound techniques for highly-directional speakers
CN109151660B (zh) 一种数字影院还音系统
JP2011010224A (ja) 超指向性スピーカ
CN108432266A (zh) 针对大量接收者的多媒体再现
US8249268B2 (en) Woofer-less and enclosure-less loudspeaker system
CN106603947A (zh) 电视机伴音播放的控制方法及装置
JPH03169200A (ja) テレビ受信機
JPH06284488A (ja) テレビジョンセットのスピーカシステム
WO2021196583A1 (zh) 一种具有AIoT声效的电视机
CN102857851B (zh) 一种用于声品质评价的声像同步系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21814404

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21814404

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.06.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21814404

Country of ref document: EP

Kind code of ref document: A1