WO2016078415A1 - Terminal acoustic pickup control method, terminal and terminal acoustic pickup control system - Google Patents

Terminal acoustic pickup control method, terminal and terminal acoustic pickup control system Download PDF

Info

Publication number
WO2016078415A1
WO2016078415A1 PCT/CN2015/082973 CN2015082973W WO2016078415A1 WO 2016078415 A1 WO2016078415 A1 WO 2016078415A1 CN 2015082973 W CN2015082973 W CN 2015082973W WO 2016078415 A1 WO2016078415 A1 WO 2016078415A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
rotation
current speaker
pickup
speaker
Prior art date
Application number
PCT/CN2015/082973
Other languages
French (fr)
Chinese (zh)
Inventor
刘兆艳
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016078415A1 publication Critical patent/WO2016078415A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D3/00Control of position or direction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/08Mouthpieces; Microphones; Attachments therefor

Definitions

  • This paper relates to the field of terminal pickup, and in particular to a terminal pickup control method, a terminal and a terminal pickup control system.
  • the main microphone (such as a microphone) in the terminal needs to face the speech.
  • the current practice is that the recording staff will switch the microphone between different presenters during the interview (the interviewer will switch the microphone between himself and the interviewee during the interview) to achieve the tracking of the presenter. The operation is inconvenient and reduces the user experience.
  • the embodiment of the invention provides a terminal sound collection control method, a terminal and a terminal sound collection control system, which can improve the user experience.
  • An embodiment of the present invention provides a terminal sound collection control method, including: acquiring a current speaker's speaking position; calculating a rotation parameter according to the speaking position; and using the rotation parameter to control the rotation device to rotate the terminal to pick up the current speaker.
  • the rotation parameter comprises a rotation direction and a rotation angle
  • the step of calculating the rotation parameter according to the speaking position comprises: acquiring a pickup direction of the terminal main microphone, determining a rotation direction according to the pickup direction and the speaking position, according to the pickup The direction of rotation, the position of the speech, and the axis of rotation of the terminal calculate the angle of rotation.
  • the step of acquiring the speaking position of the current speaker comprises determining the speaking position by using the microphone array.
  • the microphone array comprises more than two directional microphones
  • the step of determining the speaking position by the sounder array comprises: collecting the initial sounds in different directions by using the directional microphone, processing the initial sound to determine the current speaker, and determining the speaking position of the current speaker according to the signal difference value of the current speaker's voice in the initial sound.
  • the manner of obtaining the speaking position of the current speaker includes: acquiring the speaking position of the current speaker periodically or in real time.
  • the embodiment of the invention further provides a terminal, including:
  • a calculation module configured to calculate a rotation parameter according to the speaking position
  • the control module is configured to control the rotation of the rotating device by using the rotation parameter to pick up the current speaker.
  • the rotation parameter comprises a rotation direction and a rotation angle
  • the calculation module is configured to acquire a pickup direction of the terminal main microphone, determine a rotation direction according to the pickup direction and the speaking position, and speak according to the pickup direction The position and the terminal rotation axis calculate the rotation angle.
  • the terminal further includes an array of microphones, the acquisition module being configured to determine a speaking position using the array of microphones.
  • the microphone array comprises more than two directional microphones
  • the acquisition module is configured to collect initial sounds in different directions by using a directional microphone, and the initial sound is processed to determine the current speaker, according to the current speaker. The difference in signal value of the speech in the initial sound determines the speech position of the current speaker.
  • the obtaining module is configured to acquire a speaking position of the current speaker periodically or in real time.
  • the embodiment of the invention provides a terminal sound collection control system, which comprises a rotation device and a terminal provided by an embodiment of the invention, and the rotation device is arranged to rotate the terminal under the control of the terminal.
  • the embodiment of the present invention further provides a computer readable storage medium, where the storage medium stores a computer program, where the computer program includes program instructions, when the program instruction is executed by the terminal device, enabling the device to perform the terminal pickup described above. Control Method.
  • the terminal after acquiring the speaking position of the current speaker, calculates the rotation parameter required to rotate the terminal in the direction of the speaker, and uses the rotation parameter to control the rotation device matched with the terminal. Rotate the operation to rotate the terminal to the direction of the speaker to pick up the speaker, so that the terminal can automatically track the effect of the presenter, instead of requiring the conference recorder or interviewer to manually rotate the terminal device, enhancing The user experience.
  • FIG. 1 is a schematic diagram of a terminal pickup control system according to a first embodiment of the present invention
  • FIG. 2 is a flowchart of a terminal pickup control method according to a second embodiment of the present invention.
  • FIG. 3 is a flowchart of a terminal pickup control method according to a third embodiment of the present invention.
  • the terminal pickup control system includes: a terminal 1 and a rotation device 2, wherein
  • the terminal 1 is configured to acquire the speaking position of the current speaker, calculate the rotation parameter according to the speaking position, and use the rotation parameter to control the rotating device 2 to rotate the terminal to pick up the current speaker;
  • the terminal involved in the present application refers to having the speaker positioning function and recording Functional terminals, such as most current smart phones, intelligent voice collection devices, etc., the speaker positioning function can be realized by the hardware/software of the terminal 1 itself, or can be implemented by other external devices;
  • the rotating device 2 is used for rotating the terminal 1 under the control of the terminal 1; the rotating device 2 and the terminal 1 according to the present application are connected by a data line or wireless (Bluetooth, etc.) to complete the receiving and executing of the rotation parameters, such as a motor shaft.
  • a data line or wireless Bluetooth, etc.
  • Brackets, etc. which can be powered by themselves or from external devices (eg Get energy from mobile phones, external power supplies, etc.
  • the terminal 1 provided by the present invention includes an obtaining module 11, a calculating module 12, and a control module 13, wherein
  • the obtaining module 11 is adapted to obtain a speaking position of the current speaker
  • the calculation module 12 is adapted to calculate a rotation parameter according to the speaking position
  • the control module 13 is adapted to control the rotation of the rotating device by the rotation parameter to pick up the current speaker.
  • the rotation parameter in the embodiment shown in FIG. 1 includes a rotation direction and a rotation angle; and the calculation module 12 is specifically adapted to acquire a pickup direction of the terminal main microphone (such as a pickup axis of the main microphone, etc.), according to the pickup.
  • the direction of the sound and the position of the speech determine the direction of rotation (eg, turn left, turn right, etc.), and calculate the angle of rotation based on the direction of the pickup, the position of the speech, and the axis of rotation of the terminal (a value that can be controlled by controlling the rate of rotation and the time of rotation of the motor) achieve).
  • the terminal 1 further includes a microphone array 14, and the acquisition module 11 is specifically adapted to determine a speech position using the microphone array 14; the microphone array 14 refers to two or more microphones according to a predetermined rule. Arranging, the position of the current speaker can be determined, and the predetermined rule involved in the embodiment is achievable in the prior art. For example, when the microphone array 14 includes two microphones, it only needs to be disposed on both sides of the central axis of the terminal. That is, the more the number of microphones, the lower the requirements for setting the position, and the more accurate the positioning of the speaker.
  • the microphone array 14 in the embodiment shown in FIG. 1 includes more than two directional microphones 141 (FIG. 1 exemplarily shows the arrangement of three directional microphones); the acquisition module 11 is specifically applicable.
  • the directional microphone to collect the initial sounds in different directions, processing the initial sound to determine the current speaker, determining the current speaker's speaking position according to the signal difference of the current speaker's voice in the initial voice; determining the current speaker according to the initial voice
  • the speaker who receives the highest volume among the plurality of initial sounds based on the different directional microphones 141 is used as the current speaker, and the position of the speaker is determined based on the time difference in which the respective directional microphones 141 receive the same content.
  • the obtaining module 11 in the embodiment shown in FIG. 1 is specifically adapted to obtain the speaking position of the current speaker periodically or in real time; this embodiment performs the timing of acquiring the speaking position of the current speaker by the obtaining module 11. Qualified, real-time/periodic follow-up of the current speaker can be achieved Trace, making the pickup better.
  • the microphones referred to in this application generally refer to a microphone device.
  • the terminal pickup control method includes the following steps:
  • S203 Control the rotation of the rotating device by using the rotation parameter to pick up the current speaker.
  • the rotation parameter in the embodiment shown in FIG. 2 includes a rotation direction and a rotation angle; and step S202 includes: acquiring a pickup direction of the terminal main microphone, determining a rotation direction according to the pickup direction and the speaking position, according to the pickup The direction of rotation, the position of the speech, and the axis of rotation of the terminal calculate the angle of rotation.
  • step S201 in the embodiment of FIG. 2 includes determining a speech position using a microphone array.
  • the microphone array in the above embodiment includes more than two directional microphones; the step of determining the speaking position by using the microphone array includes: collecting the initial sounds in different directions by using the directional microphone, and processing the initial sound to determine the current speaker. And determining the speaking position of the current speaker according to the signal difference value of the current speaker's voice in the initial sound.
  • step S201 in the embodiment shown in FIG. 2 includes: periodically or real-time acquiring the speaking position of the current speaker.
  • FIG. 3 is a flowchart of a terminal pickup control method according to a third embodiment of the present invention. As shown in FIG. 3, in the embodiment, the terminal pickup control method includes the following steps:
  • the rotating device is fixed on the desktop, and then the terminal is fixed on the rotating device, and the terminal and the rotating device are connected through Bluetooth;
  • the pickup control function is used as an APP application, and before the conference starts, the user starts the APP application, in which the user sets the real-time tracking according to the speaker;
  • S303 The terminal determines, by using a directional microphone, a speaking position of the current speaker.
  • S304 The terminal calculates a rotation parameter according to the speaking position
  • the rotation point of the rotating device may be in the pickup direction of the terminal main microphone, or may not be in the pickup direction, and the rotation point is in the pickup direction, and all the speakers are in the same plane as an example, the terminal
  • the speech position of the current speaker is connected with the rotation point to form a straight line a
  • the pickup direction of the current main microphone of the terminal is acquired, which is recorded as a straight line b
  • the rotation direction and the rotation angle are determined according to the straight line a and the straight line b.
  • the rotation parameter is 0;
  • S305 the terminal converts the rotation parameter into an operation parameter that the rotation device can perform, and sends the operation parameter to the rotation device;
  • the terminal converts the rotation parameter into operating parameters such as a rotation direction of the motor (clockwise, counterclockwise, etc.), a rotational angular velocity w, and a rotation time t, and transmits the operating parameters to the rotating device via Bluetooth;
  • the rotating device executes the working parameter to rotate the pickup direction of the main microphone of the terminal to the direction of the current speaker.
  • the terminal obtains the speech position of the current speaker in real time. In other embodiments, the terminal can also periodically acquire the speech position of the current speaker. This method is more power efficient.
  • the terminal After acquiring the speaking position of the current speaker, the terminal calculates the rotation parameter required to rotate the terminal in the direction of the speaker, and uses the rotation parameter to control the rotation device matched with the terminal to perform the rotation operation, and rotate the terminal to the positive position.
  • the speaker In the direction of the speaker, the speaker is picked up, so that the terminal can automatically track the effect of the presenter, and the meeting recorder or the interviewer is no longer required to manually rotate the terminal device, thereby enhancing the user experience.
  • the terminal after acquiring the speaking position of the current speaker, calculates the rotation parameter required to rotate the terminal in the direction of the speaker, and uses the rotation parameter to control the rotation device matched with the terminal.
  • Rotating operation rotating the terminal to the direction of the speaker to pick up the speaker, can realize the effect of the terminal automatically tracking the presenter, and no longer need the conference recorder or the interviewer to manually rotate the terminal device to enhance the user's Use experience.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Telephone Function (AREA)

Abstract

Disclosed are a terminal acoustic pickup method, a terminal and a terminal acoustic pickup control system, the method comprising: acquiring a speaking location of a current speaker (S201); calculating a rotating parameter according to the speaking location (S202); and utilizing the rotating parameter to control a rotating device to rotate the terminal to pick up the sound of the current speaker (S203). The terminal (1), after acquiring the speaking location of the current speaker, calculates the rotating parameter required to rotate the terminal (1) to face in the direction of the speaker, the rotating parameter is utilized to control the rotating device (2), which works in cooperation with the terminal (1), to execute a rotating operation, the terminal (1) is rotated to face in the direction of the speaker to pick up the sound of the speaker, and in this way, the terminal can realize the effect of automatically tracking the speaker without manual rotation of the terminal equipment by either people responsible for meeting record or interviewers, thereby improving user experience.

Description

一种终端拾音控制方法、终端及终端拾音控制系统Terminal pickup control method, terminal and terminal pickup control system 技术领域Technical field
本文涉及终端拾音领域,特别地涉及一种终端拾音控制方法、终端及终端拾音控制系统。This paper relates to the field of terminal pickup, and in particular to a terminal pickup control method, a terminal and a terminal pickup control system.
背景技术Background technique
在会议记录/采访中,为了突出主讲人(或者采访者/被采访者)的声音,消除其余的干扰源以及混响等噪音,需要将终端内的主传声器(如麦克风等)正对着讲话者;现有做法是会议时记录人员将麦克风在不同的主讲人之间切换(采访时采访者将麦克风不停的在自己与被采访者之间转换),以实现对主讲人的跟踪拾音,操作不方便,降低了用户的使用体验。In the meeting record/interview, in order to highlight the voice of the presenter (or the interviewer/interviewee), eliminate the remaining sources of interference, and noise such as reverberation, the main microphone (such as a microphone) in the terminal needs to face the speech. The current practice is that the recording staff will switch the microphone between different presenters during the interview (the interviewer will switch the microphone between himself and the interviewee during the interview) to achieve the tracking of the presenter. The operation is inconvenient and reduces the user experience.
因此,如何提供一种可以提高用户使用体验的终端拾音控制方法,是本领域技术人员亟待解决的技术问题。Therefore, how to provide a terminal sound collection control method that can improve the user experience is a technical problem to be solved by those skilled in the art.
发明内容Summary of the invention
本发明实施例提供了一种终端拾音控制方法、终端及终端拾音控制系统,可以提高用户的使用体验。The embodiment of the invention provides a terminal sound collection control method, a terminal and a terminal sound collection control system, which can improve the user experience.
本发明实施例提供了一种终端拾音控制方法,包括:获取当前讲话人的讲话位置;根据讲话位置计算转动参数;利用转动参数控制转动装置转动终端对当前讲话人进行拾音。An embodiment of the present invention provides a terminal sound collection control method, including: acquiring a current speaker's speaking position; calculating a rotation parameter according to the speaking position; and using the rotation parameter to control the rotation device to rotate the terminal to pick up the current speaker.
可选地,其中,所述转动参数包括转动方向及转动角度;根据讲话位置计算转动参数的步骤包括:获取终端主传声器的拾音方向,根据拾音方向及讲话位置确定转动方向,根据拾音方向、讲话位置及终端转动轴计算转动角度。Optionally, wherein the rotation parameter comprises a rotation direction and a rotation angle; and the step of calculating the rotation parameter according to the speaking position comprises: acquiring a pickup direction of the terminal main microphone, determining a rotation direction according to the pickup direction and the speaking position, according to the pickup The direction of rotation, the position of the speech, and the axis of rotation of the terminal calculate the angle of rotation.
可选地,其中,所述获取当前讲话人的讲话位置的步骤包括:利用传声器阵列确定讲话位置。Optionally, wherein the step of acquiring the speaking position of the current speaker comprises determining the speaking position by using the microphone array.
可选地,其中,所述传声器阵列包括两个以上的指向性传声器;利用传 声器阵列确定讲话位置的步骤包括:利用指向性传声器采集不同方向的初始声音,处理初始声音确定当前讲话人,根据当前讲话人的语音在初始声音中的信号差值确定当前讲话人的讲话位置。Optionally, wherein the microphone array comprises more than two directional microphones; The step of determining the speaking position by the sounder array comprises: collecting the initial sounds in different directions by using the directional microphone, processing the initial sound to determine the current speaker, and determining the speaking position of the current speaker according to the signal difference value of the current speaker's voice in the initial sound. .
可选地,其中,所述获取当前讲话人的讲话位置的方式包括:周期性或者实时获取当前讲话人的讲话位置。Optionally, the manner of obtaining the speaking position of the current speaker includes: acquiring the speaking position of the current speaker periodically or in real time.
本发明实施例还提供了一种终端,包括:The embodiment of the invention further provides a terminal, including:
获取模块,设置为获取当前讲话人的讲话位置;Obtaining a module, set to obtain a speech position of the current speaker;
计算模块,设置为根据讲话位置计算转动参数;a calculation module configured to calculate a rotation parameter according to the speaking position;
控制模块,设置为利用转动参数控制转动装置转动终端对当前讲话人进行拾音。The control module is configured to control the rotation of the rotating device by using the rotation parameter to pick up the current speaker.
可选地,其中,所述转动参数包括转动方向及转动角度;所述计算模块是设置为获取终端主传声器的拾音方向,根据拾音方向及讲话位置确定转动方向,根据拾音方向、讲话位置及终端转动轴计算转动角度。Optionally, wherein the rotation parameter comprises a rotation direction and a rotation angle; the calculation module is configured to acquire a pickup direction of the terminal main microphone, determine a rotation direction according to the pickup direction and the speaking position, and speak according to the pickup direction The position and the terminal rotation axis calculate the rotation angle.
可选地,所述终端还包括传声器阵列,所述获取模块是设置为利用传声器阵列确定讲话位置。Optionally, the terminal further includes an array of microphones, the acquisition module being configured to determine a speaking position using the array of microphones.
可选地,其中,所述传声器阵列包括两个以上的指向性传声器;所述获取模块是设置为利用指向性传声器采集不同方向的初始声音,处理初始声音确定当前讲话人,根据当前讲话人的语音在初始声音中的信号差值确定当前讲话人的讲话位置。Optionally, wherein the microphone array comprises more than two directional microphones; the acquisition module is configured to collect initial sounds in different directions by using a directional microphone, and the initial sound is processed to determine the current speaker, according to the current speaker. The difference in signal value of the speech in the initial sound determines the speech position of the current speaker.
可选地,其中,所述获取模块是设置为周期性或者实时获取当前讲话人的讲话位置。Optionally, wherein the obtaining module is configured to acquire a speaking position of the current speaker periodically or in real time.
本发明实施例提供了一种终端拾音控制系统,其包括转动装置及本发明实施例提供的终端,所述转动装置设置为在终端的控制下转动终端。The embodiment of the invention provides a terminal sound collection control system, which comprises a rotation device and a terminal provided by an embodiment of the invention, and the rotation device is arranged to rotate the terminal under the control of the terminal.
本发明实施例还提供一种计算机可读存储介质,所述存储介质存储有计算机程序,该计算机程序包括程序指令,当该程序指令被终端设备执行时,使得该设备可执行上述的终端拾音控制方法。 The embodiment of the present invention further provides a computer readable storage medium, where the storage medium stores a computer program, where the computer program includes program instructions, when the program instruction is executed by the terminal device, enabling the device to perform the terminal pickup described above. Control Method.
本发明实施例的有益效果:Advantageous effects of embodiments of the present invention:
本发明实施例提供的方案,终端在获取到当前讲话人的讲话位置后,计算得到将终端转动正对讲话人的方向所需要的转动参数,并利用该转动参数控制与终端配套的转动装置执行转动操作,将终端转动到正对着讲话人的方向以对讲话人进行拾音,这样终端就可以实现自动跟踪主讲人的效果,而不再需要会议记录人或者采访者手动转动终端设备,增强了用户的使用体验。According to the solution provided by the embodiment of the present invention, after acquiring the speaking position of the current speaker, the terminal calculates the rotation parameter required to rotate the terminal in the direction of the speaker, and uses the rotation parameter to control the rotation device matched with the terminal. Rotate the operation to rotate the terminal to the direction of the speaker to pick up the speaker, so that the terminal can automatically track the effect of the presenter, instead of requiring the conference recorder or interviewer to manually rotate the terminal device, enhancing The user experience.
附图概述BRIEF abstract
图1为本发明第一实施例提供的终端拾音控制系统的示意图;1 is a schematic diagram of a terminal pickup control system according to a first embodiment of the present invention;
图2为本发明第二实施例提供的终端拾音控制方法的流程图;2 is a flowchart of a terminal pickup control method according to a second embodiment of the present invention;
图3为本发明第三实施例提供的终端拾音控制方法的流程图。FIG. 3 is a flowchart of a terminal pickup control method according to a third embodiment of the present invention.
本发明的较佳实施方式Preferred embodiment of the invention
下文中将结合附图对本发明的实施例进行详细说明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互任意组合。另外,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other. Additionally, although logical sequences are shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than the ones described herein.
第一实施例:First embodiment:
图1为本发明第一实施例提供的终端拾音控制系统的示意图,由图1可知,在本实施例中,终端拾音控制系统包括:终端1及转动装置2,其中,1 is a schematic diagram of a terminal pickup control system according to a first embodiment of the present invention. As shown in FIG. 1, the terminal pickup control system includes: a terminal 1 and a rotation device 2, wherein
终端1用于获取当前讲话人的讲话位置,根据讲话位置计算转动参数,利用转动参数控制转动装置2转动终端对当前讲话人进行拾音;本申请涉及的终端是指具备讲话人定位功能及录音功能的终端,如当前大部分的智能手机、智能语音采集装置等等设备,讲话人定位功能可以由终端1自身的硬件/软件实现,也可以是其他外部设备来实现;The terminal 1 is configured to acquire the speaking position of the current speaker, calculate the rotation parameter according to the speaking position, and use the rotation parameter to control the rotating device 2 to rotate the terminal to pick up the current speaker; the terminal involved in the present application refers to having the speaker positioning function and recording Functional terminals, such as most current smart phones, intelligent voice collection devices, etc., the speaker positioning function can be realized by the hardware/software of the terminal 1 itself, or can be implemented by other external devices;
转动装置2用于在终端1的控制下转动终端1;本申请所涉及的转动装置2与终端1通过数据线连接或者无线(蓝牙等)连接,完成转动参数的接收及执行,如带马达转轴的支架等等,其可以自己供电、或者从外部设备(如 手机、外部电源)等获取电能。The rotating device 2 is used for rotating the terminal 1 under the control of the terminal 1; the rotating device 2 and the terminal 1 according to the present application are connected by a data line or wireless (Bluetooth, etc.) to complete the receiving and executing of the rotation parameters, such as a motor shaft. Brackets, etc., which can be powered by themselves or from external devices (eg Get energy from mobile phones, external power supplies, etc.
在一些实施例中,如图1所示,本发明提供的终端1包括获取模块11、计算模块12及控制模块13,其中,In some embodiments, as shown in FIG. 1, the terminal 1 provided by the present invention includes an obtaining module 11, a calculating module 12, and a control module 13, wherein
获取模块11适用于获取当前讲话人的讲话位置;The obtaining module 11 is adapted to obtain a speaking position of the current speaker;
计算模块12适用于根据讲话位置计算转动参数;The calculation module 12 is adapted to calculate a rotation parameter according to the speaking position;
控制模块13适用于利用转动参数控制转动装置转动终端对当前讲话人进行拾音。The control module 13 is adapted to control the rotation of the rotating device by the rotation parameter to pick up the current speaker.
在一些实施例中,图1所示实施例中的转动参数包括转动方向及转动角度;计算模块12具体适用于获取终端主传声器的拾音方向(如主麦克风的拾音轴线等),根据拾音方向及讲话位置确定转动方向(如向左转、向右转等),根据拾音方向、讲话位置及终端转动轴计算转动角度(是一个数值,可以通过控制马达的转动速率及转动时间来实现)。In some embodiments, the rotation parameter in the embodiment shown in FIG. 1 includes a rotation direction and a rotation angle; and the calculation module 12 is specifically adapted to acquire a pickup direction of the terminal main microphone (such as a pickup axis of the main microphone, etc.), according to the pickup. The direction of the sound and the position of the speech determine the direction of rotation (eg, turn left, turn right, etc.), and calculate the angle of rotation based on the direction of the pickup, the position of the speech, and the axis of rotation of the terminal (a value that can be controlled by controlling the rate of rotation and the time of rotation of the motor) achieve).
在一些实施例中,如图1所示,终端1还包括传声器阵列14,获取模块11具体适用于利用传声器阵列14确定讲话位置;传声器阵列14是指两个及以上个数的传声器按照预定规则进行排列,可以确定当前讲话人的位置,本实施例所涉及的预定规则是现有技术可以实现的,如当传声器阵列14包括两个传声器时,仅需要将其设置在终端中心轴线的两侧即可,传声器个数越多,对其设置位置的要求越低,讲话人的定位就越准确。In some embodiments, as shown in FIG. 1, the terminal 1 further includes a microphone array 14, and the acquisition module 11 is specifically adapted to determine a speech position using the microphone array 14; the microphone array 14 refers to two or more microphones according to a predetermined rule. Arranging, the position of the current speaker can be determined, and the predetermined rule involved in the embodiment is achievable in the prior art. For example, when the microphone array 14 includes two microphones, it only needs to be disposed on both sides of the central axis of the terminal. That is, the more the number of microphones, the lower the requirements for setting the position, and the more accurate the positioning of the speaker.
在一些实施例中,图1所示实施例中的传声器阵列14包括两个以上的指向性传声器141(图1示例性的给出了3个指向性传声器的设置方式);获取模块11具体适用于利用指向性传声器采集不同方向的初始声音,处理初始声音确定当前讲话人,根据当前讲话人的语音在初始声音中的信号差值确定当前讲话人的讲话位置;根据初始声音确定当前讲话人可以采用基于不同指向性传声器141接收到多个初始声音中音量最大的讲话人作为当前讲话人,进而根据各指向性传声器141接收到同一内容的时间差确定讲话人的位置。In some embodiments, the microphone array 14 in the embodiment shown in FIG. 1 includes more than two directional microphones 141 (FIG. 1 exemplarily shows the arrangement of three directional microphones); the acquisition module 11 is specifically applicable. Using the directional microphone to collect the initial sounds in different directions, processing the initial sound to determine the current speaker, determining the current speaker's speaking position according to the signal difference of the current speaker's voice in the initial voice; determining the current speaker according to the initial voice The speaker who receives the highest volume among the plurality of initial sounds based on the different directional microphones 141 is used as the current speaker, and the position of the speaker is determined based on the time difference in which the respective directional microphones 141 receive the same content.
在一些实施例中,图1所示实施例中的获取模块11具体适用于周期性或者实时获取当前讲话人的讲话位置;本实施例通过对获取模块11获取当前讲话人的讲话位置的时机进行限定,可以实现对当前讲话人的实时/周期性的跟 踪,使得拾音效果更好。In some embodiments, the obtaining module 11 in the embodiment shown in FIG. 1 is specifically adapted to obtain the speaking position of the current speaker periodically or in real time; this embodiment performs the timing of acquiring the speaking position of the current speaker by the obtaining module 11. Qualified, real-time/periodic follow-up of the current speaker can be achieved Trace, making the pickup better.
在一些实施例中,本申请所涉及的传声器一般是指麦克风设备。In some embodiments, the microphones referred to in this application generally refer to a microphone device.
第二实施例:Second embodiment:
图2为本发明第二实施例提供的终端拾音控制方法的流程图;由图2可知,在本实施例中,终端拾音控制方法包括以下步骤:2 is a flowchart of a terminal pickup control method according to a second embodiment of the present invention. As shown in FIG. 2, in the embodiment, the terminal pickup control method includes the following steps:
S201:获取当前讲话人的讲话位置;S201: Acquire a speech position of the current speaker;
S202:根据讲话位置计算转动参数;S202: Calculate a rotation parameter according to the speaking position;
S203:利用转动参数控制转动装置转动终端对当前讲话人进行拾音。S203: Control the rotation of the rotating device by using the rotation parameter to pick up the current speaker.
在一些实施例中,图2所示实施例中的转动参数包括转动方向及转动角度;步骤S202包括:获取终端主传声器的拾音方向,根据拾音方向及讲话位置确定转动方向,根据拾音方向、讲话位置及终端转动轴计算转动角度。In some embodiments, the rotation parameter in the embodiment shown in FIG. 2 includes a rotation direction and a rotation angle; and step S202 includes: acquiring a pickup direction of the terminal main microphone, determining a rotation direction according to the pickup direction and the speaking position, according to the pickup The direction of rotation, the position of the speech, and the axis of rotation of the terminal calculate the angle of rotation.
在一些实施例中,图2所示实施例中的步骤S201包括:利用传声器阵列确定讲话位置。In some embodiments, step S201 in the embodiment of FIG. 2 includes determining a speech position using a microphone array.
在一些实施例中,上述实施例中的传声器阵列包括两个以上的指向性传声器;利用传声器阵列确定讲话位置的步骤包括:利用指向性传声器采集不同方向的初始声音,处理初始声音确定当前讲话人,根据当前讲话人的语音在初始声音中的信号差值确定当前讲话人的讲话位置。In some embodiments, the microphone array in the above embodiment includes more than two directional microphones; the step of determining the speaking position by using the microphone array includes: collecting the initial sounds in different directions by using the directional microphone, and processing the initial sound to determine the current speaker. And determining the speaking position of the current speaker according to the signal difference value of the current speaker's voice in the initial sound.
在一些实施例中,图2所示实施例中的步骤S201的实现方式包括:周期性或者实时获取当前讲话人的讲话位置。In some embodiments, the implementation of step S201 in the embodiment shown in FIG. 2 includes: periodically or real-time acquiring the speaking position of the current speaker.
现结合一示范性具体应用实例对本发明实施例进行诠释说明。The embodiments of the present invention will now be described in conjunction with an exemplary specific application example.
第三实施例:Third embodiment:
图3为本发明第三实施例提供的终端拾音控制方法的流程图;由图3可知,在本实施例中,终端拾音控制方法包括以下步骤:FIG. 3 is a flowchart of a terminal pickup control method according to a third embodiment of the present invention; as shown in FIG. 3, in the embodiment, the terminal pickup control method includes the following steps:
S301:装配终端及转动装置;S301: assembling terminal and rotating device;
例如,用户在做会议记录时,将转动装置固定在桌面上,然后将终端固定在转动装置上,终端与转动装置通过蓝牙连接;For example, when the user makes a meeting record, the rotating device is fixed on the desktop, and then the terminal is fixed on the rotating device, and the terminal and the rotating device are connected through Bluetooth;
S302:启动终端内的拾音控制功能; S302: Start a pickup control function in the terminal;
例如,将拾音控制功能作为一个APP应用,在会议开始前,用户启动该APP应用,在该APP应用中,用户设置实时跟踪据讲话人;For example, the pickup control function is used as an APP application, and before the conference starts, the user starts the APP application, in which the user sets the real-time tracking according to the speaker;
S303:终端利用指向性麦克风确定当前讲话人的讲话位置;S303: The terminal determines, by using a directional microphone, a speaking position of the current speaker.
S304:终端根据讲话位置计算转动参数;S304: The terminal calculates a rotation parameter according to the speaking position;
在实际应用中,转动装置的转动点可以在终端主麦克风的拾音方向上,也可以不在拾音方向上,以转动点在拾音方向上、且所有讲话人都在同一平面为例,终端将当前讲话人的讲话位置与转动点连接形成一条直线a,并获取终端当前的主麦克风的拾音方向,将其记为直线b,根据直线a及直线b确定转动方向及转动角度。特别地,当直线a及直线b重合时,转动参数为0;In practical applications, the rotation point of the rotating device may be in the pickup direction of the terminal main microphone, or may not be in the pickup direction, and the rotation point is in the pickup direction, and all the speakers are in the same plane as an example, the terminal The speech position of the current speaker is connected with the rotation point to form a straight line a, and the pickup direction of the current main microphone of the terminal is acquired, which is recorded as a straight line b, and the rotation direction and the rotation angle are determined according to the straight line a and the straight line b. In particular, when the straight line a and the straight line b coincide, the rotation parameter is 0;
针对转动点不在拾音方向上、或者所有讲话人不在同一平面的情况,计算比较复杂,且现有技术可以实现转动参数的计算,本申请不再赘述;For the case where the rotation point is not in the pickup direction, or all the speakers are not in the same plane, the calculation is complicated, and the calculation of the rotation parameter can be implemented in the prior art, which is not described in the present application;
S305:终端将转动参数转换为转动装置可以执行的工作参数,并发送至转动装置;S305: the terminal converts the rotation parameter into an operation parameter that the rotation device can perform, and sends the operation parameter to the rotation device;
例如,终端将转动参数转换为马达的转动方向(顺时针、逆时针等)、转动角速度w及转动时间t等工作参数,通过蓝牙将这些工作参数发送至转动装置;For example, the terminal converts the rotation parameter into operating parameters such as a rotation direction of the motor (clockwise, counterclockwise, etc.), a rotational angular velocity w, and a rotation time t, and transmits the operating parameters to the rotating device via Bluetooth;
S306:转动装置执行工作参数,将终端的主麦克风的拾音方向转动到当前讲话人所在方向。S306: The rotating device executes the working parameter to rotate the pickup direction of the main microphone of the terminal to the direction of the current speaker.
在图3所示的实施例中,终端是实时获取当前讲话人的讲话位置的,在另外一些实施例中,终端还可以周期性的获取当前讲话人的讲话位置,这种方法比较省电。In the embodiment shown in FIG. 3, the terminal obtains the speech position of the current speaker in real time. In other embodiments, the terminal can also periodically acquire the speech position of the current speaker. This method is more power efficient.
综上可知,通过本发明的实施,至少存在以下有益效果:In summary, through the implementation of the present invention, at least the following beneficial effects exist:
终端在获取到当前讲话人的讲话位置后,计算得到将终端转动正对讲话人的方向所需要的转动参数,并利用该转动参数控制与终端配套的转动装置执行转动操作,将终端转动到正对着讲话人的方向以对讲话人进行拾音,这样终端就可以实现自动跟踪主讲人的效果,而不再需要会议记录人或者采访者手动转动终端设备,增强了用户的使用体验。After acquiring the speaking position of the current speaker, the terminal calculates the rotation parameter required to rotate the terminal in the direction of the speaker, and uses the rotation parameter to control the rotation device matched with the terminal to perform the rotation operation, and rotate the terminal to the positive position. In the direction of the speaker, the speaker is picked up, so that the terminal can automatically track the effect of the presenter, and the meeting recorder or the interviewer is no longer required to manually rotate the terminal device, thereby enhancing the user experience.
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序 来指令相关硬件完成,所述程序可以存储于计算机可读存储介质中,如只读存储器、磁盘或光盘等。可选地,上述实施例的全部或部分步骤也可以使用一个或多个集成电路来实现。相应地,上述实施例中的各模块/单元可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。本发明不限制于任何特定形式的硬件和软件的结合。One of ordinary skill in the art will appreciate that all or part of the steps in the above methods may be passed through the program. The instruction related hardware is completed, and the program can be stored in a computer readable storage medium such as a read only memory, a magnetic disk or an optical disk. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the foregoing embodiment may be implemented in the form of hardware or in the form of a software function module. The invention is not limited to any specific form of combination of hardware and software.
当然,本发明还可有其他多种实施例,在不背离本发明精神及其实质的情况下,熟悉本领域的技术人员当可根据本发明作出各种相应的改变和变形,但这些相应的改变和变形都应属于本发明的权利要求的保护范围。The invention may, of course, be embodied in a variety of other embodiments without departing from the spirit and scope of the invention. Changes and modifications are intended to fall within the scope of the appended claims.
工业实用性Industrial applicability
本发明实施例提供的方案,终端在获取到当前讲话人的讲话位置后,计算得到将终端转动正对讲话人的方向所需要的转动参数,并利用该转动参数控制与终端配套的转动装置执行转动操作,将终端转动到正对着讲话人的方向以对讲话人进行拾音,可以实现终端自动跟踪主讲人的效果,而不再需要会议记录人或者采访者手动转动终端设备,增强用户的使用体验。 According to the solution provided by the embodiment of the present invention, after acquiring the speaking position of the current speaker, the terminal calculates the rotation parameter required to rotate the terminal in the direction of the speaker, and uses the rotation parameter to control the rotation device matched with the terminal. Rotating operation, rotating the terminal to the direction of the speaker to pick up the speaker, can realize the effect of the terminal automatically tracking the presenter, and no longer need the conference recorder or the interviewer to manually rotate the terminal device to enhance the user's Use experience.

Claims (12)

  1. 一种终端拾音控制方法,包括:A terminal pickup control method includes:
    获取当前讲话人的讲话位置;Get the speech position of the current speaker;
    根据所述讲话位置计算转动参数;Calculating a rotation parameter according to the speaking position;
    利用所述转动参数控制转动装置转动终端对所述当前讲话人进行拾音。The rotating speaker is used to control the rotating device to rotate the terminal to pick up the current speaker.
  2. 如权利要求1所述的终端拾音控制方法,其中,所述转动参数包括转动方向及转动角度;根据所述讲话位置计算转动参数包括:获取终端主传声器的拾音方向,根据所述拾音方向及所述讲话位置确定所述转动方向,根据所述拾音方向、所述讲话位置及终端转动轴计算所述转动角度。The terminal pickup control method according to claim 1, wherein the rotation parameter includes a rotation direction and a rotation angle; and calculating a rotation parameter according to the speech position comprises: acquiring a pickup direction of the terminal main microphone, according to the pickup The direction and the speaking position determine the rotation direction, and the rotation angle is calculated according to the pickup direction, the speaking position, and the terminal rotation axis.
  3. 如权利要求1所述的终端拾音控制方法,其中,所述获取当前讲话人的讲话位置包括:利用传声器阵列确定所述讲话位置。The terminal pickup control method according to claim 1, wherein said obtaining a speech position of a current speaker comprises determining said speech position using a microphone array.
  4. 如权利要求3所述的终端拾音控制方法,其中,所述传声器阵列包括两个以上的指向性传声器;所述利用传声器阵列确定所述讲话位置包括:利用所述指向性传声器采集不同方向的初始声音,处理所述初始声音确定所述当前讲话人,根据所述当前讲话人的语音在所述初始声音中的信号差值确定所述当前讲话人的讲话位置。The terminal pickup control method according to claim 3, wherein said microphone array comprises two or more directional microphones; said determining said speaking position by said microphone array comprises: collecting said different directions by said directional microphone An initial sound, the initial sound is determined to determine the current speaker, and the current speaker's speaking position is determined according to a signal difference of the current speaker's voice in the initial sound.
  5. 如权利要求1至4任一项所述的终端拾音控制方法,其中,所述获取当前讲话人的讲话位置的方式包括:周期性或者实时获取当前讲话人的讲话位置。The terminal pickup control method according to any one of claims 1 to 4, wherein the manner of acquiring the speech position of the current speaker includes: acquiring the speech position of the current speaker periodically or in real time.
  6. 一种终端,包括:A terminal comprising:
    获取模块,设置为获取当前讲话人的讲话位置;Obtaining a module, set to obtain a speech position of the current speaker;
    计算模块,设置为根据所述讲话位置计算转动参数;a calculation module configured to calculate a rotation parameter according to the speaking position;
    控制模块,设置为利用所述转动参数控制转动装置转动所述终端对所述当前讲话人进行拾音。And a control module configured to control the rotating device to rotate the terminal to pick up the current speaker by using the rotation parameter.
  7. 如权利要求6所述的终端,其中,所述转动参数包括转动方向及转动角度;所述计算模块是设置为获取终端主传声器的拾音方向,根据所述拾音方向及所述讲话位置确定所述转动方向,根据所述拾音方向、所述讲话位置 及终端转动轴计算所述转动角度。The terminal according to claim 6, wherein said rotation parameter comprises a rotation direction and a rotation angle; said calculation module is configured to acquire a pickup direction of the terminal main microphone, and determine according to said pickup direction and said speech position The direction of rotation, according to the sound pickup direction, the speaking position And the terminal rotation axis calculates the rotation angle.
  8. 如权利要求6所述的终端,还包括传声器阵列,所述获取模块是设置为利用所述传声器阵列确定所述讲话位置。The terminal of claim 6 further comprising a microphone array, said acquisition module being arranged to determine said speaking position using said array of microphones.
  9. 如权利要求8所述的终端,其中,所述传声器阵列包括两个以上的指向性传声器;所述获取模块是设置为利用所述指向性传声器采集不同方向的初始声音,处理所述初始声音确定所述当前讲话人,根据所述当前讲话人的语音在所述初始声音中的信号差值确定所述当前讲话人的讲话位置。The terminal of claim 8 wherein said array of microphones comprises more than two directional microphones; said acquisition module being arranged to acquire initial sounds in different directions using said directional microphone, said initial sound determination being processed The current speaker determines a speaking position of the current speaker according to a signal difference value of the current speaker's voice in the initial voice.
  10. 如权利要求6至9任一项所述的终端,其中,所述获取模块是设置为周期性或者实时获取当前讲话人的讲话位置。The terminal according to any one of claims 6 to 9, wherein the acquisition module is configured to acquire a speech position of a current speaker periodically or in real time.
  11. 一种终端拾音控制系统,包括转动装置及如权利要求6至10任一项所述的终端,所述转动装置设置为在所述终端的控制下转动所述终端。A terminal pickup control system comprising a rotating device and a terminal according to any one of claims 6 to 10, the rotating device being arranged to rotate the terminal under the control of the terminal.
  12. 一种计算机可读存储介质,所述存储介质存储有计算机程序,该计算机程序包括程序指令,当该程序指令被终端设备执行时,使得该设备可执行权利要求1-5任一项的方法。 A computer readable storage medium storing a computer program comprising program instructions that, when executed by a terminal device, cause the device to perform the method of any of claims 1-5.
PCT/CN2015/082973 2014-11-18 2015-06-30 Terminal acoustic pickup control method, terminal and terminal acoustic pickup control system WO2016078415A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410657404.8A CN105681939A (en) 2014-11-18 2014-11-18 Pickup control method for terminal, terminal and pickup control system for terminal
CN201410657404.8 2014-11-18

Publications (1)

Publication Number Publication Date
WO2016078415A1 true WO2016078415A1 (en) 2016-05-26

Family

ID=56013234

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/082973 WO2016078415A1 (en) 2014-11-18 2015-06-30 Terminal acoustic pickup control method, terminal and terminal acoustic pickup control system

Country Status (2)

Country Link
CN (1) CN105681939A (en)
WO (1) WO2016078415A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106982227A (en) * 2017-05-03 2017-07-25 张德明 A kind of holographic sound field conference system

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108831474B (en) * 2018-05-04 2021-05-25 广东美的制冷设备有限公司 Voice recognition equipment and voice signal capturing method, device and storage medium thereof
CN111601198B (en) * 2020-04-24 2022-03-11 达闼机器人有限公司 Method and device for tracking speaker by using microphone and computing equipment
CN114811353B (en) * 2022-04-28 2023-11-28 青岛海尔科技有限公司 Control method of intelligent support based on voice, intelligent support and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060065272A (en) * 2004-12-10 2006-06-14 엘지전자 주식회사 System for hands-free of vehicle
US20100083470A1 (en) * 2008-10-08 2010-04-08 Kabushiki Kaisha Audio-Technica Microphone holder
CN202413214U (en) * 2011-12-28 2012-09-05 张颖 Movable support of portable recorder pen
CN102905094A (en) * 2012-10-26 2013-01-30 鸿富锦精密工业(深圳)有限公司 Voice-controlled television and method for improving voice receiving effect of voice-controlled television
CN103119642A (en) * 2010-09-28 2013-05-22 雅马哈株式会社 Audio output device and audio output method
CN103235645A (en) * 2013-04-25 2013-08-07 上海大学 Standing type display interface self-adaption tracking regulating device and method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100943224B1 (en) * 2007-10-16 2010-02-18 한국전자통신연구원 An intelligent robot for localizing sound source by frequency-domain characteristics and method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060065272A (en) * 2004-12-10 2006-06-14 엘지전자 주식회사 System for hands-free of vehicle
US20100083470A1 (en) * 2008-10-08 2010-04-08 Kabushiki Kaisha Audio-Technica Microphone holder
CN103119642A (en) * 2010-09-28 2013-05-22 雅马哈株式会社 Audio output device and audio output method
CN202413214U (en) * 2011-12-28 2012-09-05 张颖 Movable support of portable recorder pen
CN102905094A (en) * 2012-10-26 2013-01-30 鸿富锦精密工业(深圳)有限公司 Voice-controlled television and method for improving voice receiving effect of voice-controlled television
CN103235645A (en) * 2013-04-25 2013-08-07 上海大学 Standing type display interface self-adaption tracking regulating device and method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106982227A (en) * 2017-05-03 2017-07-25 张德明 A kind of holographic sound field conference system

Also Published As

Publication number Publication date
CN105681939A (en) 2016-06-15

Similar Documents

Publication Publication Date Title
JP6713035B2 (en) Far-field voice function implementation method, equipment, system, storage medium, and program
KR102481454B1 (en) Hands free device with directional interface
US9621984B1 (en) Methods to process direction data of an audio input device using azimuth values
US9263044B1 (en) Noise reduction based on mouth area movement recognition
US20190222950A1 (en) Intelligent audio rendering for video recording
WO2016078415A1 (en) Terminal acoustic pickup control method, terminal and terminal acoustic pickup control system
CN110288997A (en) Equipment awakening method and system for acoustics networking
US10834503B2 (en) Recording method, recording play method, apparatuses, and terminals
TW201629950A (en) Utilizing digital microphones for low power keyword detection and noise suppression
JP6844608B2 (en) Voice processing device and voice processing method
US20160094812A1 (en) Method And System For Mobile Surveillance And Mobile Infant Surveillance Platform
US10325600B2 (en) Locating individuals using microphone arrays and voice pattern matching
WO2017000775A1 (en) Robot voice direction-seeking turning system and method
JP2019506018A (en) System for sound capture and generation via nasal vibration
WO2017036323A1 (en) Processing method and device for receiving sound, storage medium, mobile terminal and robot
JP5206151B2 (en) Voice input robot, remote conference support system, and remote conference support method
WO2019227552A1 (en) Behavior recognition-based speech positioning method and device
WO2019200722A1 (en) Sound source direction estimation method and apparatus
CN105516692A (en) Intelligent equipment for Internet of Things
US20180322763A1 (en) Speech therapeutic devices and methods
US20150181353A1 (en) Hearing aid for playing audible advertisement or audible data
CN113053371A (en) Voice control system and method, voice suite, bone conduction and voice processing device
WO2022183968A1 (en) Audio signal processing method, devices, system, and storage medium
WO2017215158A1 (en) Communication terminal sound processing control method, device and communication terminal
AU2021100005A4 (en) An automated microphone system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15860917

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15860917

Country of ref document: EP

Kind code of ref document: A1