CN114760574A - Audio playing method and laser projection equipment - Google Patents
Audio playing method and laser projection equipment Download PDFInfo
- Publication number
- CN114760574A CN114760574A CN202210307766.9A CN202210307766A CN114760574A CN 114760574 A CN114760574 A CN 114760574A CN 202210307766 A CN202210307766 A CN 202210307766A CN 114760574 A CN114760574 A CN 114760574A
- Authority
- CN
- China
- Prior art keywords
- audio signal
- frequency band
- played
- camera
- projection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000005236 sound signal Effects 0.000 claims abstract description 213
- 230000009471 action Effects 0.000 claims description 37
- 238000012545 processing Methods 0.000 claims description 10
- 230000006870 function Effects 0.000 abstract description 31
- 230000008569 process Effects 0.000 description 12
- 238000004590 computer program Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000003062 neural network model Methods 0.000 description 7
- 230000033001 locomotion Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R23/00—Transducers other than those covered by groups H04R9/00 - H04R21/00
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
- H04N9/3161—Modulator illumination systems using laser light sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Acoustics & Sound (AREA)
- Optics & Photonics (AREA)
- Multimedia (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
本申请公开了一种音频播放方法及激光投影设备,属于激光投影技术领域。所述方法包括:获取待播放的音频信号,该音频信号包括第一频段的音频信号和第二频段的音频信号,第一频段高于第二频段,检测摄像头是否处于拍摄状态,在摄像头处于拍摄状态的情况下,通过所述投影屏幕播放所述第一频段的音频信号而不播放所述第二频段的音频信号。在摄像头处于拍摄状态时,即用户在使用社交功能时,使用多种方法解决投影屏幕发声产生的抖动而引起摄像头拍摄的画面抖动和模糊的问题,并保留视频通话过程中的有效信息,保证视频通话的质量,使激光投影设备同时具备激光大屏护眼、屏幕发声音画同源和社交实时共享等强大功能。
The application discloses an audio playback method and a laser projection device, which belong to the technical field of laser projection. The method includes: acquiring an audio signal to be played, the audio signal including an audio signal of a first frequency band and an audio signal of a second frequency band, the first frequency band is higher than the second frequency band, detecting whether the camera is in a shooting state, and when the camera is in a shooting state In the case of the state, the audio signal of the first frequency band is played through the projection screen, but the audio signal of the second frequency band is not played. When the camera is in the shooting state, that is, when the user is using the social function, use a variety of methods to solve the problem of shaking and blurring of the camera shot caused by the shaking generated by the sound of the projection screen, and retain the effective information during the video call. The quality of the call makes the laser projection equipment have powerful functions such as large laser screen eye protection, screen sound and picture homology, and social real-time sharing.
Description
技术领域technical field
本申请涉及激光投影技术领域,特别涉及一种音频播放方法及激光投影设备。The present application relates to the technical field of laser projection, and in particular, to an audio playback method and a laser projection device.
背景技术Background technique
随着科技的不断进步,具有屏幕发声功能的激光投影设备越来越多地走进人们的生活中。为了使人们的生活更加便捷,这些激光投影设备还可以包括摄像头,通过该摄像头可以进行社交功能。With the continuous advancement of science and technology, laser projection equipment with screen sound function has increasingly entered people's lives. To make people's lives more convenient, these laser projection devices can also include cameras through which social functions can be performed.
在相关技术中,以屏幕发声的激光电视为例,由于激光电视包括的投影主机的放置位置较低,作为社交功能的摄像头通常被优先放置到投影屏幕上。然而,在屏幕发声的激光电视上使用社交功能时,由于屏幕发声会使投影屏幕产生振动,从而使摄像头拍摄的画面产生抖动。In the related art, taking a laser TV with sound from the screen as an example, because the projection host included in the laser TV is placed at a low position, the camera as a social function is usually placed on the projection screen first. However, when using the social function on a laser TV with sound from the screen, the sound of the screen will cause the projection screen to vibrate, so that the picture captured by the camera will shake.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供了一种音频播放方法及激光投影设备,可以解决相关技术中播放低频段音频信号引起摄像头振动的问题。所述技术方案如下:Embodiments of the present application provide an audio playback method and a laser projection device, which can solve the problem of camera vibration caused by playback of low-frequency audio signals in the related art. The technical solution is as follows:
一方面,提供了一种音频播放方法,所述激光投影设备包括投影主机和投影屏幕,所述投影屏幕具有摄像头,所述投影屏幕为发声屏幕,所述方法包括:In one aspect, an audio playback method is provided, the laser projection device includes a projection host and a projection screen, the projection screen has a camera, the projection screen is a sound-emitting screen, and the method includes:
获取待播放的音频信号,所述音频信号包括第一频段的音频信号和第二频段的音频信号,所述第一频段高于所述第二频段;acquiring an audio signal to be played, the audio signal includes an audio signal of a first frequency band and an audio signal of a second frequency band, the first frequency band is higher than the second frequency band;
检测所述摄像头是否处于拍摄状态;Detecting whether the camera is in a shooting state;
在所述摄像头处于拍摄状态的情况下,通过所述投影屏幕播放所述第一频段的音频信号而不播放所述第二频段的音频信号。When the camera is in a shooting state, the audio signal of the first frequency band is played through the projection screen, but the audio signal of the second frequency band is not played.
另一方面,提供了一种激光投影设备,所述激光投影设备包括投影主机和投影屏幕,所述投影屏幕具有摄像头,所述投影屏幕为发声屏幕,所述投影主机包括处理器,所述处理器用于:In another aspect, a laser projection device is provided, the laser projection device includes a projection host and a projection screen, the projection screen has a camera, the projection screen is a sound-emitting screen, the projection host includes a processor, and the processing The device is used for:
获取待播放的音频信号,所述音频信号包括第一频段的音频信号和第二频段的音频信号,所述第一频段高于所述第二频段;acquiring an audio signal to be played, the audio signal includes an audio signal of a first frequency band and an audio signal of a second frequency band, the first frequency band is higher than the second frequency band;
检测所述摄像头是否处于拍摄状态;Detecting whether the camera is in a shooting state;
在所述摄像头处于拍摄状态的情况下,通过所述投影屏幕播放所述第一频段的音频信号而不播放所述第二频段的音频信号。When the camera is in a shooting state, the audio signal of the first frequency band is played through the projection screen, but the audio signal of the second frequency band is not played.
另一方面,提供了一种音频播放装置,所述装置包括:In another aspect, an audio playback device is provided, the device comprising:
获取模块,用于获取待播放的音频信号,所述音频信号包括第一频段的音频信号和第二频段的音频信号,所述第一频段高于所述第二频段;an acquisition module, configured to acquire an audio signal to be played, the audio signal includes an audio signal of a first frequency band and an audio signal of a second frequency band, and the first frequency band is higher than the second frequency band;
检测模块,用于检测所述摄像头是否处于拍摄状态;a detection module for detecting whether the camera is in a shooting state;
播放模块,用于在所述摄像头处于拍摄状态的情况下,通过所述投影屏幕播放所述第一频段的音频信号而不播放所述第二频段的音频信号。A playing module, configured to play the audio signal of the first frequency band but not the audio signal of the second frequency band through the projection screen when the camera is in a shooting state.
另一方面,提供了一种计算机可读存储介质,所述存储介质内存储有计算机程序,所述计算机程序被处理器执行时实现上述所述音频播放方法的步骤。In another aspect, a computer-readable storage medium is provided, and a computer program is stored in the storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned audio playback method are implemented.
另一方面,提供了一种包含指令的计算机程序产品,当所述指令在计算机上运行时,使得计算机执行上述所述的音频播放方法的步骤。In another aspect, there is provided a computer program product comprising instructions that, when executed on a computer, cause the computer to perform the steps of the audio playback method described above.
本申请实施例提供的技术方案至少可以带来以下有益效果:The technical solutions provided in the embodiments of the present application can at least bring the following beneficial effects:
在摄像头处于拍摄状态时,即用户在使用社交功能时,由于第一频段高于第二频段,所以通过投影屏幕播放第一频段的音频信号而不播放第二频段的音频信号,这样,第二频段的音频信号就不会使投影屏幕发生振动,也就不会引起摄像头的拍摄的画面产生抖动和模糊,从而使激光投影设备同时具备屏幕发声和社交共享等功能。When the camera is in the shooting state, that is, when the user is using the social function, since the first frequency band is higher than the second frequency band, the audio signal of the first frequency band is played through the projection screen instead of the audio signal of the second frequency band. The audio signal in the frequency band will not cause the projection screen to vibrate, and it will not cause jitter and blur in the picture captured by the camera, so that the laser projection device has the functions of screen sound and social sharing at the same time.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.
图1是本申请实施例提供的一种激光投影设备的示意图;1 is a schematic diagram of a laser projection device provided by an embodiment of the present application;
图2是本申请实施例提供的一种音频播放方法的流程图;2 is a flowchart of an audio playback method provided by an embodiment of the present application;
图3是本申请实施例提供的一种人声的频率范围的示意图;3 is a schematic diagram of a frequency range of a human voice provided by an embodiment of the present application;
图4是本申请实施例提供的一种音频播放方法的流程图;4 is a flowchart of an audio playback method provided by an embodiment of the present application;
图5是本申请实施例提供的一种音频播放装置的结构示意图;5 is a schematic structural diagram of an audio playback device provided by an embodiment of the present application;
图6是本申请实施例提供的一种激光投影设备的结构框图。FIG. 6 is a structural block diagram of a laser projection device provided by an embodiment of the present application.
具体实施方式Detailed ways
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。In order to make the objectives, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.
在对本申请实施例提供的音频播放方法进行详细地解释说明之前,先对本申请实施例涉及的激光投影设备进行介绍。Before the audio playback method provided by the embodiment of the present application is explained in detail, the laser projection device involved in the embodiment of the present application is first introduced.
请参考图1,图1是根据一示例性实施例示出的一种激光投影设备的示意图。该激光投影设备包括投影主机101和投影屏幕102,投影屏幕102具有摄像头。投影主机101可以与投影屏幕102进行通信连接。该通信连接可以为有线或者无线连接,本申请实施例对此不做限定。Please refer to FIG. 1 , which is a schematic diagram of a laser projection apparatus according to an exemplary embodiment. The laser projection device includes a
其中,投影主机101通常采用桌面安装的方式被安装在桌面上,或者采用吊装的方式被安装在天花板上,投影屏幕102通常安装在墙面上。在显示画面时,投影主机101用于基于待显示的画面向投影屏幕102发射激光,投影屏幕102用于对待显示的画面进行显示。在播放音频信号时,投影主机101用于将待播放的音频信号发送给投影屏幕102,投影屏幕102基于内置的发声单元播放该音频信号,以实现屏幕发声功能。Wherein, the
在激光投影设备启用社交功能时,可以打开该摄像头,并通过该摄像头拍摄画面后发送给投影主机101,投影主机101将接收到的画面通过网络发送出去。但是在投影屏幕102播放音频信号的过程中,低频段的音频信号会导致投影屏幕102在发声时产生较大幅度的振动,并使投影屏幕102上的摄像头发生抖动,进而导致摄像头拍摄到的图像产生晃动或模糊。所以,本申请实施例提供了一种音频播放方法,通过该方法能够解决该问题。When the social function is enabled in the laser projection device, the camera can be turned on, and the picture is captured by the camera and sent to the
上述描述的社交功能可以是视频聊天、网络直播、交流音乐等功能。社交功能可以在用户足不出户的情况下,满足用户的社交需求,为用户实现最真实的视听效果。The social functions described above may be functions such as video chat, webcast, and music exchange. The social function can meet the social needs of users without leaving home, and achieve the most realistic audio-visual effects for users.
本领域技术人员应能理解上述投影主机101和投影屏幕102的功能仅为举例,其他现有的或今后可能出现的其他功能如可适用于本申请实施例,也应包含在本申请实施例保护范围以内,并在此以引用方式包含于此。Those skilled in the art should understand that the above-mentioned functions of the
需要说明的是,本申请实施例描述的激光投影设备是为了更加清楚的说明本申请实施例的技术方案,并不构成对于本申请实施例提供的技术方案的限定,本领域普通技术人员可知,随着技术的演变,本申请实施例提供的技术方案对于类似的技术问题,同样适用。It should be noted that the laser projection equipment described in the embodiments of the present application is for the purpose of illustrating the technical solutions of the embodiments of the present application more clearly, and does not constitute a limitation on the technical solutions provided by the embodiments of the present application. With the evolution of technology, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
接下来对本申请实施例提供的音频播放方法进行详细地解释说明。Next, the audio playback method provided by the embodiment of the present application will be explained in detail.
图2是本申请实施例提供的一种音频播放方法的流程图,该方法应用于激光投影设备,该激光投影设备包括投影主机和投影屏幕,投影屏幕具有摄像头,投影屏幕为发声屏幕。请参考图2,该方法包括如下步骤。2 is a flowchart of an audio playback method provided by an embodiment of the present application. The method is applied to a laser projection device. The laser projection device includes a projection host and a projection screen. The projection screen has a camera, and the projection screen is a sound-emitting screen. Please refer to FIG. 2 , the method includes the following steps.
步骤201:获取待播放的音频信号,该音频信号包括第一频段的音频信号和第二频段的音频信号,第一频段高于第二频段。Step 201: Acquire an audio signal to be played, where the audio signal includes an audio signal of a first frequency band and an audio signal of a second frequency band, and the first frequency band is higher than the second frequency band.
第一频段的音频信号是指频率超过频率阈值的音频信号,第二频段的音频信号是指频率低于频率阈值的音频信号。通俗地讲,第一频段的音频信号是指中高频段的音频信号,第二频段的音频信号是指低频段的音频信号。The audio signal of the first frequency band refers to the audio signal whose frequency exceeds the frequency threshold, and the audio signal of the second frequency band refers to the audio signal whose frequency is lower than the frequency threshold. In layman's terms, the audio signal in the first frequency band refers to the audio signal in the middle and high frequency bands, and the audio signal in the second frequency band refers to the audio signal in the low frequency band.
本申请实施例中,“超过”可以理解为大于,也可以理解为大于或等于。在“超过”理解为大于的情况下,“低于”可以理解为小于或等于。在“超过”理解为大于或等于的情况下,“低于”可以理解为小于。后续涉及的“超过”和“低于”都可以参考该解释。In the embodiments of the present application, "exceeding" may be understood as greater than, and may also be understood as greater than or equal to. Where "more than" is understood as greater than, "below" is understood as less than or equal to. Where "more than" is understood as greater than or equal to, "less than" is understood as less than. Subsequent references to "over" and "under" can refer to this explanation.
其中,频率阈值是事先设置的,通过该频率阈值可以划分低频段和中高频段。而且,在投影屏幕的大小不同的情况下,屏幕发声功能对投影屏幕产生的振动可能不同,进而对摄像头产生的抖动可能不同,所以,实际应用过程中,还可以根据投影屏幕的大小对该频率阈值进行调整。例如,频率阈值可以设置为300Hz(Hertz,赫兹)。The frequency threshold is set in advance, and the low frequency band and the middle and high frequency band can be divided by the frequency threshold. Moreover, when the size of the projection screen is different, the vibration generated by the screen sound function on the projection screen may be different, and then the vibration generated by the camera may be different. Therefore, in the actual application process, the frequency can also be determined according to the size of the projection screen. Thresholds are adjusted. For example, the frequency threshold can be set to 300 Hz (Hertz).
待播放的音频信号可以为人与人之间的对话声、交流音乐时乐器发出的声音以及视频通话时的背景音等等。The audio signal to be played can be the sound of conversation between people, the sound of musical instruments when exchanging music, the background sound of video call, and so on.
步骤202:检测摄像头是否处于拍摄状态。Step 202: Detect whether the camera is in a shooting state.
激光投影设备的投影主机与摄像头进行通信,投影主机可以获知摄像头是否处于拍摄状态。The projection host of the laser projection device communicates with the camera, and the projection host can know whether the camera is in a shooting state.
例如,在具有社交功能的屏幕发声的激光电视中,激光电视的投影主机与摄像头进行通信,投影主机可以获知摄像头是否处于拍摄状态。For example, in a laser TV with a social function, the projection host of the laser TV communicates with the camera, and the projection host can know whether the camera is in a shooting state.
步骤203:在摄像头处于拍摄状态的情况下,通过投影屏幕播放第一频段的音频信号而不播放第二频段的音频信号。Step 203 : when the camera is in a shooting state, play the audio signal of the first frequency band but not the audio signal of the second frequency band through the projection screen.
也即是,在摄像头处于拍摄状态的情况下,将激光投影设备当前的音频播放模式切换为社交发声模式。在社交发声模式下,通过投影屏幕播放第一频段的音频信号而不播放第二频段的音频信号。That is, when the camera is in the shooting state, the current audio playback mode of the laser projection device is switched to the social voice mode. In the social voice mode, the audio signal of the first frequency band is played through the projection screen, but the audio signal of the second frequency band is not played.
在一些实施例中,在摄像头处于拍摄状态的情况下,可以直接将第二频段的音频信号删除,并通过投影屏幕播放第一频段的音频信号。In some embodiments, when the camera is in a shooting state, the audio signal of the second frequency band can be directly deleted, and the audio signal of the first frequency band can be played through the projection screen.
在通过摄像头使用社交功能时主要是进行交谈,因此,人与人之间的对话声是在社交过程中产生的主要声音。通常情况下人声的频率处于第一频段,删除第二频段的音频信号并不会使人与人之间对话的音频信号丢失。所以,在摄像头处于拍摄状态的情况下,可以直接将第二频段的音频信号删除,并通过投影屏幕播放第一频段的音频信号。例如,如图3所示,第一频段的音频信号是指频率在300Hz至20K(Kilo,千)Hz之间的音频信号,第二频段的音频信号是指频率在30Hz至300Hz之间的音频信号,而人声的频率范围一般处于300Hz至5KHz之间,即人声的频率处于第一频段,因此删除第二频段的音频信号并不会使人与人之间对话的音频信号丢失。When using the social function through the camera, it is mainly for conversation, so the conversation sound between people is the main sound produced in the social process. Usually, the frequency of the human voice is in the first frequency band, and deleting the audio signal of the second frequency band will not cause the audio signal of the dialogue between people to be lost. Therefore, when the camera is in the shooting state, the audio signal of the second frequency band can be directly deleted, and the audio signal of the first frequency band can be played through the projection screen. For example, as shown in Figure 3, the audio signal of the first frequency band refers to the audio signal with a frequency between 300Hz and 20K (Kilo, thousand) Hz, and the audio signal of the second frequency band refers to the audio frequency with a frequency between 30Hz and 300Hz. The frequency range of human voice is generally between 300Hz and 5KHz, that is, the frequency of human voice is in the first frequency band, so deleting the audio signal of the second frequency band will not cause the audio signal of the dialogue between people to be lost.
激光投影设备中具有高通滤波器和低通滤波器。在摄像头处于拍摄状态的情况下,第一频段的音频信号可以通过高通滤波器滤出并通过投影屏幕播放,第二频段的音频信号可以通过低通滤波器滤出,并且将第二频段的音频信号删除,本申请实施例对此不作限定。There are high-pass and low-pass filters in laser projection equipment. When the camera is in the shooting state, the audio signal of the first frequency band can be filtered out by a high-pass filter and played on the projection screen, the audio signal of the second frequency band can be filtered out by a low-pass filter, and the audio signal of the second frequency band can be filtered out Signal deletion, which is not limited in this embodiment of the present application.
在另一些实施例中,通过摄像头进行社交功能的过程中,还可能会交流音乐,比如弹奏乐器,此时,第二频段的音频可能存在有效信息,直接删除第二频段的音频信号会导致有效信号的丢失。因此,在摄像头处于拍摄状态的情况下,可以检测第二频段的音频信号中是否存在有效信号。在第二频段的音频信号中不存在有效信号的情况下,删除第二频段的音频信号,并通过投影屏幕播放第一频段的音频信号。在第二频段的音频信号中存在有效信号的情况下,通过投影屏幕播放第一频段的音频信号,将第二频段的音频信号转移至其他设备来播放。当然,也可以不进行有效信号的判断,直接将第二频段的音频信号转移至其他设备来播放。In other embodiments, during the process of performing social functions through the camera, music may also be exchanged, such as playing a musical instrument. At this time, there may be valid information in the audio of the second frequency band, and direct deletion of the audio signal of the second frequency band will result in Loss of valid signal. Therefore, when the camera is in a shooting state, it can be detected whether there is a valid signal in the audio signal of the second frequency band. In the case that there is no valid signal in the audio signal of the second frequency band, the audio signal of the second frequency band is deleted, and the audio signal of the first frequency band is played through the projection screen. When there is a valid signal in the audio signal of the second frequency band, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is transferred to other devices for playback. Of course, it is also possible to directly transfer the audio signal of the second frequency band to other devices for playback without judging the valid signal.
其中,检测第二频段的音频信号中是否存在有效信号的方式包括两种,接下来对这两种实现方式进行介绍。Among them, there are two ways to detect whether there is a valid signal in the audio signal of the second frequency band, and the two implementation ways will be introduced next.
第一种实现方式,待播放的音频信号是摄像头拍摄的视频画面内产生的音频信号。在这种情况下,可以对摄像头拍摄的视频画面进行识别,以确定视频画面中是否存在目标动作,在视频画面中不存在目标动作的情况下,确定第二频段的音频信号中不存在有效信号。在视频画面中存在目标动作的情况下,确定第二频段的音频信号中存在有效信号。In a first implementation manner, the audio signal to be played is an audio signal generated in a video image captured by a camera. In this case, the video picture captured by the camera can be identified to determine whether there is a target action in the video picture, and if there is no target action in the video picture, it can be determined that there is no valid signal in the audio signal of the second frequency band . In the case that the target action exists in the video picture, it is determined that there is a valid signal in the audio signal of the second frequency band.
其中,目标动作是指存储在本地或者云空间的动作,可以是乐器弹奏动作也可以是其他可以发出声音的动作。本申请实施例对此不作限定。Among them, the target action refers to the action stored in the local or cloud space, which can be an action of playing a musical instrument or other actions that can produce sounds. This embodiment of the present application does not limit this.
假设目标动作是乐器弹奏动作,则通过对摄像头拍摄的多个视频帧进行识别,以确定手部动作和视频画面中乐器的类别,基于视频画面中乐器的类别,从存储的乐器类别与弹奏动作之间的对应关系中确定该乐器对应的弹奏动作,进而确定视频画面中的手部动作是否与识别出的乐器的弹奏动作一致,在视频画面中的手部动作与识别出的乐器的弹奏动作一致的情况下,确定视频画面中存在乐器弹奏动作,在视频画面中的手部动作与识别出的乐器的弹奏动作不一致的情况下,确定视频画面中不存在乐器弹奏动作。Assuming that the target action is the action of playing an instrument, multiple video frames captured by the camera are identified to determine the type of the hand action and the musical instrument in the video image. Determine the corresponding playing action of the instrument from the corresponding relationship between the playing actions, and then determine whether the hand action in the video screen is consistent with the playing action of the recognized musical instrument, and the hand action in the video screen is consistent with the recognized playing action of the musical instrument. In the case that the playing actions of the musical instruments are consistent, it is determined that there is a musical instrument playing action in the video screen, and when the hand movements in the video screen are inconsistent with the recognized playing actions of the musical instrument, it is determined that there is no musical instrument playing in the video screen. play action.
由于不同乐器的形状各异,并且在弹奏不同乐器时手部的动作不同。因此可以对手部动作和视频画面中乐器的类别进行识别,从而确定视频画面中是否存在乐器弹奏动作的情况,进而判断第二频段的音频信号中是否存在有效信号。Because different instruments have different shapes and different hand movements when playing different instruments. Therefore, it is possible to identify hand movements and the types of musical instruments in the video picture, so as to determine whether there is a musical instrument playing action in the video picture, and then determine whether there is a valid signal in the audio signal of the second frequency band.
其中,对手部动作和视频画面中乐器的类别进行识别的方式包括多种,作为一种示例,可以通过神经网络模型来进行识别,也即是,将该视频画面输入至神经网络模型中,以得到神经网络模型输出的手部动作和视频画面中乐器的类别。Among them, there are many ways to recognize the hand movements and the categories of musical instruments in the video picture. As an example, the recognition can be performed through a neural network model, that is, the video picture is input into the neural network model to Get the hand motion output by the neural network model and the category of the musical instrument in the video.
在用神经网络模型进行识别之前需要进行神经网络模型的训练。也即是,获取多个样本视频段,以及每个视频段对应的手部动作和视频段中乐器的类别,将视频段作为神经网络模型的输入,将乐器的类别以及手部动作作为神经网络模型的输出,对神经网络模型进行训练。The neural network model needs to be trained before using the neural network model for recognition. That is, multiple sample video segments are obtained, as well as the hand actions corresponding to each video segment and the category of the musical instrument in the video segment, the video segment is used as the input of the neural network model, and the category of the musical instrument and the hand motion are used as the neural network. The output of the model is used to train the neural network model.
第二种实现方式,待播放的音频信号是通过弹奏乐器所产生的音频信号。在这种情况下,可以提取第二频段的音频信号的频率信息,在存储的乐器频率信息中不存在与第二频段的音频信号的频率信息相匹配的乐器频率信息的情况下,确定第二频段的音频信号中不存在有效信号。在存储的乐器频率信息中存在与第二频段的音频信号的频率信息相匹配的乐器频率信息的情况下,确定第二频段的音频信号中存在有效信号。In the second implementation manner, the audio signal to be played is an audio signal generated by playing a musical instrument. In this case, the frequency information of the audio signal of the second frequency band may be extracted, and if there is no musical instrument frequency information matching the frequency information of the audio signal of the second frequency band in the stored musical instrument frequency information, it is determined that the second frequency band There is no valid signal in the audio signal of the band. In the case where musical instrument frequency information matching the frequency information of the audio signal of the second frequency band exists in the stored musical instrument frequency information, it is determined that a valid signal exists in the audio signal of the second frequency band.
由于每种乐器在弹奏时发出的声音的频率都有其相对固定的频率范围,因此可以提前对发声频率处于第二频段的多种乐器的频率信息进行存储。这样,可以提取第二频段的音频信号的频率信息,并且与存储的乐器频率信息进行比对,判断存储的乐器频率信息中是否存在与第二频段的音频信号的频率信息相匹配的乐器频率信息,进而可以确定第二频段的音频信号中是否存在有效信号。Since the frequencies of the sounds produced by each musical instrument when played have a relatively fixed frequency range, the frequency information of multiple musical instruments whose sound frequencies are in the second frequency band can be stored in advance. In this way, the frequency information of the audio signal of the second frequency band can be extracted and compared with the stored musical instrument frequency information to determine whether there is musical instrument frequency information matching the frequency information of the audio signal of the second frequency band in the stored musical instrument frequency information. , and then it can be determined whether there is a valid signal in the audio signal of the second frequency band.
当然,以上两种实现方式也可以进行结合,从而可以提高识别有效信号的准确性。即,对摄像头拍摄的视频画面进行识别,以确定视频画面中是否存在目标动作,提取第二频段的音频信号的频率信息,判断存储的乐器频率信息中是否存在与第二频段的音频信号的频率信息相匹配的乐器频率信息。在视频画面中存在目标动作并且存储的乐器频率信息中存在与第二频段的音频信号的频率信息相匹配的乐器频率信息时,确定第二频段的音频信号中存在有效信号。在视频画面中不存在目标动作或者存储的乐器频率信息中不存在与第二频段的音频信号的频率信息相匹配的乐器频率信息时,确定第二频段的音频信号中不存在有效信号。Of course, the above two implementation manners can also be combined, so that the accuracy of identifying valid signals can be improved. That is, the video image captured by the camera is identified to determine whether there is a target action in the video image, the frequency information of the audio signal of the second frequency band is extracted, and it is determined whether there is a frequency of the audio signal of the second frequency band in the stored musical instrument frequency information. information to match the frequency information of the instrument. When the target action exists in the video picture and the stored musical instrument frequency information contains musical instrument frequency information matching the frequency information of the audio signal of the second frequency band, it is determined that a valid signal exists in the audio signal of the second frequency band. When there is no target action in the video picture or no musical instrument frequency information matching the frequency information of the audio signal of the second frequency band exists in the stored musical instrument frequency information, it is determined that there is no valid signal in the audio signal of the second frequency band.
在将第二频段的音频信号转移至其他设备来播放时,通过投影屏幕播放第一频段的音频信号而不播放第二频段的音频信号的方式有两种,接下来对这两种实现方式进行介绍。When transferring the audio signal of the second frequency band to other devices for playback, there are two ways to play the audio signal of the first frequency band but not the audio signal of the second frequency band through the projection screen. introduce.
第一种实现方式,在投影主机内具有音箱的情况下,通过投影屏幕播放第一频段的音频信号,通过音箱播放第二频段的音频信号。In the first implementation manner, in the case where the projection host has a speaker, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the speaker.
也就是说,在摄像头处于拍摄状态的情况下,可以通过高通滤波器从待播放的音频信号中滤出第一频段的音频信号,通过低通滤波器从待播放的音频信号中滤出第二频段的音频信号,进而通过投影屏幕播放第一频段的音频信号,通过音箱播放第二频段的音频信号。这样,第二频段的音频信号就不会对投影屏幕产生振动,进而就不会对摄像头的拍摄画面产生抖动。That is to say, when the camera is in the shooting state, the audio signal of the first frequency band can be filtered out from the audio signal to be played through a high-pass filter, and the second frequency band can be filtered out from the audio signal to be played through a low-pass filter. The audio signal of the frequency band, and then the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the speaker. In this way, the audio signal of the second frequency band will not vibrate the projection screen, and thus will not shake the image captured by the camera.
第二种实现方式,在投影主机连接有低音炮的情况下,通过投影屏幕播放第一频段的音频信号,通过低音炮播放第二频段的音频信号。In the second implementation manner, when the projection host is connected with a subwoofer, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer.
也就是说,在摄像头处于拍摄状态的情况下,可以通过高通滤波器从待播放的音频信号中滤出第一频段的音频信号,通过低通滤波器从待播放的音频信号中滤出第二频段的音频信号,进而通过投影屏幕播放第一频段的音频信号,通过低音炮播放第二频段的音频信号。这样,第二频段的音频信号就不会对投影屏幕产生振动,进而就不会对摄像头的拍摄画面产生抖动。That is to say, when the camera is in the shooting state, the audio signal of the first frequency band can be filtered out from the audio signal to be played through a high-pass filter, and the second frequency band can be filtered out from the audio signal to be played through a low-pass filter. The audio signal of the frequency band, and then the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer. In this way, the audio signal of the second frequency band will not vibrate the projection screen, and thus will not shake the image captured by the camera.
在上述描述的内容中,在通过投影屏幕播放第一频段的音频信号时,可以将第一频段的音频信号发送给投影屏幕内置的振子,通过振子产生振动从而驱动投影屏幕振动发声,本申请实施例对屏幕发声的实现过程不做限定。In the above description, when the audio signal of the first frequency band is played through the projection screen, the audio signal of the first frequency band can be sent to the built-in vibrator of the projection screen, and the vibrator generates vibration to drive the projection screen to vibrate and sound. This application implements The example does not limit the implementation process of the screen sound.
在摄像头处于拍摄状态的情况下,通过投影屏幕播放第一频段的音频信号而不播放第二频段的音频信号的方式是一种示例,实际应用的过程中,还可以通过其他方式来实现。When the camera is in the shooting state, the way of playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band is an example, and other ways can also be used in practical application.
作为一种示例,在投影主机内具有音箱的情况下,通过该音箱播放第一频段的音频信号和第二频段的音频信号。As an example, in the case of a sound box in the projection host, the audio signal of the first frequency band and the audio signal of the second frequency band are played through the sound box.
也即是,通过投影主机内的音箱播放全频段的音频信号,而无需通过投影屏幕来播放音频信号。通过此方法可以有效地解决投影屏幕发声所带来的摄像头拍摄画面抖动的问题,并且还能够将第二频段的音频信号全部保留并进行播放。That is, the audio signal of the full frequency range is played through the speaker in the projection host without the need to play the audio signal through the projection screen. This method can effectively solve the problem of camera image shaking caused by the sound of the projection screen, and can also retain and play all the audio signals of the second frequency band.
作为另一种示例,在投影主机内具有音箱且投影主机连接有低音炮的情况下,通过该音箱播放第一频段的音频信号和第二频段的音频信号,通过低音炮播放第二频段的音频信号。As another example, when the projection host has a speaker and the projection host is connected with a subwoofer, the audio signal of the first frequency band and the audio signal of the second frequency band are played through the speaker, and the audio of the second frequency band is played through the subwoofer Signal.
也即是,通过投影主机内的音箱播放全频段的音频信号,并且用低音炮播放第二频段的音频信号,无需通过投影屏幕来播放音频信号。通过此方法不仅可以有效地解决投影屏幕发声所带来的摄像头拍摄画面抖动的问题,以及将第二频段的音频信号全部保留并进行播放,并且通过低音炮来播放第二频段的音频信号,能够将重音和低音更加完美地体现出来,提高音频播放效果。That is, the audio signal of the full frequency band is played through the speaker in the projection host, and the audio signal of the second frequency band is played by the subwoofer, without the need to play the audio signal through the projection screen. This method can not only effectively solve the problem of camera shooting picture shake caused by the sound of the projection screen, but also retain and play all the audio signals of the second frequency band, and play the audio signals of the second frequency band through the subwoofer, which can The accent and bass are more perfectly reflected, and the audio playback effect is improved.
上文描述的是在摄像头处于拍摄状态的情况下,通过投影屏幕播放第一频段的音频信号而不播放第二频段的音频信号的情况。在摄像头不处于拍摄状态的情况下,可以直接通过投影屏幕播放第一频段的音频信号与第二频段的音频信号。即,通过投影屏幕播放全频段的音频信号。What is described above is the situation in which the audio signal of the first frequency band is played through the projection screen and the audio signal of the second frequency band is not played when the camera is in the shooting state. When the camera is not in the shooting state, the audio signal of the first frequency band and the audio signal of the second frequency band can be directly played through the projection screen. That is, a full-range audio signal is played through the projection screen.
接下来以图4为例,对本申请实施例提供的一种音频播放方法进行介绍。如图4所示,激光投影设备开机后,检测摄像头是否处于拍摄状态。在摄像头不处于拍摄状态的情况下,将第一频段和第二频段的音频信号发送给投影屏幕,即,将全频段的音频信号发送给投影屏幕,由投影屏幕对音频信号进行播放。在摄像头处于拍摄状态的情况下,投影主机将待播放的音频信号进行划分,以得到第一频段的音频信号和第二频段的音频信号,将第一频段的音频信号发送给投影屏幕,并确定激光投影设备是否连接低音炮,在连接低音炮的情况下,通过投影屏幕播放第一频段的音频信号,通过低音炮播放第二频段的音频信号。Next, an audio playback method provided by an embodiment of the present application is introduced by taking FIG. 4 as an example. As shown in Figure 4, after the laser projection device is turned on, it is detected whether the camera is in a shooting state. When the camera is not in the shooting state, the audio signals of the first frequency band and the second frequency band are sent to the projection screen, that is, the audio signals of the whole frequency band are sent to the projection screen, and the audio signals are played by the projection screen. When the camera is in the shooting state, the projection host divides the audio signal to be played to obtain the audio signal of the first frequency band and the audio signal of the second frequency band, sends the audio signal of the first frequency band to the projection screen, and determines Whether the laser projection device is connected to a subwoofer, if the subwoofer is connected, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer.
在一些实施例中,在摄像头处于拍摄状态的情况下,即在使用社交功能的过程中,还可以对摄像头采集到的画面进行识别,以确定用户的动作,基于用户的动作,对投影屏幕的发声进行控制。例如,通过对摄像头采集到的画面进行识别,进而确定用户的动作为侧耳动作,并且在确定出用户侧耳的耳朵为右耳时,增大投影屏幕的右声道的音量,保持投影屏幕的左声道的音量不变,以实现近强远弱的音效。In some embodiments, when the camera is in the shooting state, that is, in the process of using the social function, the image captured by the camera can also be recognized to determine the user's action, and based on the user's action, the projection screen's action can be adjusted based on the user's action. Sound control. For example, by recognizing the image captured by the camera, it is then determined that the user's action is a lateral ear action, and when it is determined that the user's lateral ear is the right ear, the volume of the right channel of the projection screen is increased, and the left side of the projection screen is maintained. The volume of the channel does not change to achieve sound effects that are close to strong and far weak.
在本申请实施例中,摄像头处于拍摄状态时,即用户在使用社交功能时,使用多种方法解决投影屏幕发声产生的抖动而引起摄像头拍摄的画面抖动和模糊的问题。而且,在某些实现方式中,通过对产生的音频信息进行分析,以及对摄像头拍摄到的画面的进行识别,判断产生的第二频段音频信息中是否存在有效信息,进而选择将第二频段的音频信号删除或转移至其它设备。由此不仅可以有效地解决投影屏幕发声产生的抖动而引起摄像头拍摄的画面抖动和模糊的问题,还能够保留视频通话过程中的有效信息,保证视频通话的质量。并且按照本申请实施例所提供的方法能够使激光投影设备同时具备激光大屏护眼、屏幕发声音画同源和社交实时共享等强大功能。In the embodiment of the present application, when the camera is in the shooting state, that is, when the user uses the social function, various methods are used to solve the problem of shaking and blurring of the picture captured by the camera caused by the shaking generated by the sound of the projection screen. Moreover, in some implementations, by analyzing the generated audio information and identifying the pictures captured by the camera, it is judged whether there is valid information in the generated second frequency band audio information, and then the second frequency band audio information is selected. Audio signals are deleted or transferred to other equipment. This not only effectively solves the problem of jittering and blurring of the image captured by the camera caused by the jitter of the projection screen, but also preserves the effective information during the video call to ensure the quality of the video call. And according to the method provided by the embodiment of the present application, the laser projection device can simultaneously have powerful functions such as large laser screen eye protection, screen sound and picture homology, and social real-time sharing.
图5是本申请实施例提供的一种音频播放装置的结构示意图,该音频播放装置可以由软件、硬件或者两者的结合实现成为上述激光投影设备的部分或者全部,请参考图5,该装置包括:获取模块501、检测模块502和播放模块503。FIG. 5 is a schematic structural diagram of an audio playback device provided by an embodiment of the present application. The audio playback device can be implemented by software, hardware, or a combination of the two to become part or all of the above-mentioned laser projection equipment. Please refer to FIG. 5. The device It includes: an
获取模块501,用于获取待播放的音频信号,音频信号包括第一频段的音频信号和第二频段的音频信号,该第一频段高于第二频段。详细实现过程参考上述各个实施例中对应的内容,此处不再赘述。The acquiring
检测模块502,用于检测摄像头是否处于拍摄状态。详细实现过程参考上述各个实施例中对应的内容,此处不再赘述。The
播放模块503,用于在摄像头处于拍摄状态的情况下,通过投影屏幕播放第一频段的音频信号而不播放第二频段的音频信号。详细实现过程参考上述各个实施例中对应的内容,此处不再赘述。The
可选地,播放模块503具体用于:Optionally, the
检测第二频段的音频信号中是否存在有效信号;Detecting whether there is a valid signal in the audio signal of the second frequency band;
在第二频段的音频信号中不存在有效信号的情况下,删除第二频段的音频信号,并通过投影屏幕播放第一频段的音频信号。In the case that there is no valid signal in the audio signal of the second frequency band, the audio signal of the second frequency band is deleted, and the audio signal of the first frequency band is played through the projection screen.
可选地,播放模块503还具体用于:Optionally, the
对摄像头拍摄的视频画面进行识别,以确定视频画面中是否存在目标动作;Identify the video image captured by the camera to determine whether there is a target action in the video image;
在视频画面中不存在目标动作的情况下,确定第二频段的音频信号中不存在有效信号。In the case that the target action does not exist in the video picture, it is determined that there is no valid signal in the audio signal of the second frequency band.
可选地,播放模块503还具体用于:Optionally, the
提取第二频段的音频信号的频率信息;Extract the frequency information of the audio signal of the second frequency band;
在存储的乐器频率信息中不存在与第二频段的音频信号的频率信息相匹配的乐器频率信息的情况下,确定第二频段的音频信号中不存在有效信号。In the case where there is no musical instrument frequency information matching the frequency information of the audio signal of the second frequency band in the stored musical instrument frequency information, it is determined that no valid signal exists in the audio signal of the second frequency band.
可选地,播放模块503具体用于:Optionally, the
在投影主机内具有音箱的情况下,通过投影屏幕播放第一频段的音频信号,通过音箱播放第二频段的音频信号;或者In the case that the projection host has a speaker, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the speaker; or
在投影主机连接有低音炮的情况下,通过投影屏幕播放第一频段的音频信号,通过低音炮播放第二频段的音频信号。When the projection host is connected with a subwoofer, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer.
在本申请实施例中,摄像头处于拍摄状态时,即用户在使用社交功能时,使用多种方法解决投影屏幕发声产生的抖动而引起摄像头拍摄的画面抖动和模糊的问题。而且,在某些实现方式中,通过对产生的音频信息进行分析,以及对摄像头拍摄到的画面的进行识别,判断产生的第二频段音频信息中是否存在有效信息,进而选择将第二频段的音频信号删除或转移至其它设备。由此不仅可以有效地解决投影屏幕发声产生的抖动而引起摄像头拍摄的画面抖动和模糊的问题,还能够保留视频通话过程中的有效信息,保证视频通话的质量。并且按照本申请实施例所提供的方法能够使激光投影设备同时具备激光大屏护眼、屏幕发声音画同源和社交实时共享等强大功能。In the embodiment of the present application, when the camera is in the shooting state, that is, when the user uses the social function, various methods are used to solve the problem of shaking and blurring of the picture captured by the camera caused by the shaking generated by the sound of the projection screen. Moreover, in some implementations, by analyzing the generated audio information and identifying the pictures captured by the camera, it is judged whether there is valid information in the generated second frequency band audio information, and then the second frequency band audio information is selected. Audio signals are deleted or transferred to other equipment. This not only effectively solves the problem of jittering and blurring of the image captured by the camera caused by the jitter of the projection screen, but also preserves the effective information during the video call to ensure the quality of the video call. And according to the method provided by the embodiment of the present application, the laser projection device can simultaneously have powerful functions such as large laser screen eye protection, screen sound and picture homology, and social real-time sharing.
需要说明的是:上述实施例提供的音频播放装置在进行音频播放时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的音频播放装置与音频播放方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。It should be noted that: when the audio playback device provided by the above embodiment performs audio playback, only the division of the above functional modules is used for illustration. In practical applications, the above functions can be allocated according to different functional modules. That is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the audio playback device provided in the above embodiments and the audio playback method embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.
图6是本申请实施例提供的一种激光投影设备600的结构框图。该激光投影设备600包括投影主机601和投影屏幕602。投影主机601可以包括处理器6011和存储器6012,可选地,投影主机601还可以包括远程拾音麦克,远程拾音麦克可用于语音助手及聊天功能的声音采集。投影屏幕602用于显示图形、文本、图标、视频等信息。投影屏幕602具有摄像头6021,而且,投影屏幕602还包括发声单元6022。FIG. 6 is a structural block diagram of a
处理器6011包括一个或多个处理核心,比如4核心处理器、8核心处理器等。处理器6011可以采用DSP(Digital Signal Processing,数字信号处理)、FPGA(Field-Programmable Gate Array,现场可编程门阵列)、PLA(Programmable Logic Array,可编程逻辑阵列)中的至少一种硬件形式来实现。处理器6011也可以包括主处理器和协处理器,主处理器是用于对在唤醒状态下的数据进行处理的处理器,也称CPU(Central ProcessingUnit,中央处理器);协处理器是用于对在待机状态下的数据进行处理的低功耗处理器。在一些实施例中,处理器6011可以在集成有GPU(Graphics Processing Unit,图像处理器),GPU用于负责显示屏所需要显示的内容的渲染和绘制。一些实施例中,处理器6011还可以包括AI(Artificial Intelligence,人工智能)处理器,该AI处理器用于处理有关机器学习的计算操作。The processor 6011 includes one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 6011 can use at least one hardware form among DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, programmable logic array) accomplish. The processor 6011 may also include a main processor and a coprocessor. The main processor is a processor used to process data in the wake-up state, also called CPU (Central Processing Unit, central processing unit); A low-power processor for processing data in a standby state. In some embodiments, the processor 6011 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen. In some embodiments, the processor 6011 may further include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.
存储器6012可以包括一个或多个计算机可读存储介质,该计算机可读存储介质可以是非暂态的。存储器6012还可包括高速随机存取存储器,以及非易失性存储器,比如一个或多个磁盘存储设备、闪存存储设备。在一些实施例中,存储器6012中的非暂态的计算机可读存储介质用于存储至少一个指令,该至少一个指令用于被处理器6012所执行以实现本申请中方法实施例提供的音频播放方法。Memory 6012 may include one or more computer-readable storage media, which may be non-transitory. Memory 6012 may also include high-speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash storage devices. In some embodiments, a non-transitory computer-readable storage medium in the memory 6012 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 6012 to implement the audio playback provided by the method embodiments in this application. method.
摄像头6021用于采集图像或视频。可选地,摄像头6021设置在投影屏幕602的前面。在一些实施例中,摄像头包括主摄像头、景深摄像头、广角摄像头、长焦摄像头中的任意一种,以实现主摄像头和景深摄像头融合实现背景虚化功能、主摄像头和广角摄像头融合实现全景拍摄以及VR(Virtual Reality,虚拟现实)拍摄功能或者其它融合拍摄功能。在一些实施例中,摄像头组件6021还可以包括闪光灯。闪光灯可以是单色温闪光灯,也可以是双色温闪光灯。双色温闪光灯是指暖光闪光灯和冷光闪光灯的组合,可以用于不同色温下的光线补偿。The camera 6021 is used to capture images or videos. Optionally, the camera 6021 is arranged in front of the projection screen 602 . In some embodiments, the camera includes any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth-of-field camera to achieve a background blur function, the fusion of the main camera and the wide-angle camera to achieve panoramic shooting, and VR (Virtual Reality, virtual reality) shooting function or other integrated shooting functions. In some embodiments, the camera assembly 6021 may also include a flash. The flash can be a single color temperature flash or a dual color temperature flash. Dual color temperature flash refers to the combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.
可选地,激光投影主机601还可以内置有音箱等其他的设备,或者,激光投影主机601还可以外接其他的外设,比如低音炮等等。Optionally, the laser projection host 601 may also have other devices such as speakers built in, or the laser projection host 601 may also be connected to other peripheral devices, such as a subwoofer and the like.
本领域技术人员可以理解,图6中示出的结构并不构成对激光投影设备600的限定,可以包括比图示更多或更少的组件,或者组合某些组件,或者采用不同的组件布置。Those skilled in the art can understand that the structure shown in FIG. 6 does not constitute a limitation on the
在一些实施例中,还提供了一种计算机可读存储介质,该存储介质内存储有计算机程序,所述计算机程序被处理器执行时实现上述实施例中音频播放方法的步骤。例如,所述计算机可读存储介质可以是ROM、RAM、CD-ROM、磁带、软盘和光数据存储设备等。In some embodiments, a computer-readable storage medium is also provided, and a computer program is stored in the storage medium, and when the computer program is executed by a processor, the steps of the audio playback method in the above-mentioned embodiments are implemented. For example, the computer-readable storage medium may be ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.
值得注意的是,本申请实施例提到的计算机可读存储介质可以为非易失性存储介质,换句话说,可以是非瞬时性存储介质。It should be noted that the computer-readable storage medium mentioned in the embodiments of the present application may be a non-volatile storage medium, in other words, may be a non-transitory storage medium.
应当理解的是,实现上述实施例的全部或部分步骤可以通过软件、硬件、固件或者其任意结合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。所述计算机指令可以存储在上述计算机可读存储介质中。It should be understood that, all or part of the steps of implementing the above embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions may be stored in the computer-readable storage medium described above.
也即是,在一些实施例中,还提供了一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机执行上述所述的音频播放方法的步骤。That is, in some embodiments, there is also provided a computer program product containing instructions, which, when executed on a computer, cause the computer to perform the steps of the audio playback method described above.
应当理解的是,本文提及的“至少一个”是指一个或多个,“多个”是指两个或两个以上。在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;本文中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,为了便于清楚描述本申请实施例的技术方案,在本申请的实施例中,采用了“第一”、“第二”等字样对功能和作用基本相同的相同项或相似项进行区分。本领域技术人员可以理解“第一”、“第二”等字样并不对数量和执行次序进行限定,并且“第一”、“第二”等字样也并不限定一定不同。It should be understood that references herein to "at least one" refers to one or more, and "plurality" refers to two or more. In the description of the embodiments of the present application, unless otherwise specified, "/" means or means, for example, A/B can mean A or B; "and/or" in this document is only an association that describes an associated object Relation, it means that there can be three kinds of relations, for example, A and/or B can mean that A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish the same or similar items with basically the same function and effect. Those skilled in the art can understand that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like are not necessarily different.
需要说明的是,本申请实施例所涉及的信息(包括但不限于用户设备信息、用户个人信息等)、数据(包括但不限于用于分析的数据、存储的数据、展示的数据等)以及信号,均为经用户授权或者经过各方充分授权的,且相关数据的收集、使用和处理需要遵守相关国家和地区的相关法律法规和标准。例如,本申请实施例中涉及到的摄像头拍摄的视频画面、获取的待播放的音频信号都是在充分授权的情况下获取的。It should be noted that the information (including but not limited to user equipment information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the embodiments of this application, and Signals are authorized by users or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions. For example, the video images captured by the camera involved in the embodiments of the present application and the acquired audio signals to be played are all acquired with sufficient authorization.
以上所述为本申请提供的实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。The above-mentioned examples provided for this application are not intended to limit this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the protection scope of this application. Inside.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210307766.9A CN114760574A (en) | 2022-03-25 | 2022-03-25 | Audio playing method and laser projection equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210307766.9A CN114760574A (en) | 2022-03-25 | 2022-03-25 | Audio playing method and laser projection equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114760574A true CN114760574A (en) | 2022-07-15 |
Family
ID=82327775
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210307766.9A Pending CN114760574A (en) | 2022-03-25 | 2022-03-25 | Audio playing method and laser projection equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114760574A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115297309A (en) * | 2022-07-29 | 2022-11-04 | 青岛海信激光显示股份有限公司 | Projection picture display method and projection equipment |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20100010151A (en) * | 2008-07-22 | 2010-02-01 | 주식회사 케이티테크 | Filming device having function of playing sound and method for controlling thereof |
WO2020227633A1 (en) * | 2019-05-08 | 2020-11-12 | Meyer Sound Laboratories, Incorporated | System and method for delivering full-bandwidth sound to an audience in an audience space |
CN112423052A (en) * | 2019-11-04 | 2021-02-26 | 青岛海信激光显示股份有限公司 | Display system and display method |
WO2021042655A1 (en) * | 2019-09-04 | 2021-03-11 | 海信视像科技股份有限公司 | Sound and picture synchronization processing method and display device |
CN214070060U (en) * | 2020-11-24 | 2021-08-27 | 四川长虹电器股份有限公司 | Spontaneous sound laser projection display screen |
CN113785596A (en) * | 2019-05-08 | 2021-12-10 | 索尼集团公司 | Signal processing device, signal processing method, program, and video display device |
-
2022
- 2022-03-25 CN CN202210307766.9A patent/CN114760574A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20100010151A (en) * | 2008-07-22 | 2010-02-01 | 주식회사 케이티테크 | Filming device having function of playing sound and method for controlling thereof |
WO2020227633A1 (en) * | 2019-05-08 | 2020-11-12 | Meyer Sound Laboratories, Incorporated | System and method for delivering full-bandwidth sound to an audience in an audience space |
CN113785596A (en) * | 2019-05-08 | 2021-12-10 | 索尼集团公司 | Signal processing device, signal processing method, program, and video display device |
WO2021042655A1 (en) * | 2019-09-04 | 2021-03-11 | 海信视像科技股份有限公司 | Sound and picture synchronization processing method and display device |
CN112423052A (en) * | 2019-11-04 | 2021-02-26 | 青岛海信激光显示股份有限公司 | Display system and display method |
CN214070060U (en) * | 2020-11-24 | 2021-08-27 | 四川长虹电器股份有限公司 | Spontaneous sound laser projection display screen |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115297309A (en) * | 2022-07-29 | 2022-11-04 | 青岛海信激光显示股份有限公司 | Projection picture display method and projection equipment |
CN115297309B (en) * | 2022-07-29 | 2024-05-10 | 青岛海信激光显示股份有限公司 | Projection picture display method and projection equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230328429A1 (en) | Audio processing method and electronic device | |
JP6760271B2 (en) | Information processing equipment, information processing methods and programs | |
US20170068508A1 (en) | Method and system for communicating with a user immersed in a virtual reality environment | |
CN113676592B (en) | Recording method, device, electronic device and computer readable medium | |
CN107730460B (en) | Image processing method and mobile terminal | |
WO2021043121A1 (en) | Image face changing method, apparatus, system, and device, and storage medium | |
US11395089B2 (en) | Mixing audio based on a pose of a user | |
EP4096211B1 (en) | Image processing method, electronic device and computer-readable storage medium | |
US11086587B2 (en) | Sound outputting apparatus and method for head-mounted display to enhance realistic feeling of augmented or mixed reality space | |
KR20210110852A (en) | Image deformation control method, device and hardware device | |
WO2021197020A1 (en) | Audio processing method and apparatus, readable medium, and electronic device | |
CN105635452A (en) | Mobile terminal and contact person identification method thereof | |
CN111445901A (en) | Audio data acquisition method and device, electronic equipment and storage medium | |
CN110853124B (en) | Methods, devices, electronic equipment and media for generating GIF dynamic images | |
CN114630057A (en) | Method, device, electronic device and storage medium for determining special effects video | |
CN107087208B (en) | Panoramic video playing method, system and storage device | |
CN114760574A (en) | Audio playing method and laser projection equipment | |
JPWO2018105552A1 (en) | Voice control device, voice control method and program | |
KR102138835B1 (en) | Apparatus and method for providing information exposure protecting image | |
CN106804010B (en) | Incoming call processing method and device based on virtual reality equipment and virtual reality equipment | |
JP2023184519A (en) | Information processing system, information processing method and computer program | |
TWI581626B (en) | System and method for processing media files automatically | |
CN116055766A (en) | Bullet screen shielding prevention method, bullet screen shielding prevention device, bullet screen shielding prevention equipment and storage medium | |
CN116489451A (en) | Method for determining mirror information, method and device for displaying scene picture | |
CN114745516A (en) | Method, device, storage medium and electronic device for generating panoramic video |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |