CN114760574A - Audio playing method and laser projection equipment - Google Patents
Audio playing method and laser projection equipment Download PDFInfo
- Publication number
- CN114760574A CN114760574A CN202210307766.9A CN202210307766A CN114760574A CN 114760574 A CN114760574 A CN 114760574A CN 202210307766 A CN202210307766 A CN 202210307766A CN 114760574 A CN114760574 A CN 114760574A
- Authority
- CN
- China
- Prior art keywords
- frequency band
- audio signal
- projection
- camera
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R23/00—Transducers other than those covered by groups H04R9/00 - H04R21/00
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
- H04N9/3161—Modulator illumination systems using laser light sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Acoustics & Sound (AREA)
- Optics & Photonics (AREA)
- Multimedia (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses an audio playing method and laser projection equipment, and belongs to the technical field of laser projection. The method comprises the following steps: the method comprises the steps of obtaining an audio signal to be played, wherein the audio signal comprises an audio signal of a first frequency band and an audio signal of a second frequency band, the first frequency band is higher than the second frequency band, detecting whether a camera is in a shooting state, and playing the audio signal of the first frequency band but not playing the audio signal of the second frequency band through a projection screen under the condition that the camera is in the shooting state. When the camera is in a shooting state, namely when a user uses a social function, the problem of picture shake and blurring of shooting of the camera caused by shake generated by sound production of a projection screen is solved by using various methods, effective information in a video call process is kept, the quality of video call is guaranteed, and the laser projection equipment has strong functions of laser large-screen eye protection, screen sound production and sound picture homology, social real-time sharing and the like.
Description
Technical Field
The present disclosure relates to laser projection technologies, and in particular, to an audio playing method and a laser projection apparatus.
Background
With the continuous progress of science and technology, laser projection equipment with a screen sounding function increasingly comes into the lives of people. In order to facilitate the life of people, these laser projection devices may further include a camera through which a social function may be performed.
In the related art, taking a laser television with a sounding screen as an example, a camera serving as a social function is usually preferentially placed on a projection screen because the laser television includes a projection host with a low placement position. However, when the social function is used in a laser television with a screen sounding function, the projection screen vibrates due to the screen sounding, and thus, the picture taken by the camera shakes.
Disclosure of Invention
The embodiment of the application provides an audio playing method and laser projection equipment, and the problem that a camera vibrates due to the fact that a low-frequency audio signal is played in the related art can be solved. The technical scheme is as follows:
in one aspect, an audio playing method is provided, where the laser projection device includes a projection host and a projection screen, the projection screen has a camera, and the projection screen is a sound production screen, and the method includes:
Acquiring an audio signal to be played, wherein the audio signal comprises an audio signal of a first frequency band and an audio signal of a second frequency band, and the first frequency band is higher than the second frequency band;
detecting whether the camera is in a shooting state;
and under the condition that the camera is in a shooting state, playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band.
In another aspect, a laser projection apparatus is provided, which includes a projection host and a projection screen, the projection screen has a camera, the projection screen is a sound screen, the projection host includes a processor, and the processor is configured to:
acquiring an audio signal to be played, wherein the audio signal comprises an audio signal of a first frequency band and an audio signal of a second frequency band, and the first frequency band is higher than the second frequency band;
detecting whether the camera is in a shooting state;
and under the condition that the camera is in a shooting state, playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band.
In another aspect, an audio playing apparatus is provided, the apparatus including:
The device comprises an acquisition module, a playing module and a playing module, wherein the acquisition module is used for acquiring audio signals to be played, the audio signals comprise audio signals of a first frequency band and audio signals of a second frequency band, and the first frequency band is higher than the second frequency band;
the detection module is used for detecting whether the camera is in a shooting state;
and the playing module is used for playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band under the condition that the camera is in a shooting state.
In another aspect, a computer-readable storage medium is provided, in which a computer program is stored, which, when being executed by a processor, implements the steps of the audio playing method described above.
In another aspect, a computer program product is provided, which comprises instructions that, when executed on a computer, cause the computer to perform the steps of the audio playback method described above.
The technical scheme provided by the embodiment of the application can at least bring the following beneficial effects:
when the camera is in a shooting state, namely when the user uses the social function, the first frequency band is higher than the second frequency band, so that the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is not played, therefore, the audio signal of the second frequency band does not cause the projection screen to vibrate, and the shot picture of the camera cannot shake or blur, so that the laser projection equipment has the functions of screen sounding, social sharing and the like.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic diagram of a laser projection apparatus provided in an embodiment of the present application;
fig. 2 is a flowchart of an audio playing method provided in an embodiment of the present application;
FIG. 3 is a schematic diagram of a frequency range of a human voice provided by an embodiment of the present application;
fig. 4 is a flowchart of an audio playing method provided in an embodiment of the present application;
fig. 5 is a schematic structural diagram of an audio playing apparatus according to an embodiment of the present application;
fig. 6 is a block diagram of a laser projection apparatus according to an embodiment of the present disclosure.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail with reference to the accompanying drawings.
Before explaining the audio playing method provided in the embodiments of the present application in detail, a laser projection apparatus related to the embodiments of the present application will be described.
Referring to fig. 1, fig. 1 is a schematic diagram of a laser projection apparatus according to an exemplary embodiment. The laser projection device comprises a projection host 101 and a projection screen 102, wherein the projection screen 102 is provided with a camera. Projection host 101 may be communicatively coupled to projection screen 102. The communication connection may be a wired connection or a wireless connection, which is not limited in this embodiment of the present application.
The projection host 101 is usually installed on a desktop in a desktop installation manner, or installed on a ceiling in a ceiling-mounted manner, and the projection screen 102 is usually installed on a wall surface. When displaying the picture, the projection host 101 is configured to emit laser light to the projection screen 102 based on the picture to be displayed, and the projection screen 102 is configured to display the picture to be displayed. When playing an audio signal, the projection host 101 is configured to send the audio signal to be played to the projection screen 102, and the projection screen 102 plays the audio signal based on a built-in sound-emitting unit, so as to implement a screen sound-emitting function.
When the laser projection device enables the social function, the camera can be opened, the picture is shot by the camera and then sent to the projection host 101, and the projection host 101 sends the received picture out through a network. However, in the process of playing the audio signal by the projection screen 102, the audio signal of the low frequency band may cause the projection screen 102 to generate a large amplitude vibration during sound production, and cause the camera on the projection screen 102 to shake, thereby causing the image captured by the camera to shake or blur. Therefore, the embodiment of the present application provides an audio playing method, by which this problem can be solved.
The social function described above may be a video chat, a live webcast, a music exchange, etc. The social function can meet the social requirements of the user under the condition that the user can not go home, and the most real audio-visual effect is realized for the user.
Those skilled in the art will appreciate that the functions of the projection host 101 and the projection screen 102 are only examples, and other functions that may be present or later come into existence, such as being applicable to the embodiments of the present application, are also included in the scope of the embodiments of the present application and are hereby incorporated by reference.
It should be noted that the laser projection apparatus described in the embodiment of the present application is for more clearly illustrating the technical solutions of the embodiment of the present application, and does not constitute a limitation to the technical solutions provided in the embodiment of the present application, and as the technology evolves, a person skilled in the art can know that the technical solutions provided in the embodiment of the present application are also applicable to similar technical problems.
The following explains the audio playing method provided in the embodiments of the present application in detail.
Fig. 2 is a flowchart of an audio playing method provided in an embodiment of the present application, where the method is applied to a laser projection device, the laser projection device includes a projection host and a projection screen, the projection screen has a camera, and the projection screen is a sound-emitting screen. Referring to fig. 2, the method includes the following steps.
Step 201: the method comprises the steps of obtaining audio signals to be played, wherein the audio signals comprise audio signals of a first frequency band and audio signals of a second frequency band, and the first frequency band is higher than the second frequency band.
The audio signal of the first frequency band is an audio signal with a frequency exceeding a frequency threshold, and the audio signal of the second frequency band is an audio signal with a frequency lower than the frequency threshold. In general, the audio signal of the first frequency band is an audio signal of a middle-high frequency band, and the audio signal of the second frequency band is an audio signal of a low frequency band.
In the embodiments of the present application, "more than" may be understood as being greater than or equal to. Where "more" is understood to be greater than, "less than" is understood to be less than or equal to. Where "more" is understood to be greater than or equal to "less than" is understood to be less than. References to "above" and "below" in the following are made to the interpretation.
Wherein, the frequency threshold value is set in advance, and the low frequency band and the middle and high frequency band can be divided through the frequency threshold value. Moreover, under the condition that the sizes of the projection screens are different, the vibration generated by the screen sounding function on the projection screens is possibly different, and further the vibration generated on the cameras is possibly different, so that in the practical application process, the frequency threshold value can be adjusted according to the sizes of the projection screens. For example, the frequency threshold may be set at 300Hz (Hertz).
The audio signal to be played may be a conversation sound between people, a sound made by a musical instrument when music is exchanged, a background sound when a video call is made, and the like.
Step 202: whether the camera is in a shooting state is detected.
The projection host of the laser projection equipment is communicated with the camera, and the projection host can know whether the camera is in a shooting state.
For example, in a laser television with a social function and a screen sounding function, a projection host of the laser television communicates with a camera, and the projection host can know whether the camera is in a shooting state.
Step 203: and under the condition that the camera is in a shooting state, playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band.
That is, when the camera is in the shooting state, the current audio playing mode of the laser projection device is switched to the social sound production mode. In the social sound production mode, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is not played.
In some embodiments, when the camera is in a shooting state, the audio signal in the second frequency band may be directly deleted, and the audio signal in the first frequency band may be played through the projection screen.
When the social function is used through a camera, a conversation is mainly conducted, and thus, a conversation sound between people is a main sound generated in a social process. Usually, the frequency of the human voice is in the first frequency band, and the audio signal of the second frequency band is deleted without losing the audio signal of the conversation between people. Therefore, under the condition that the camera is in a shooting state, the audio signal of the second frequency band can be directly deleted, and the audio signal of the first frequency band can be played through the projection screen. For example, as shown in fig. 3, the audio signal of the first frequency band refers to an audio signal with a frequency between 300Hz and 20K (Kilo, K) Hz, the audio signal of the second frequency band refers to an audio signal with a frequency between 30Hz and 300Hz, and the frequency range of the human voice is generally between 300Hz and 5KHz, i.e., the frequency of the human voice is in the first frequency band, so that the audio signal of the conversation between people is not lost by deleting the audio signal of the second frequency band.
The laser projection apparatus has a high-pass filter and a low-pass filter therein. Under the condition that the camera is in a shooting state, the audio signal in the first frequency band may be filtered out by the high-pass filter and played by the projection screen, and the audio signal in the second frequency band may be filtered out by the low-pass filter and deleted.
In other embodiments, during the social function performed through the camera, music may be exchanged, such as playing a musical instrument, at this time, valid information may exist in the audio in the second frequency band, and directly deleting the audio signal in the second frequency band may result in the loss of the valid signal. Therefore, in the case where the camera is in the shooting state, it is possible to detect whether or not a valid signal exists in the audio signal of the second frequency band. And under the condition that no effective signal exists in the audio signal of the second frequency band, deleting the audio signal of the second frequency band, and playing the audio signal of the first frequency band through the projection screen. And under the condition that effective signals exist in the audio signals of the second frequency band, the audio signals of the first frequency band are played through the projection screen, and the audio signals of the second frequency band are transferred to other equipment to be played. Of course, the audio signal of the second frequency band may be directly transferred to other devices for playing without determining the valid signal.
The two ways of detecting whether there is a valid signal in the audio signal of the second frequency band include two ways, and the two ways are described next.
In a first implementation, the audio signal to be played is an audio signal generated within a video frame captured by a camera. In this case, the video picture taken by the camera may be recognized to determine whether there is a target motion in the video picture, and in the case where there is no target motion in the video picture, it may be determined that there is no valid signal in the audio signal of the second frequency band. And determining that the effective signal exists in the audio signal of the second frequency band under the condition that the target action exists in the video picture.
The target motion is a motion stored locally or in a cloud space, and may be a musical instrument playing motion or other motions capable of making a sound. The embodiments of the present application do not limit this.
Assuming that the target motion is an instrument playing motion, identifying a plurality of video frames shot by a camera to determine a hand motion and a category of an instrument in a video picture, determining a playing motion corresponding to the instrument from a stored correspondence between the category of the instrument and the playing motion based on the category of the instrument in the video picture, further determining whether the hand motion in the video picture is consistent with the identified instrument playing motion, determining that the instrument playing motion exists in the video picture if the hand motion in the video picture is consistent with the identified instrument playing motion, and determining that the instrument playing motion does not exist in the video picture if the hand motion in the video picture is inconsistent with the identified instrument playing motion.
Since the shapes of different instruments vary and the movements of the hands differ when playing different instruments. Therefore, the hand movement and the type of the musical instrument in the video picture can be identified, so that whether the musical instrument playing movement exists in the video picture or not is determined, and whether the effective signal exists in the audio signal of the second frequency band or not is further judged.
The manner of identifying the hand movement and the type of the musical instrument in the video picture includes multiple manners, and as an example, the hand movement and the type of the musical instrument in the video picture may be identified through a neural network model, that is, the video picture is input into the neural network model to obtain the hand movement output by the neural network model and the type of the musical instrument in the video picture.
Training of the neural network model is required before recognition with the neural network model. That is, a plurality of sample video segments, the hand motion corresponding to each video segment and the type of the instrument in the video segment are obtained, the video segments are used as the input of the neural network model, and the type of the instrument and the hand motion are used as the output of the neural network model, so as to train the neural network model.
In a second implementation, the audio signal to be played is an audio signal generated by playing a musical instrument. In this case, it is possible to extract frequency information of the audio signal of the second frequency band, and determine that a valid signal does not exist in the audio signal of the second frequency band in the case where instrument frequency information matching the frequency information of the audio signal of the second frequency band does not exist in the stored instrument frequency information. In the case where instrument frequency information matching the frequency information of the audio signal of the second frequency band is present in the stored instrument frequency information, it is determined that a valid signal is present in the audio signal of the second frequency band.
Since the frequency of the sound emitted by each instrument during playing has a relatively fixed frequency range, frequency information of a plurality of instruments whose sound emission frequencies are in the second frequency band can be stored in advance. Therefore, the frequency information of the audio signal of the second frequency band can be extracted and compared with the stored musical instrument frequency information, whether the stored musical instrument frequency information contains musical instrument frequency information matched with the frequency information of the audio signal of the second frequency band or not is judged, and whether an effective signal exists in the audio signal of the second frequency band or not can be further determined.
Of course, the above two implementation manners may also be combined, so that the accuracy of identifying the effective signal may be improved. Namely, the video picture shot by the camera is identified to determine whether the target action exists in the video picture, the frequency information of the audio signal of the second frequency band is extracted, and whether the stored instrument frequency information has instrument frequency information matched with the frequency information of the audio signal of the second frequency band is judged. And determining that the valid signal exists in the audio signal of the second frequency band when the target action exists in the video picture and instrument frequency information matched with the frequency information of the audio signal of the second frequency band exists in the stored instrument frequency information. And when the target action does not exist in the video picture or instrument frequency information matched with the frequency information of the audio signal of the second frequency band does not exist in the stored instrument frequency information, determining that no effective signal exists in the audio signal of the second frequency band.
When the audio signal of the second frequency band is transferred to another device for playing, there are two ways of playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band, and the two implementation ways are introduced next.
The first implementation manner is that under the condition that a sound box is arranged in the projection host, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the sound box.
That is to say, under the condition that the camera is in the shooting state, the audio signal of the first frequency band can be filtered out from the audio signal to be played through the high-pass filter, the audio signal of the second frequency band can be filtered out from the audio signal to be played through the low-pass filter, then the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the sound box. Therefore, the audio signal of the second frequency band can not vibrate the projection screen, and further can not shake the shooting picture of the camera.
The second implementation mode is that under the condition that the projection host is connected with a subwoofer, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer.
That is to say, under the condition that the camera is in the shooting state, the audio signal of the first frequency band can be filtered out from the audio signal to be played through the high-pass filter, the audio signal of the second frequency band is filtered out from the audio signal to be played through the low-pass filter, then the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer. Therefore, the audio signal of the second frequency band can not vibrate the projection screen, and further can not shake the shooting picture of the camera.
In the content described above, when the audio signal of the first frequency band is played on the projection screen, the audio signal of the first frequency band may be sent to the oscillator built in the projection screen, and the oscillator generates vibration to drive the projection screen to vibrate and sound.
When the camera is in a shooting state, a mode of playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band is an example, and in the process of practical application, the mode can be realized through other modes.
As an example, in the case where a sound box is provided in the projector host, the audio signal of the first frequency band and the audio signal of the second frequency band are played through the sound box.
That is, the audio signal of the full frequency band is played through the speaker in the projection host, and the audio signal does not need to be played through the projection screen. The method can effectively solve the problem of picture jitter of the camera caused by sound production of the projection screen, and can also completely reserve and play the audio signals of the second frequency band.
As another example, in a case where the projection host has a sound box therein and a subwoofer is connected to the projection host, the audio signal of the first frequency band and the audio signal of the second frequency band are played through the sound box, and the audio signal of the second frequency band is played through the subwoofer.
That is, the audio signal of the full frequency band is played through the sound box in the projection host, and the audio signal of the second frequency band is played through the subwoofer, so that the audio signal does not need to be played through the projection screen. By the method, the problem of shaking of a camera shooting picture caused by sound production of the projection screen can be effectively solved, the audio signals of the second frequency band are completely reserved and played, the audio signals of the second frequency band are played through a subwoofer, accents and bass can be reflected more perfectly, and the audio playing effect is improved.
The above description is of the case where the audio signal of the first frequency band is played through the projection screen without playing the audio signal of the second frequency band in the case where the camera is in the photographing state. Under the condition that the camera is not in a shooting state, the audio signal of the first frequency band and the audio signal of the second frequency band can be directly played through the projection screen. That is, the full band of audio signals is played through the projection screen.
Next, an audio playing method provided in an embodiment of the present application is described with reference to fig. 4 as an example. As shown in fig. 4, after the laser projection apparatus is turned on, it is detected whether the camera is in a shooting state. Under the condition that the camera is not in the shooting state, the audio signals of the first frequency band and the second frequency band are sent to the projection screen, namely, the audio signals of the full frequency band are sent to the projection screen, and the projection screen plays the audio signals. Under the condition that the camera is in a shooting state, the projection host divides audio signals to be played to obtain audio signals of a first frequency range and audio signals of a second frequency range, sends the audio signals of the first frequency range to the projection screen, determines whether the laser projection equipment is connected with a subwoofer or not, and under the condition that the subwoofer is connected, plays the audio signals of the first frequency range through the projection screen and plays the audio signals of the second frequency range through the subwoofer.
In some embodiments, in the case that the camera is in a shooting state, that is, during the process of using the social function, pictures captured by the camera may also be recognized to determine the motion of the user, and the sound production of the projection screen is controlled based on the motion of the user. For example, the picture collected by the camera is identified, so that the action of the user is determined to be a lateral ear action, and when the ear of the lateral ear of the user is determined to be a right ear, the volume of a right sound channel of the projection screen is increased, and the volume of a left sound channel of the projection screen is kept unchanged, so that a near-strong and far-weak sound effect is realized.
In the embodiment of the application, when the camera is in a shooting state, namely when a user uses a social function, the problem that pictures shot by the camera are shaken and blurred due to shaking caused by sounding of a projection screen is solved by using various methods. In some implementations, whether valid information exists in the generated second frequency band audio information is determined by analyzing the generated audio information and identifying the picture shot by the camera, and then the audio signal of the second frequency band is selected to be deleted or transferred to other equipment. Therefore, the problem that pictures shot by a camera are jittered and blurred due to jitter generated by sounding of a projection screen can be effectively solved, effective information in a video call process can be reserved, and the quality of the video call is guaranteed. According to the method provided by the embodiment of the application, the laser projection equipment can simultaneously have the powerful functions of large-screen laser eye protection, screen sound production and sound and picture homology, social real-time sharing and the like.
Fig. 5 is a schematic structural diagram of an audio playing apparatus provided in an embodiment of the present application, where the audio playing apparatus may be implemented by software, hardware, or a combination of the two to become a part or all of the laser projection device, please refer to fig. 5, the apparatus includes: an acquisition module 501, a detection module 502 and a playing module 503.
The obtaining module 501 is configured to obtain an audio signal to be played, where the audio signal includes an audio signal in a first frequency band and an audio signal in a second frequency band, and the first frequency band is higher than the second frequency band. For the detailed implementation process, reference is made to corresponding contents in the foregoing embodiments, and details are not repeated here.
The detecting module 502 is configured to detect whether the camera is in a shooting state. For the detailed implementation process, reference is made to corresponding contents in the foregoing embodiments, and details are not repeated here.
The playing module 503 is configured to play the audio signal in the first frequency band through the projection screen without playing the audio signal in the second frequency band when the camera is in a shooting state. For the detailed implementation process, reference is made to corresponding contents in the foregoing embodiments, and details are not repeated here.
Optionally, the playing module 503 is specifically configured to:
detecting whether a valid signal exists in the audio signal of the second frequency band;
And under the condition that no effective signal exists in the audio signal of the second frequency band, deleting the audio signal of the second frequency band, and playing the audio signal of the first frequency band through the projection screen.
Optionally, the playing module 503 is further specifically configured to:
identifying a video picture shot by a camera to determine whether a target action exists in the video picture;
and determining that the effective signal does not exist in the audio signal of the second frequency band under the condition that the target action does not exist in the video picture.
Optionally, the playing module 503 is further specifically configured to:
extracting frequency information of the audio signal of the second frequency band;
in the case where instrument frequency information matching the frequency information of the audio signal of the second frequency band does not exist in the stored instrument frequency information, it is determined that a valid signal does not exist in the audio signal of the second frequency band.
Optionally, the playing module 503 is specifically configured to:
under the condition that a sound box is arranged in the projection host, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the sound box; or
Under the condition that the projection host is connected with the subwoofer, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer.
In the embodiment of the application, when the camera is in a shooting state, namely when a user uses a social function, the problem that pictures shot by the camera are shaken and blurred due to shaking caused by sounding of a projection screen is solved by using various methods. In some implementation manners, whether valid information exists in the generated second frequency band audio information is judged by analyzing the generated audio information and identifying the picture shot by the camera, and then the audio signal of the second frequency band is selected to be deleted or transferred to other equipment. Therefore, the problem that pictures shot by a camera are jittered and blurred due to jitter generated by sounding of a projection screen can be effectively solved, effective information in a video call process can be reserved, and the quality of the video call is guaranteed. According to the method provided by the embodiment of the application, the laser projection equipment can simultaneously have the powerful functions of large-screen laser eye protection, screen sound production and sound and picture homology, social real-time sharing and the like.
It should be noted that: in the audio playing apparatus provided in the foregoing embodiment, when playing audio, only the division of the functional modules is exemplified, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the apparatus is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the audio playing device and the audio playing method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.
Fig. 6 is a block diagram of a laser projection apparatus 600 according to an embodiment of the present disclosure. The laser projection apparatus 600 includes a projection host 601 and a projection screen 602. Projection host 601 may include a processor 6011 and a memory 6012, and optionally, projection host 601 may further include a remote pickup microphone, which may be used for voice collection for voice assistant and chat functions. Projection screen 602 is used to display information such as graphics, text, icons, video, and the like. The projection screen 602 has a camera 6021, and the projection screen 602 further includes a sound emission unit 6022.
The processor 6011 includes one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 6011 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). Processor 6011 may also include a main processor and a coprocessor, where the main processor is a processor used to process data in an awake state, and is also referred to as a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 6011 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing content required to be displayed by a display screen. In some embodiments, processor 6011 may also include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.
Memory 6012 may include one or more computer readable storage media, which may be non-transitory. Memory 6012 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 6012 is configured to store at least one instruction for execution by the processor 6012 to implement the audio playing method provided by the method embodiments in this application.
The camera 6021 is used to collect images or video. Optionally, a camera 6021 is disposed in front of the projection screen 602. In some embodiments, the camera includes any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to implement a background blurring function by fusing the main camera and the depth-of-field camera, a panoramic shooting function by fusing the main camera and the wide-angle camera, and a VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 6021 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.
Optionally, the laser projection host 601 may further have a built-in speaker or other devices, or the laser projection host 601 may further be externally connected to other peripheral devices, such as a subwoofer or the like.
Those skilled in the art will appreciate that the configuration shown in FIG. 6 is not intended to be limiting of laser projection device 600, and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components may be used.
In some embodiments, a computer-readable storage medium is also provided, in which a computer program is stored, which when executed by a processor implements the steps of the audio playing method in the above embodiments. For example, the computer readable storage medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
It is noted that the computer-readable storage medium referred to in the embodiments of the present application may be a non-volatile storage medium, in other words, a non-transitory storage medium.
It should be understood that all or part of the steps for implementing the above embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions may be stored in the computer-readable storage medium described above.
That is, in some embodiments, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of the audio playback method described above.
It is to be understood that reference herein to "at least one" means one or more and "a plurality" means two or more. In the description of the embodiments of the present application, "/" indicates an alternative meaning, for example, a/B may indicate a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in order to facilitate clear description of technical solutions of the embodiments of the present application, in the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items having substantially the same functions and actions. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance.
It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.) and signals referred to in the embodiments of the present application are authorized by the user or fully authorized by each party, and the collection, use and processing of the relevant data need to comply with relevant laws and regulations and standards in relevant countries and regions. For example, the video pictures taken by the camera and the obtained audio signals to be played in the embodiments of the present application are obtained under sufficient authorization.
The above-mentioned embodiments are provided by way of example and should not be construed as limiting the present application, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (10)
1. The audio playing method is characterized by being applied to laser projection equipment, wherein the laser projection equipment comprises a projection host and a projection screen, the projection screen is provided with a camera, the projection screen is a sounding screen, and the method comprises the following steps:
acquiring an audio signal to be played, wherein the audio signal comprises an audio signal of a first frequency band and an audio signal of a second frequency band, and the first frequency band is higher than the second frequency band;
Detecting whether the camera is in a shooting state;
and under the condition that the camera is in a shooting state, playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band.
2. The method of claim 1, wherein said playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band comprises:
detecting whether a valid signal exists in the audio signal of the second frequency band;
and under the condition that no effective signal exists in the audio signals of the second frequency band, deleting the audio signals of the second frequency band, and playing the audio signals of the first frequency band through the projection screen.
3. The method of claim 2, wherein the audio signal to be played is an audio signal generated within a video picture taken by the camera;
the detecting whether a valid signal exists in the audio signal of the second frequency band includes:
identifying a video picture shot by the camera to determine whether a target action exists in the video picture;
and determining that no effective signal exists in the audio signal of the second frequency band under the condition that no target action exists in the video picture.
4. The method of claim 2, wherein the audio signal to be played is an audio signal generated by playing a musical instrument;
the detecting whether a valid signal exists in the audio signal of the second frequency band includes:
extracting frequency information of the audio signal of the second frequency band;
determining that a valid signal does not exist in the audio signal of the second frequency band in a case where instrument frequency information matching the frequency information of the audio signal of the second frequency band does not exist in the stored instrument frequency information.
5. The method of claim 1, wherein said playing the audio signal in the first frequency band through the projection screen without playing the audio signal in the second frequency band comprises:
under the condition that a sound box is arranged in the projection host, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the sound box; or alternatively
Under the condition that the projection host is connected with a subwoofer, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer.
6. The utility model provides a laser projection equipment which characterized in that, laser projection equipment includes projection host computer and projection screen, projection screen has the camera, projection screen is the sound production screen, the projection host computer includes the treater, the treater is used for:
acquiring an audio signal to be played, wherein the audio signal comprises an audio signal of a first frequency band and an audio signal of a second frequency band, and the first frequency band is higher than the second frequency band;
detecting whether the camera is in a shooting state;
and under the condition that the camera is in a shooting state, playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band.
7. The laser projection device of claim 6, wherein the processor is to:
detecting whether a valid signal exists in the audio signal of the second frequency band;
and under the condition that no effective signal exists in the audio signals of the second frequency band, deleting the audio signals of the second frequency band, and playing the audio signals of the first frequency band through the projection screen.
8. The laser projection device of claim 7, wherein the processor is to:
Identifying a video picture shot by the camera to determine whether a target action exists in the video picture;
and determining that no effective signal exists in the audio signal of the second frequency band under the condition that no target action exists in the video picture.
9. The laser projection device of claim 7, wherein the processor is to:
extracting frequency information of the audio signal of the second frequency band;
determining that there is no valid signal in the audio signal of the second frequency band in a case where there is no instrument frequency information matching the frequency information of the audio signal of the second frequency band in the stored instrument frequency information.
10. The method of claim 6, wherein the processor is configured to;
under the condition that a sound box is arranged in the projection host, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the sound box; or
Under the condition that the projection host is connected with a subwoofer, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210307766.9A CN114760574A (en) | 2022-03-25 | 2022-03-25 | Audio playing method and laser projection equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210307766.9A CN114760574A (en) | 2022-03-25 | 2022-03-25 | Audio playing method and laser projection equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114760574A true CN114760574A (en) | 2022-07-15 |
Family
ID=82327775
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210307766.9A Pending CN114760574A (en) | 2022-03-25 | 2022-03-25 | Audio playing method and laser projection equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114760574A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115297309A (en) * | 2022-07-29 | 2022-11-04 | 青岛海信激光显示股份有限公司 | Projection picture display method and projection equipment |
-
2022
- 2022-03-25 CN CN202210307766.9A patent/CN114760574A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115297309A (en) * | 2022-07-29 | 2022-11-04 | 青岛海信激光显示股份有限公司 | Projection picture display method and projection equipment |
| CN115297309B (en) * | 2022-07-29 | 2024-05-10 | 青岛海信激光显示股份有限公司 | Projection picture display method and projection equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108829881B (en) | Video title generation method and device | |
| US20170374486A1 (en) | Positional audio assignment system | |
| CN111918018B (en) | Video conference system, video conference apparatus, and video conference method | |
| JP6760271B2 (en) | Information processing equipment, information processing methods and programs | |
| CN110673716B (en) | Method, device, equipment and storage medium for interaction between intelligent terminal and user | |
| CN109887494B (en) | Method and apparatus for reconstructing a speech signal | |
| WO2021197020A1 (en) | Audio processing method and apparatus, readable medium, and electronic device | |
| CN108596107A (en) | Lip reading recognition methods and its device, AR equipment based on AR equipment | |
| WO2014061931A1 (en) | Device and method for playing sound | |
| CN113778360B (en) | Screen projection method and electronic equipment | |
| US20200389754A1 (en) | Mixing audio based on a pose of a user | |
| JP2019220848A (en) | Data processing apparatus, data processing method and program | |
| KR20210110852A (en) | Image deformation control method, device and hardware device | |
| CN109243479B (en) | Audio signal processing method and device, electronic equipment and storage medium | |
| CN107087208B (en) | Panoramic video playing method, system and storage device | |
| CN114422935B (en) | Audio processing method, terminal and computer readable storage medium | |
| KR20220106848A (en) | Video special effects processing methods and devices | |
| CN114760574A (en) | Audio playing method and laser projection equipment | |
| US8937635B2 (en) | Device, method and system for real-time screen interaction in video communication | |
| US11086587B2 (en) | Sound outputting apparatus and method for head-mounted display to enhance realistic feeling of augmented or mixed reality space | |
| WO2013008869A1 (en) | Electronic device and data generation method | |
| WO2020234939A1 (en) | Information processing device, information processing method, and program | |
| KR20210056414A (en) | System for controlling audio-enabled connected devices in mixed reality environments | |
| JP2008193563A (en) | Imaging apparatus, reproduction device, imaging method, reproduction method and program | |
| RU42905U1 (en) | EMOTION DETECTION SYSTEM |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |