WO2019153999A1

WO2019153999A1 - Voice control-based dynamic projection method, apparatus, and system

Info

Publication number: WO2019153999A1
Application number: PCT/CN2019/070933
Authority: WO
Inventors: 杨伟樑; 高志强; 林清云; 吴志远
Original assignee: 广景视睿科技（深圳）有限公司
Priority date: 2018-02-09
Filing date: 2019-01-09
Publication date: 2019-08-15
Also published as: CN108319171B; CN108319171A

Abstract

A voice control-based dynamic projection method, apparatus, and system, relating to the technical field of projection devices. The dynamic projection method is applied to the dynamic projection apparatus, and comprises: receiving a voice control instruction, the voice control instruction comprising: an operating state instruction and/or a projection direction adjustment instruction and/or a content search selection instruction (S10); and controlling an operating state of the dynamic projection apparatus according to the operating state instruction, and/or adjusting a projection direction of the dynamic projection apparatus according to the projection direction adjustment instruction, and/or adjusting projection content of the dynamic projection apparatus according to the content search selection instruction (S20). The operating state, projection direction, and projection content of the dynamic projection apparatus can be controlled by means of a voice.

Description

Directional projection method, device and motion projection system based on voice control

Technical field

The present application relates to the field of projection device technologies, and in particular, to a motion control projection method, device and a motion projection system based on voice control.

Background technique

With the rapid development of science and technology and the continuous improvement of people's living standards, the level of automation and intelligence of people's life and work is getting higher and higher, people's requirements for visual perception are getting higher and higher, and projection technology has been widely used. On the other hand, people's requirements for display devices of human-machine interfaces are increasingly moving toward micro, large-screen and high-resolution; on the other hand, people tend to pursue augmented reality and immersive vision in terms of display effects. enjoy. At present, interactive projection technology is gradually entering people's daily life, and is gradually developing in the direction of tracking user intentions.

The existing projection devices on the market are mostly fixed, and their functions are single and poorly interactive, which can no longer satisfy the diversified needs of people for projection. For example, projectors that are common on the market are often fixed in a certain orientation in space. When people need to use them, they need to reach the specified location to view the content they are serving. Once the position of the projector changes, it needs to be recalibrated, so its flexibility is small. The functions of the projection device will vary depending on the usage scenario. For example, in a home or a large stage, when the projection device needs to perform multi-directional projection display according to the user's indicative information, the projection device is required to collect and indicate the user's indicative information, and confirm the required projection content and the projection position direction thereof. Furthermore, the projection display content and the projection direction of the projection lens are adjusted to realize human-computer interaction. Therefore, how to collect the indicative information identifying the user and adjust the projection content and the projection direction according to the indicative information become the research focus in the field.

In the process of implementing the embodiments of the present application, the applicant finds that the related art has at least the following problem: the existing projection device cannot simultaneously adjust the working state, the projection direction, and the projection content of the projection device according to the user's voice.

Application content

The embodiments of the present application are directed to a voice projection-based motion projection method, apparatus, and motion projection system, which solve the problem that the existing projection apparatus cannot simultaneously adjust the working state, the projection direction, and the projection content of the projection apparatus according to the user's voice.

To solve the above technical problem, the embodiment of the present application provides the following technical solutions:

In a first aspect, the embodiment of the present application provides a motion projection method based on voice control, which is applied to a motion projection apparatus, and the method includes:

Receiving a voice control instruction, the voice control instruction comprising: an operation status instruction and/or a projection direction adjustment instruction and/or a content search selection instruction;

Controlling an operating state of the moving projection device according to the working state instruction;

And/or adjusting a projection direction of the moving projection device according to the projection direction adjustment instruction;

And/or adjusting the projected content of the moving projection device according to the content search selection command.

In some embodiments, the method further includes:

Collect environmental voice information,

Extracting voice control information according to the environmental voice information;

The voice control information is identified and a voice control command is generated.

In some embodiments, the working state instruction includes: a start instruction, a pause instruction, a standby instruction, and a shutdown instruction; and the controlling the working state of the moving projection device according to the working state instruction, including:

Presetting the instruction information corresponding to different working state instructions;

And controlling the working state of the moving projection device according to the instruction information.

In some embodiments, the instruction information corresponding to the startup instruction is startup information, and the method further includes:

Determining, according to the environmental voice information, whether the environmental voice information includes preset startup information;

And starting the moving projection device and determining the target sound according to the startup information;

Determining a user corresponding to the target sound as a tracking target,

A voice control command is determined based on the sound of the tracking target.

In some embodiments, the method further includes:

And extracting, according to the voice control information, a feature parameter of the voice control information, where the feature parameter includes: a sound amplitude and a sound arrival time;

Determining a current location of the tracking target according to the feature parameter;

And according to the current position of the tracking target, the projection direction of the motion projection device is automatically adjusted such that the projection direction of the motion projection device faces the tracking target.

In some embodiments, the automatically adjusting the projection direction of the motion projection device in real time according to the projection direction adjustment instruction comprises:

After automatically adjusting the projection direction of the motion projection device, if the user still cannot completely face the projection screen, the user's projection direction adjustment command is received, and the projection direction of the motion projection device is accurately adjusted according to the projection direction adjustment command.

In some embodiments, the projection direction adjustment instruction includes: a direction adjustment instruction and an angle adjustment instruction, and the method includes:

The direction adjustment instruction corresponds to direction adjustment information, and the angle adjustment instruction corresponds to angle adjustment information;

Determining an adjustment direction of a projection direction of the moving projection device according to the direction adjustment information;

The projection direction of the moving projection device is adjusted in conjunction with the angle adjustment information.

In some embodiments, the motion projection apparatus includes a pre-stored database, and the adjusting the projection content of the motion projection apparatus according to the content search selection instruction comprises: correspondingly pushing a database in a database pre-stored according to the content search selection instruction The projected content is displayed; and/or the Internet related content is searched for projection display.

In some embodiments, the content search selection instruction comprises: a first retrieval instruction and a secondary retrieval instruction; the method comprising:

The initial retrieval instruction corresponds to initial retrieval information, and the secondary retrieval instruction corresponds to secondary retrieval information;

When the initial search is performed, if the content search selection information corresponds to a plurality of contents of the database or the Internet pre-stored by the projection device, the content of the desired projection display is further determined by the secondary search information.

In some embodiments, the pre-stored database includes a plurality of voice libraries, and the plurality of different voice libraries respectively correspond to different projection contents, and the method further includes:

Determining a target sound according to the environmental voice information;

Extracting target sound feature information, and determining a voice library corresponding to the target sound,

Determining the projection content according to the speech library corresponding to the target sound, and projecting the projection content.

In a second aspect, the embodiment of the present application provides a moving projection device, including:

a voice collection module, configured to collect environmental voice information;

a voice processing module, configured to extract voice control information according to the ambient voice information;

a voice recognition module, configured to identify the voice control information, and generate a voice control instruction;

a control module, configured to control the motion projection device according to the voice control instruction;

a motion projection module, the motion projection module includes: a projection module and a motion driving device for changing a projection direction of the motion projection module;

a voice positioning module, configured to locate and analyze a current location data of the user according to the voice control information;

a storage module, configured to establish a database pre-stored by the moving projection device;

The wireless transmission module is configured to search for relevant projection content through the network according to the voice control instruction, and perform wireless transmission projection display.

In a third aspect, an embodiment of the present application provides a motion projection system, where the system includes:

The above-mentioned moving projection device;

At least one processor; and,

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the voice control based motion projection method described above.

An advantageous effect of the embodiment of the present application is that, in the case of the prior art, a motion control projection method based on voice control provided by the embodiment of the present application receives a voice control instruction, where the voice control instruction includes: a working state instruction And/or a projection direction adjustment instruction and/or a content search selection instruction; controlling an operation state of the moving projection device according to the working state instruction; and/or adjusting a projection direction of the moving projection device according to the projection direction adjustment instruction; and / or according to the content search selection command, adjust the projection content of the moving projection device. Through the above method, the embodiment of the present application can realize the working state, the projection direction, and the projection content of the moving projection device by voice control.

DRAWINGS

The one or more embodiments are exemplified by the accompanying drawings in the accompanying drawings, and FIG. The figures in the drawings do not constitute a scale limitation unless otherwise stated.

FIG. 1 is a schematic flowchart diagram of a motion-based projection method based on voice control according to an embodiment of the present application;

2 is a schematic flow chart of a method for controlling a projection direction according to an embodiment of the present application;

3 is a schematic structural diagram of a motion projection apparatus according to an embodiment of the present application;

4 is a schematic structural diagram of a motion projection system provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. It is a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

Further, the technical features involved in the various embodiments of the present application described below may be combined with each other as long as they do not constitute a conflict with each other.

In the embodiment of the present application, the moving projection device may be an electronic device capable of realizing a moving projection method, such as a projector, a projector, a moving projector, a projection lamp, an interactive projection device, and the like.

Specifically, the embodiment of the present application is specifically described below by taking a projector as an example.

Example 1

Please refer to FIG. 1. FIG. 1 is a schematic flowchart diagram of a method for moving a projection according to an embodiment of the present application. As shown in FIG. 1, the method is applied to a motion projection device, such as a projector with a pan/tilt head, the method comprising:

Step S10: Receive a voice control instruction, where the voice control instruction includes: a working state instruction and/or a projection direction adjustment instruction and/or a content search selection instruction;

Specifically, the voice control instruction is generated by environment voice, and the environment voice information is collected by using ambient voice information, and in order to extract control information about the motion projection device from the noisy environment voice information, The environmental voice information is processed in different ways, such as noise reduction processing, vocal amplification processing, and the like. After the environment voice is processed correspondingly by different processing manners, the voice control information may be extracted according to the environment voice information. The voice control information includes activation information, suspension information, standby information, shutdown information, and the like, and generates a voice control instruction by identifying the voice control information. The voice control information may be a word, a vocabulary, a phrase, a short sentence, an English word, an English phrase, or a vocabulary, a short sentence, or a dialect in other languages, and the like.

The voice control instruction includes a working state instruction, a projection direction adjustment instruction, and a content search selection instruction, and different instructions correspond to different information, for example, the working status instruction includes: startup information, pause information, standby information, shutdown information, and projection. The direction adjustment instruction includes: direction adjustment information and angle adjustment information; the content search selection instruction includes: content search information, content selection information, and the like. The voice control information can be extracted through the environment voice information, and the specific type of the voice control information is determined according to the specific content of the voice control information, and the corresponding voice control instruction is generated according to the specific type and specific content of the voice control information. It can be understood that, since the voice control instruction may include multiple instruction types, including: a working state instruction, a projection direction adjustment instruction, and a content search selection instruction; therefore, the voice control instruction may include multiple voice control information, which may be The plurality of voice control information are processed correspondingly, and the priority may be set for different voice control instructions, where the working state command is set to a first priority, the projection direction adjustment command is set to a second priority, and the content search is performed. The selection instruction is set to a third priority; if the voice control information extracted by the ambient voice information includes multiple types of information, by identifying all the information included in the voice control information, respectively determining the instruction type corresponding to the information, respectively Determining a priority of the instruction type, and processing the environmental voice information in a prioritized order according to different priorities. The first priority is greater than the second priority, and the second priority is greater than the third priority. It can be understood that if the voice control information includes multiple types of information, but the multiple types of information belong to the same priority, the processing is performed in chronological order.

Step S20: controlling an operation state of the moving projection device according to the working state instruction; and/or adjusting a projection direction of the moving projection device according to the projection direction adjustment instruction; and/or adjusting a movement according to the content search selection instruction The projected content of the projection device.

The operating state command includes: a start command, a pause command, a standby command, and a shutdown command; the startup command corresponds to the startup information; The pause command corresponds to the pause information; the standby command corresponds to the standby information; the shutdown command corresponds to the shutdown information, wherein the startup information, the pause information, the standby information, and the shutdown information can be manually set, for example, the startup information can be set to: Start, start, action, begin, etc., can also be set to: please start projection, please start projection and other short sentences; the pause information can be set to: pause, stop and other words, can also be set to: please pause projection, please Stop the projection and other short sentences; the standby information can be set to: standby, waiting, etc.; can also be set to: standby projection, please wait for projection and other short sentences; the shutdown information can be set to: shutdown, end, over, etc. Vocabulary; can also be set to: please shut down, end projection, please close the projection and other short sentences;

The start information, the pause information, the standby information, and the shutdown information corresponding to the start command, the pause command, the standby command, and the shutdown command are all saved in a pre-stored database, and preset instruction information corresponding to different working state instructions is preset. And saving the instruction information in a database preset by the moving projection device, and controlling the working state of the moving projection device by identifying the instruction information corresponding to the working state instruction.

It can be understood that, when the motion projection device is used for the first time, the motion projection device is in a shutdown state, and at this time, the projection device can be manually turned on, and the instruction information of the motion projection device is set, and the instruction information is saved in a database. Or, directly, the operation state of the moving projection device is controlled by the factory-set command information. Specifically, if the motion projection device is in a power-on state, the motion projection device can be controlled to enter a pause state, a standby state, or a power-off state by voice; when the motion projection device is in a pause state, the motion projection device can be voice-controlled to enter. Turning on, standby or off state, and other state transitions, it can be understood that in order to save the power consumption of the moving projection device, and the moving projection device can be quickly activated, the moving projection device will default to the standby state. The moving projection device can be switched from the standby state to the activated state by a start command. Different instruction status information is used to determine different working state commands, and the state transition of the moving projection device is controlled to adapt to different usage requirements.

The projection direction adjustment instruction includes: a direction adjustment instruction and an angle adjustment instruction, where the direction adjustment instruction corresponds to the direction adjustment information, according to the projection direction adjustment instruction, and the projection direction of the motion projection apparatus is adjusted; The angle adjustment command corresponds to the angle adjustment information, and the angle adjustment command is used to identify the angle adjustment information, determine the adjustment direction of the projection direction of the motion projection device according to the angle adjustment information, and adjust the information according to the angle adjustment information. Adjusting the angle of the moving projection device relative to the adjustment direction, thereby accurately adjusting the projection direction of the moving projection device. Setting the direction adjustment information includes: up, down, left, and right; setting the angle adjustment information includes: first level, second level, third level, the first level is defined as an angle deflection of 5 degrees, the second The stage is defined as an angular deflection of 10 degrees, and the three stages are defined as an angular deflection of 15 degrees. The direction adjustment information is combined with the angle adjustment information to adjust the projection direction of the moving projection device. For example, the user sends a voice: "downward secondary", the motion projection device identifies whether the voice control information includes: a second level, when the voice control information is recognized to include: down to the second level, The projection direction of the motion projection device is adjusted to be 10 degrees below, thereby adjusting the projection direction of the motion projection device.

It can be understood that the direction adjustment information may be more fine. For example, the direction adjustment information may include: up, down, left, right, left, right, left, and right; Wherein, the upper left indicates a 45 degree angular direction along the upper left, the upper right indicates a 45 degree angular direction along the upper right, the lower left indicates a 45 degree angular direction along the lower left, and the lower right indicates the lower right. 45 degree direction; the angle adjustment information can also be more fine, and can directly recognize the angle in the voice, for example: 10 degrees, 20 degrees, the user can control the projection direction of the motion projection device by sound, for example: to the left 15 Degree, the projection direction of the moving projection device is adjusted to 15 degrees to the lower left, which is convenient and quick. The adjustment direction of the projection direction of the motion projection device is determined by the direction adjustment information, and the projection direction of the motion projection device is accurately adjusted according to the angle adjustment information, so that the projection screen can be adjusted to face the user.

The projection content of the moving projection device is adjusted according to the content search selection instruction. Specifically, the motion projection device includes a pre-stored database, and the database is used for storing projection content, where the projection content includes audio and video. , text, PPT and other visualization files, the database is equivalent to a personal computer, the database can store the user's file, and the database also establishes an index relationship, indexes the user's file, and can directly find the content by projecting the content information. The user's file is convenient for projecting the file, or classifying the files in the user's database, and classifying different types of files to index the keywords of the file, which is convenient for the user to directly Finding a file for projection, wherein the moving projection device is further connected to the Internet, and the projection content information is obtained according to the voice information of the user, and the projection content of the user is searched by the search engine according to the projected content information, specifically, , Google, etc. Search engine users projected content, based on the search results to determine the projected content information, for example: Baidu search by projecting the contents information corresponding to voice information, select the five highest correlation search results for users to choose.

The moving projection device may identify the projected content information included in the content search selection instruction according to the content search selection instruction, and push the corresponding projected content in the pre-stored database and/or search the Internet according to the projected content information. Related content is projected and displayed. Specifically, if there are multiple projection contents corresponding to the projection content information, the projection content may be selected again according to the voice instruction of the user, and the projection content is selected and determined for projection. Specifically, the content of the content is selected by the secondary screening, wherein the content search selection instruction includes: a first retrieval instruction and a secondary retrieval instruction, wherein the initial retrieval instruction corresponds to initial retrieval information, and the secondary retrieval instruction corresponds to two times The information is retrieved, and when the initial search is performed, if the content search selection information corresponds to a plurality of contents of the database or the Internet pre-stored by the projection device, the content of the desired projection display is further determined by the secondary search information. For example, when a user needs to play a photo of a pre-stored database, a voice command of "viewing photos" may be issued, or when the user needs to search for a song MV of Teresa Teng in a webpage such as a cool dog, the "cool dog" may be issued simultaneously or sequentially. "Teng Lijun" voice control command, projection display Teresa Teng's song list and then choose to determine the song MV of the main point.

The voice control instruction further includes: a projection screen control instruction, the projection screen control instruction includes: projection screen control information, where the projection screen control information is used to change a size, a light, a projection screen of the projection device of the motion projection device, Brightness, contrast, clarity, transparency, color, and other features, by projecting screen control commands, in conjunction with the content search selection command, adjusting the projection screen itself and the projected content, facilitates better presentation of the projected content.

The database pre-stored by the moving projection device includes a plurality of voice libraries, and the plurality of different voice libraries respectively correspond to different projection contents, the method further comprising: determining a target sound according to the environmental voice information; a target voice corresponding to the voice library, the target voice corresponding to a unique voice library, by extracting target sound feature information, such as: timbre, pitch, loudness, and the like, according to the sound feature, determining the target sound Corresponding speech library, determining projection content according to the speech library corresponding to the target sound, and projecting the projection content. The database stored in the moving projection device may include: a male voice library, a female voice library, and a children's voice library, wherein the different voice libraries respectively correspond to different projection contents, for example, the male voice library corresponds to a car, and the sports Content related to fitness, games, etc., the female voice library corresponds to beauty, makeup, shopping, and the like, and the child voice library corresponds to animation, learning, and the like, by establishing different voice libraries and different projection contents. The relationship is convenient for projecting the corresponding content according to the user's interests. The method further includes: identifying, according to the environmental voice information, whether the environment voice information includes startup information, starting the motion projection device according to the activation information, determining a target sound, and identifying a voice library corresponding to the target sound, Projecting content corresponding to the voice library is automatically projected according to a voice library corresponding to the target sound. The recognition of the target sound may be recognized by identifying features such as timbre, pitch, frequency, and loudness of the target sound, and the voice library corresponding to the target sound is identified by features such as timbre, pitch, frequency, and loudness of the target sound. It is advantageous to determine the target object according to the target sound and perform corresponding adjustment on the projected content. The voice library can also set a plurality of voice libraries according to different users, and can set different voice libraries according to the age of the user, for example, a post-70 voice library, a post-80 voice library, a post-90 voice library, or other age groups can be set. a voice library, corresponding to different projection contents in the database according to different age groups of the user, and determining a user's emotion corresponding to the target sound according to characteristics such as timbre, pitch, frequency, and loudness of the target sound a state in which the projected content is determined according to the emotional state of the user. For example, if the emotional state of the user is determined to be a negative emotion by the characteristics of the timbre, pitch, frequency, loudness, and the like of the target sound, some positive types of content may be automatically projected, such as projecting some comedy movies, funny clips, or Other content that helps users improve their moods. If the emotional state of the user is determined to be a positive emotion by the characteristics of the timbre, pitch, frequency, loudness, and the like of the target sound, the same type of content may continue to be projected. It can be understood that the content corresponding to the automatic projection of the voice library should be used to control the projection of the motion projection device by the content search selection instruction when the user does not issue content search selection information to the motion projection device. In the case of content, the projection screen of the moving projection device will perform corresponding projection according to the projection content corresponding to the content search selection instruction.

In the embodiment of the present application, the voice control instruction includes: a working state instruction, a projection direction adjustment instruction, and a content search selection instruction; and controlling the working state of the moving projection device according to the working state instruction; and And adjusting the projection direction of the motion projection device according to the projection direction adjustment command; and/or adjusting the projection content of the motion projection device according to the content search selection command. Through the above method, the embodiment of the present application can realize the working state, the projection direction, and the projection content of the moving projection device by voice control.

Example 2

Referring to FIG. 2, FIG. 2 is a schematic flowchart of a method for controlling a projection direction according to an embodiment of the present disclosure. In the embodiment of the present application, the motion projection device is not activated by default.

As shown in Figure 2, the method includes:

Step S201: collecting environmental voice information;

Specifically, the ambient voice information is a sound acquired before the motion projection device is not activated, and the ambient voice information is collected by performing environmental noise reduction processing to eliminate interference noise, and may also perform sound ripple recording to determine different The ripple of the sound of tone, tone, frequency, and loudness, and the waveforms of different sounds are recorded separately. By recording the waveform of the ambient voice, it is advantageous to identify different sounds and locate the sound.

Step S202: Identify whether the environmental voice information includes preset startup information.

Specifically, the preset startup information is a preset instruction capable of starting projection of the projector, and may be set to a word such as “start”, “action”, “start”, or may be set to “please start projection”. In the sentence, when the moving projection device recognizes the preset activation information from the ambient voice, the motion projection device is automatically activated for projection. The motion projection device can identify the preset startup information by means of modeling. Specifically, the motion projection device can use a hidden Markov model (HMM) to preset startup information, such as “start” and “action”. A phrase such as "start" or "please start projection" is used for training modeling, and the built model determines whether the environmental voice information contains preset startup information. For example, in the moving projection device, the startup information capable of starting the projector projection is preset to be “start”, and when the user A issues a “start” command, the collected environmental voice includes the “start” startup information, and the moving projection device is included. Will start.

Step S203: Start moving the projection device and determine a target sound according to the startup information;

Further, the preset activation information can also be used as an identifier of the tracking target, that is, when the motion projection device recognizes the preset activation information from the ambient voice, the target sound including the startup information is determined to be a motion projection. The tracking target of the device, the moving projection device determines the projection direction by tracking and positioning the target sound.

Step S204: determining a user corresponding to the target sound as a tracking target, and determining a current location of the tracking target;

Specifically, the target sound includes a specific timbre, pitch, amplitude, loudness, and other sound features, and the target can be more accurately obtained by comprehensively analyzing sound characteristics such as timbre, pitch, amplitude, and loudness of the target sound. Sound information reduces interference.

Specifically, the voice control information is obtained by extracting the environmental voice information, and the feature parameters of the voice control information are extracted according to the voice control information, where the feature parameters include: a sound amplitude and a sound arrival time; The parameter determines the current location of the tracking target. Specifically, the current position of the tracking target can be determined by a time difference based positioning method and a sound amplitude based positioning method.

The time difference based positioning method performs positioning by using sounds collected by microphones at different positions in the microphone array with different arrival times (ie, time differences), and calculates a current position of the tracking target according to a geometric function. Specifically, a multiple signal classification algorithm (MUSIC) can be used to determine the direction in which the sound is generated, and then the current position of the tracking target is determined by the direction in which the sound is generated.

The sound characteristic based positioning method performs positioning by using sounds collected by microphones at different positions in the microphone array to have different amplitudes (ie, amplitude differences), specifically, calculating a microphone array according to a physical position difference of each microphone in the microphone array. The amplitude value of each point on the line is based on the same amplitude from the same distance position of the sound source. Through the mathematical model, the point on the same acoustic arc is found, and the position of the point is the current position of the tracking target.

Step S205: automatically adjusting the projection direction of the motion projection device according to the current position of the tracking target, so that the projection direction of the motion projection device is opposite to the tracking target;

Specifically, after the current position of the tracking target is determined by the sound amplitude and/or the sound arrival time, the motion projection device adjusts the projection direction of the projection image of the motion projection device according to the current position of the tracking target. The projection direction of the moving projection device is opposite to the tracking target, wherein the projection direction can also be determined by tracking the sound direction of the target's mouth, and the projection direction is determined by identifying the current position of the tracking target and tracking the sound direction of the target's mouth. For example, if the projection direction of the projection screen has been adjusted to be the current position of the tracking target, that is, the body of the tracking target is facing the projection direction of the projection screen, when the tracking direction of the tracking target is with the body Inconsistent, that is, the sounding direction of the mouth of the tracking target is at an angle to the projection direction, and the projection direction of the moving projection device is adjusted to the sounding direction of the tracking target according to the sounding direction of the mouth of the tracking target .

The method further includes: identifying a sounding direction of the tracking target, determining whether the voice control instruction is a valid command according to a sounding direction of the tracking target; and calculating a projection angle of the moving projection device by a preset angle threshold The angle of the sounding direction of the tracking target is determined, whether the angle is greater than the angle threshold, and if it is greater, determining that the voice control command is an invalid command, if the projection direction of the moving projection device and the tracking target The angle of the pronunciation direction is less than or equal to the angle threshold, and the voice control instruction is determined to be a valid instruction. For example, if the angle of the tracking target is 45 degrees, when the angle between the sounding direction of the tracking target and the projection direction of the moving projection device is greater than 45 degrees, it is determined that the sound of the tracking target is an invalid sound, and the voice control instruction is also an invalid instruction. . For example, the pronunciation direction of the tracking target can be tracked in real time, and according to the pronunciation direction, whether the voice control command of the tracking target is a valid command, and if the voice control command is an invalid command, the motion projection device will The invalid instruction is not executed, and if the voice control instruction is a valid instruction, the motion projection device performs a corresponding action according to the voice control instruction.

Wherein, when the projection direction of the motion projection device is automatically adjusted, the projection direction is accurately adjusted according to the projection direction adjustment command of the user. Specifically, the projection direction adjustment instruction includes: a direction adjustment instruction and an angle adjustment instruction, where the direction adjustment instruction corresponds to the direction adjustment information, the angle adjustment instruction corresponds to the angle adjustment information, and the angle adjustment instruction is used to identify the angle adjustment information Determining, according to the angle adjustment information, an adjustment direction of a projection direction of the motion projection device, and adjusting an adjustment angle of the motion projection device relative to the adjustment direction according to the angle adjustment information, thereby accurately adjusting the The direction of projection of the projection device. Setting the direction adjustment information includes: up, down, left, and right; setting the angle adjustment information includes: first level, second level, third level, the first level is defined as an angle deflection of 5 degrees, the second The stage is defined as an angular deflection of 10 degrees, and the three stages are defined as an angular deflection of 15 degrees. The direction adjustment information is combined with the angle adjustment information to adjust the projection direction of the moving projection device. For example, the user sends a voice: "downward secondary", the motion projection device identifies whether the voice control information includes: a second level, when the voice control information is recognized to include: down to the second level, The projection direction of the motion projection device is adjusted to be 10 degrees below, thereby adjusting the projection direction of the motion projection device.

It can be understood that when the motion projection device does not receive the voice control command for a long time, and the projection screen of the motion projection device does not change, the motion projection device will automatically enter the standby state and will delete The information of the tracking target is tracked until new startup information is recognized, and the user corresponding to the sound corresponding to the activation information is set as a new tracking target.

In the embodiment of the present application, the environment voice information is collected to identify whether the environment voice information includes preset startup information, and according to the startup information, the motion projection device is activated and the target voice is determined, and the user corresponding to the target voice is determined. The tracking target is determined, and the current position of the tracking target is determined. According to the current position of the tracking target, the projection direction of the moving projection device is automatically adjusted such that the projection direction of the moving projection device faces the tracking target. In the above manner, the embodiment of the present application can accurately adjust the projection direction of the motion projection device such that the projection direction of the motion projection device faces the tracking target.

Example 3

Referring to FIG. 3 and FIG. 4, FIG. 3 is a schematic structural diagram of a motion projection apparatus according to an embodiment of the present disclosure, and FIG. 4 is a schematic structural diagram of a motion projection system according to an embodiment of the present application. The motion projection device can be applied to a motion projection system. As shown in FIG. 3, the motion projection device 10 includes:

The voice collection module 101 is configured to collect environment voice information; the voice collection module 101 may be a single microphone or a microphone array; the voice collection module 101 may be packaged together with a motion projection module, and the voice collection module and the voice collection module The electrical connection between the moving projection modules is performed by the control module; or the voice collecting module is independently disposed at any position in the projection space, and the voice collecting module and the moving projection module each set a wireless transmission module, and the wireless transmission module is wirelessly connected therebetween. The mode performs data transmission; according to the number of the microphones, the microphone array can be configured as a linear array, a triangular array, a circular array, a circular array, and a rectangular array, and the distance between the microphones can be set according to the actual application environment space. The size is adjusted. Since the position of each microphone is different, the distance of the same sound to different microphones is different, so that there is a time difference/amplitude difference when the sound reaches the sound collecting device, and based on this, the collected sound can be positioned.

The voice processing module 102 is configured to extract voice control information according to the environment voice information. The voice processing module 102 may be a voice processor, a voice controller, and other devices that can perform voice processing.

The voice recognition module 103 is configured to identify the voice control information and generate a voice control command. The voice recognition module 103 can be a voice recognizer.

The control module 104 is configured to control the motion projection device according to the voice control instruction;

The motion projection module 105 includes: a projection module and a motion driving device for changing a projection direction of the motion projection module; the motion driving device is a pan/tilt or a multi-dimensional motion platform, and can realize spherical rotation.

The voice positioning module 106 is configured to locate and analyze the current location data of the user according to the voice control information; the voice positioning module is configured to locate and analyze the current location data of the user according to the voice control information, specifically, extract the feature parameter of the voice control information, The characteristic parameter includes a sound amplitude or a sound arrival time; determining a position coordinate of the user according to a sound amplitude or a sound arrival time of the target sound; wherein the voice positioning module may include a calculation analysis module, where the calculation analysis module is configured to Calculating the direction and angle of the required rotation of the motion driving device according to the position coordinates of the user and the coordinates of the moving projection module, so that the user can face the projection picture;

The storage module 107 is configured to establish a database pre-stored by the moving projection device; wherein the storage module 107 can be a storage device such as a mechanical hard disk or a solid state hard disk, and different voice control instructions correspond to different projection contents;

The wireless transmission module 108 is configured to search for related projection content through a network according to a voice control instruction, and perform wireless transmission projection display. The wireless transmission module 108 can be WIFI, Bluetooth, and the like.

It should be noted that the above-mentioned voice control-based motion projection method and projection apparatus thereof can be applied to various scenarios, and all devices and methods for controlling a motion projection device by voice are within the scope protected by the present application. For example, the voice control-based motion projection method and the projection device thereof can be applied to a song playing system such as a KTV or a family entertainment room. After the user voice wakes up to the projection device, the voice song operation can be performed, for example, “Give me "The first week of Jay's song", the moving projection device can also add the role of artificial intelligence interaction, can be defined based on the voice control settings to be able to read, understand, understand, have memories, self-learning, and truly understand the master's emotions of artificial intelligence partners The response method is naturally emotional; for example: first respond to the user "good, master, will pick you Jay Chou's most popular songs", then project the song list and adjust the projection direction according to the user's position for the user to watch. Select, the user can select in the list, such as "play the third bar", then the moving projection device plays the third singing MV in the list after receiving the instruction. Of course, the voice-based motion-based projection method and the projection device thereof can also be applied to a food ordering system in a restaurant private room, such as a locked tracking user to issue a “Cantonese Menu” command, according to the position of the locked user. Angle adjustment projection direction dynamic projection display Cantonese menu for users to choose the order, the user does not issue a voice control command when the user exceeds the set time, then the projector automatically enters the standby state; when other guests in the private room need to order and issue a wake-up command The moving projection device adjusts the projection direction in time and collects voice control commands for tracking new users.

Please refer to FIG. 4 again. FIG. 4 is a schematic structural diagram of a moving projection system according to an embodiment of the present application.

As shown in FIG. 4, the motion projection system 100 includes a motion projection device 10, one or more processors 20, and a memory 30. Wherein, one processor 20 is taken as an example in FIG.

The processor 20 and the memory 30 may be connected by a bus or other means, as exemplified by a bus connection in FIG.

The memory 30 is a non-volatile computer readable storage medium, and can be used for storing non-volatile software programs, non-volatile computer-executable programs, and modules, such as a voice-based movement in the embodiment of the present application. The unit corresponding to the projection method (for example, each module described in FIG. 3). The processor 20 performs various functional applications and data processing of the voice-based motion-based projection method by running non-volatile software programs, instructions, and modules stored in the memory 30, that is, implementing the above-described method embodiments based on voice control The method of moving projections and the functions of the various modules and units of the device embodiments described above.

Memory 30 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 30 can optionally include memory remotely located relative to processor 20, which can be coupled to processor 20 over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The module is stored in the memory 30, and when executed by the one or more processors 20, performs a voice control based motion projection method in any of the above method embodiments, for example, performing FIG. 1 described above. The various steps shown in Figure 2; the functionality of the various modules or units described in Figure 3 can also be implemented.

The embodiment of the present application further provides a non-volatile computer storage medium storing computer-executable instructions executed by one or more processors, such as one of the processes in FIG. The above-mentioned one or more processors may be configured to perform a voice control based motion projection method in any of the above method embodiments, for example, to perform a voice control based motion projection method in any of the above method embodiments, for example, performing The various steps shown in Figures 1 and 2 described above; the functions of the various units described in Figure 3 can also be implemented.

The apparatus or device embodiments described above are merely illustrative, wherein the unit modules described as separate components may or may not be physically separate, and the components displayed as modular units may or may not be physical units. , can be located in one place, or can be distributed to multiple network module units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a general hardware platform, and of course, by hardware. Based on such understanding, the above technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as a ROM/RAM or a disk. , optical discs, etc., including a number of instructions for use in a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not limited thereto; in the idea of the present application, the technical features in the above embodiments or different embodiments may also be combined. The steps may be carried out in any order, and there are many other variations of the various aspects of the present application as described above, which are not provided in the details for the sake of brevity; although the present application has been described in detail with reference to the foregoing embodiments, The skilled person should understand that the technical solutions described in the foregoing embodiments may be modified, or some of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the embodiments of the present application. The scope of the technical solution.

Claims

A motion-based projection method based on voice control is applied to a motion projection device, and the method includes:

Receiving a voice control instruction, the voice control instruction comprising: an operation status instruction and/or a projection direction adjustment instruction and/or a content search selection instruction;

Controlling an operating state of the moving projection device according to the working state instruction;

And/or adjusting a projection direction of the motion projection device according to the projection direction adjustment command; and/or adjusting a projection content of the motion projection device according to the content search selection command.
The method of claim 1 further comprising:

Collect environmental voice information,

Extracting voice control information according to the environmental voice information;

The voice control information is identified and a voice control command is generated.
The method according to claim 2, wherein the working state instruction comprises: a start command, a pause command, a standby command, and a shutdown command; and the operating state command is controlled according to the working state command, including :

Presetting the instruction information corresponding to different working state instructions;

And controlling the working state of the moving projection device according to the instruction information.
The method according to claim 3, wherein the instruction information corresponding to the startup instruction is startup information, and the method further comprises:

Determining, according to the environmental voice information, whether the environmental voice information includes preset startup information;

And starting the moving projection device and determining the target sound according to the startup information;

Determining a user corresponding to the target sound as a tracking target,

A voice control command is determined based on the sound of the tracking target.
The method of claim 4, wherein the method further comprises:

And extracting, according to the voice control information, a feature parameter of the voice control information, where the feature parameter includes: a sound amplitude and a sound arrival time;

Determining a current location of the tracking target according to the feature parameter;

And according to the current position of the tracking target, the projection direction of the motion projection device is automatically adjusted such that the projection direction of the motion projection device faces the tracking target.
The method according to claim 5, wherein the automatically adjusting the projection direction of the moving projection device in real time according to the projection direction adjustment command comprises:

After automatically adjusting the projection direction of the motion projection device, if the user still cannot completely face the projection screen, the user's projection direction adjustment command is received, and the projection direction of the motion projection device is accurately adjusted according to the projection direction adjustment command.
The method according to claim 6, wherein the projection direction adjustment instruction comprises: a direction adjustment instruction and an angle adjustment instruction, the method comprising:

The direction adjustment instruction corresponds to direction adjustment information, and the angle adjustment instruction corresponds to angle adjustment information;

Determining an adjustment direction of a projection direction of the moving projection device according to the direction adjustment information;

The projection direction of the moving projection device is adjusted in conjunction with the angle adjustment information.
The method according to claim 7, wherein the moving projection device comprises a pre-stored database, and the adjusting the projection content of the moving projection device according to the content search selection instruction comprises: pushing the movement according to the content search selection instruction The corresponding projected content in the database pre-stored by the projection device is displayed; and/or the Internet-related content is searched for projection display.
The method of claim 8, wherein the content search selection instruction comprises: a first retrieval instruction and a secondary retrieval instruction; the method comprising:

The initial retrieval instruction corresponds to initial retrieval information, and the secondary retrieval instruction corresponds to secondary retrieval information;

When the initial search is performed, if the content search selection information corresponds to a plurality of contents of the database or the Internet pre-stored by the projection device, the content of the desired projection display is further determined by the secondary search information.
The method according to claim 9, wherein the pre-stored database comprises a plurality of voice libraries, and the plurality of different voice libraries respectively correspond to different projection contents, the method further comprising:

Determining a target sound according to the environmental voice information;

Extracting target sound feature information, and determining a voice library corresponding to the target sound,

Determining the projection content according to the speech library corresponding to the target sound, and projecting the projection content.
A motion projection device, characterized in that the device comprises:

a voice collection module, configured to collect environmental voice information;

a voice processing module, configured to extract voice control information according to the ambient voice information;

a voice recognition module, configured to identify the voice control information, and generate a voice control instruction;

a control module, configured to control the motion projection device according to the voice control instruction;

a motion projection module, the motion projection module includes: a projection module and a motion driving device for changing a projection direction of the motion projection module;

a voice positioning module, configured to locate and analyze a current location data of the user according to the voice control information;

a storage module, configured to establish a database pre-stored by the moving projection device;

The wireless transmission module is configured to search for relevant projection content through the network according to the voice control instruction, and perform wireless transmission projection display.
A motion projection system, characterized in that the system comprises:

The motion projection device of claim 11;

At least one processor; and,

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of any of claims 1-10 method.