CN113238440A

CN113238440A - Operation guiding method and system based on wide screen splicing and readable storage medium

Info

Publication number: CN113238440A
Application number: CN202110337662.8A
Authority: CN
Inventors: 李志�; 金凌琳; 林锦发
Original assignee: Shenzhen Dangzhi Technology Co ltd
Current assignee: Shenzhen Dangzhi Technology Co ltd
Priority date: 2020-11-16
Filing date: 2020-11-16
Publication date: 2021-08-10
Anticipated expiration: 2040-11-16
Also published as: CN112104852A; CN112104852B; CN113238440B

Abstract

The application discloses an operation guiding method and system based on wide-screen splicing and a computer readable storage medium, wherein the method comprises the steps that after a wide-screen projection system is started and two optical machines carry out projection focusing, if it is detected that a user triggers projection calibration through a setting interface or through voice information, the two optical machines are controlled to project projection surfaces in the shooting direction of a camera, and calibration images are projected and spliced respectively; shooting an acquired image of the spliced calibration image based on the camera, and determining the position relationship of the two spliced calibration images; generating and outputting an operation guide of the optical machine according to the position relation; after the two spliced calibration images are spliced seamlessly, the two optical machines carry out trapezoidal correction and projection size correction; and finally, controlling the two optical machines to respectively project the images to be displayed on the projection surface. The problem that the upper and lower black borders of the projection of the wide-screen projection system are large and the projection area of the actual display image is small is avoided, and the integral effect of the effective projection picture of the wide-screen projection system is improved.

Description

Operation guiding method and system based on wide screen splicing and readable storage medium

Technical Field

The application relates to the technical field of projection display, in particular to an operation guidance method and system based on wide screen splicing and a computer readable storage medium.

Background

With the development of science and technology, projection equipment is increasingly popularized in offices, multifunctional meeting rooms and home theaters, at present, projection equipment or a projection system generally uses a single optical machine to output a single optical path for projection, and in the projection direction, the projection area is limited by the projection distance, the physical imaging characteristics of the optical machine, trapezoidal correction of images and the like.

When the projection device or the projection system is in side projection, the actually displayed projection picture is scaled down and corrected due to the influence of the picture trapezoidal correction factor, so that the appearance is weakened, and the larger the side projection angle is, the smaller the projection area of the actually displayed image is. Particularly, when the projection displays a large-width image, the actual display projection picture can only be scaled down under the condition of keeping a high width and a high proportion, which is reflected in that the upper black edge and the lower black edge of the projection are very large, the projection area of the actual display image is small, and the overall effect of the effective projection picture is poor.

The above is only for the purpose of assisting understanding of the technical solutions of the present application, and does not represent an admission that the above is prior art.

Disclosure of Invention

The embodiment of the application mainly aims to provide an operation guidance method and system based on wide screen splicing and a computer readable storage medium, and aims to solve the technical problems that the actual display image projection area of conventional projection equipment or systems is small, and the overall effect of effective projection pictures is poor.

In order to achieve the above object, an embodiment of the present application provides an operation guidance method based on wide-screen stitching, where the operation guidance method based on wide-screen stitching is applied to a wide-screen projection system, the wide-screen projection system includes two optical machines and a camera arranged on the same plane, and the camera is arranged between the two optical machines;

the operation guiding method based on the wide-screen splicing comprises the following steps:

after the wide-screen projection system is started and the two optical machines carry out projection focusing, analyzing a setting interface of projection display or a microphone at the optical machines to collect voice information input by a user in real time;

if the fact that a user triggers projection calibration through a setting interface of projection display or through voice information is detected, controlling two optical machines to project and splice calibration images to projection surfaces in the shooting direction of a camera;

shooting an acquired image of the spliced calibration image based on the camera, and determining the position relationship of the two spliced calibration images;

generating and outputting operation guide of the optical machines according to the position relation, so that a user can adjust the projection included angle of the two optical machines based on the operation guide until the two spliced calibration images are spliced seamlessly;

after the two splicing calibration images are spliced seamlessly, trapezoidal correction and projection size correction are respectively carried out on the two splicing calibration images until the sizes of the left and right splicing calibration images are consistent, and the process keeps seamless splicing of the two splicing calibration images;

after the projection trapezoid correction and the projection size correction are carried out, two optical machines are controlled to project images to be displayed to a projection surface respectively, and the two images to be displayed are obtained by cutting an original image; the final two projection images are combined into the original image.

Optionally, the step of determining a positional relationship between the two stitched calibration images based on the captured images of the stitched calibration images captured by the camera includes:

carrying out characteristic analysis on collected images of spliced calibration images shot by a camera, and detecting whether an overlapping area exists between the two spliced calibration images;

if the two spliced calibration images have an overlapping area, the position relation is intersection;

if the two spliced calibration images do not have an overlapping area and the two spliced calibration images have an area which does not belong to the two calibration images, the position relationship is a phase difference;

and if the intersection or the phase separation phenomenon does not occur, judging that the two spliced calibration images are tangent at the moment.

Optionally, the step of generating and outputting the operation guide of the optical machine according to the position relationship includes:

if the position relations are separated, generating a first operation guide for reducing the included angle of the light emitting directions of the two optical machines;

and if the position relations are intersected, generating a second operation guide for increasing the included angle of the light emitting directions of the two optical machines.

Optionally, the operation guidance method based on widescreen stitching further includes:

after the first operation guide is detected to be output, if the included angle is increased, outputting a direction adjustment error prompt;

and after the second operation guide is detected to be output, if the included angle is reduced, outputting a direction adjustment error prompt.

Optionally, after the step of generating and outputting the operation guide of the optical machine according to the position relationship, the method includes:

judging whether the two opposite longitudinal boundaries of the spliced calibration image are tangent or not based on a boundary identification algorithm;

and if the two longitudinal boundaries are tangent, judging that the two spliced calibration images are spliced seamlessly, and outputting a successful splicing prompt.

the wide-screen projection system also comprises a focusing motor, and the focusing motor is arranged at the lens of the optical machine; before the two optical machines of the wide-screen projection system perform projection focusing, the two optical machines are controlled to project a focal length calibration image to the projection surface;

and controlling a focusing motor to adjust the focal lengths of the two optical machines based on the definition of a focal length calibration image dynamically acquired by the camera until the definition reaches a preset definition threshold value.

after seamless splicing and respective trapezoidal correction of the two spliced calibration images are detected, size correction of the spliced calibration images at two sides is carried out, and size correction operation of the spliced calibration images is divided into two steps of longitudinal alignment and transverse alignment;

the longitudinally aligning step includes: and dividing the projection plane into two transverse areas by using the projection splicing line vertical bisector of the two spliced calibration images, wherein the splicing calibration image point far away from the vertical bisector in each transverse area moves to the plane where the splicing calibration image transverse boundary is located on the same side close to the vertical bisector until the transverse boundary end points of the two spliced calibration images in each transverse area are overlapped.

The laterally aligning step includes: and taking the projection splicing line of the two spliced calibration images as a central line, wherein the two spliced calibration images respectively have a correction longitudinal edge which is parallel to the central line but not overlapped with the central line. The correction longitudinal edge far away from the central line translates towards the direction close to the central line until the distances from the two correction longitudinal edges to the central line are equal.

Optionally, after the voice information input by the user is collected in real time by a microphone at the optical machine or the setting interface based on the projection display, the method further includes:

if the voice information contains a key word for canceling the wide-screen projection, detecting the current projection brightness requirement of the wide-screen projection system;

if the current projection brightness requirement is larger than or equal to a preset brightness threshold value, controlling the two optical machines to project splicing calibration images to the area, perpendicular to the projection surface, in the shooting direction of the camera until the two splicing calibration images are completely overlapped;

and performing trapezoidal correction on the two optical machines, and controlling the two optical machines to project the same image to be displayed to the projection surface.

In order to achieve the above object, the present application further provides a wide-screen projection system, where the wide-screen projection system includes two optical machines and a camera arranged on the same plane, a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the camera is arranged between the two optical machines, and the computer program is executed by the processor to implement the steps of the operation guidance method based on the wide-screen stitching.

In order to achieve the above object, the present application further provides a readable storage medium, which stores a computer program, and the computer program, when executed by a processor, implements the steps of the operation guidance method based on widescreen stitching.

In the embodiment of the application, the wide-screen projection is realized by setting two optical machines, after a user is measured through a setting interface of projection display or through voice information (including preset awakening words), the two optical machines are controlled to respectively perform projection focusing, a splicing calibration image is projected to a projection surface, and operation guide of the optical machines is generated and output according to the position relation of the splicing calibration image dynamically acquired by a camera, so that the user can adjust the projection angle of the optical machines based on the operation guide until the two splicing calibration images are seamlessly spliced; after the splicing operation is finished, performing trapezoidal correction and projection size correction on the two spliced calibration images respectively; and finally, controlling the two optical machines to project the image to be displayed on the projection surface, cutting the image to be displayed to form a left image A to be displayed and a right image B to be displayed, and then respectively and simultaneously displaying the left image and the right image by the two optical machines, so that the two optical machines jointly output the projection picture output by the single optical machine in the conventional scheme, the amplitude of the equal-scale reduction of the actual projection picture when the single optical machine system displays the wide-screen image is reduced, the problems of large upper and lower black edges and small projection area of the actual display image during full-screen projection are avoided, and the integral effect of the effective projection picture of the wide-screen projection system is improved.

Drawings

FIG. 1 is a schematic view of a wide-screen projection system according to the present application;

FIG. 2 is a schematic view of another embodiment of a wide screen projection system according to the present invention;

FIG. 3 is a schematic view of a scene with two projector projection angles P in the present application;

FIG. 4 is a schematic view of the orientation and reference line layout of one embodiment of a projection screen in a widescreen projection system according to the present application;

FIG. 5 is a schematic flowchart of an embodiment of an operation guidance method based on widescreen stitching according to the present application;

FIG. 6 is a schematic flowchart of another embodiment of an operation guidance method based on widescreen stitching according to the present application;

FIG. 7 is a scene schematic diagram of a splitting projection and a synthesizing projection of an original image in the present application;

FIG. 8 is a schematic view of a scene of longitudinal alignment in the size correction of the stitching calibration image according to the present application;

fig. 9 is a schematic view of a scene of lateral alignment in the size correction of the stitching calibration image in the present application.

The reference numbers illustrate:

reference numerals	Name (R)	Reference numerals	Name (R)
				1	Optical machine	2	Camera head
3	Circuit board	4	Base seat
				5	Image processing chip	6	Optical machine driving chip
71	The first motor	72	First mounting table
				73	Second mounting table	711	Driving gear
P	Included angle	8	Projection screen
				91	Second motor	92	Horizontal rotating shaft
10	Focusing motor

The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that all the directional indications (such as up, down, left, right, front, and rear … …) in the embodiment of the present application are only used to explain the relative position relationship between the components, the movement situation, and the like in a specific posture (as shown in the drawing), and if the specific posture is changed, the directional indication is changed accordingly.

In this application, unless expressly stated or limited otherwise, the terms "connected," "secured," and the like are to be construed broadly, and for example, "secured" may be a fixed connection, a removable connection, or an integral part; can be mechanically or electrically connected; they may be directly connected or indirectly connected through intervening media, or they may be connected internally or in any other suitable relationship, unless expressly stated otherwise. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.

In addition, descriptions in this application as to "first", "second", etc. are for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicit to the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present application.

In an embodiment of the present application, referring to fig. 1 and 2, a wide-screen projection system includes: the optical-mechanical device comprises two optical-mechanical devices 1, a camera 2, a circuit board 3 and a base 4, wherein the optical-mechanical devices 1 are arranged on the base 4 at intervals, a driving assembly for driving the optical-mechanical devices 1 to rotate is arranged on the base 4, the camera 2 is arranged on the base 4 between the two optical-mechanical devices 1, the camera 2 is used for collecting various calibration images output by the optical-mechanical devices 1, and the calibration images comprise splicing calibration images and focal length calibration images; the models of the two optical machines 1 are generally the same, that is, the projection optical parameters of the two optical machines 1 are basically the same, the base 4 mainly plays a role in installation and support, the optical machines 1 are movably installed on the base 4 at intervals, the optical machines 1 are driven by the driving assembly to rotate on the plane where the base 4 is located, the light emitting direction of the optical machines 1 is adjusted, and therefore the projection area position of the optical machines 1 on the projection screen 8 is adjusted. The camera 2 is mainly used for collecting image content projected to the projection screen 8 by the optical machine 1, the image content can be a calibration image for projection calibration of the optical machine 1, and can also be a projection picture generated by cutting a to-be-displayed image projected by the optical machine 1, generally speaking, in order to facilitate the camera 2 to accurately collect the image content, the camera 2 is arranged on the base 4 between the two optical machines 1, thereby reducing horizontal offset of the image content projected by the optical machine 1 as much as possible, improving accuracy of the image content collected by the camera 2, and further improving accuracy of data analysis of the image processing chip 5 and the optical machine driving chip 6.

Referring to fig. 2, a processor is arranged on the circuit board 3, and the processor comprises an image processing chip 5 and an optical drive chip 6 which are in communication connection with each other; the image processing chip 5 is in communication connection with the optical machine 1, and controls the optical machine 1 to output splicing calibration images respectively by receiving image data and logic control signals of the image processing chip 5; the image processing chip 5 is respectively in communication connection with the optical machine driving chip 6, the driving assembly and the camera, so that the driving assembly is controlled to adjust an included angle P formed by the light emitting directions of the two optical machines 1 based on the splicing calibration images acquired by the camera 2, and the adjacent boundaries of the two splicing calibration images are connected; after the two splicing calibration images are connected, the optical-mechanical driving chip 6 informs the image processing chip 5 to control the optical-mechanical 1 to output respective projection images, wherein the projection images are obtained by proportionally splitting the images to be displayed by the image processing chip 5 according to the width proportion of the splicing calibration images.

The circuit board 3 is generally disposed on the base 4 and spaced from the optical machine 1, that is, the circuit board 3 is disposed above one side of the base 4 where the optical machine 1 is mounted, a bracket can be disposed between the circuit board 3 and the base 4, the circuit board 3 is fixedly connected with the bracket, and the height of the bracket is greater than that of the optical machine 1, so that the circuit board 3 and the optical machine 1 are disposed at intervals. Optionally, because ray apparatus 1 power is great, and the heat production is more, and the heat dissipation problem is outstanding, can set up the fin in circuit board 3 towards ray apparatus 1 one side, and the radiating fin one end is connected circuit board 3, one end and is connected ray apparatus 1 radiating piece or neighbouring ray apparatus 1 louvre to effectively utilize the region between circuit board 3 and the ray apparatus 1, increase heat radiating area improves the radiating efficiency of ray apparatus 1.

The image processing chip 5 and the optical engine driving chip 6 are both solid chips installed on the circuit board 3, and the image processing chip 5 is mainly used for controlling the optical engine 1 to output images, splitting the images to be displayed and controlling the optical engine 1 to respectively display the split images. The optical machine driving chip 6 is mainly used for adjusting the light emitting direction of the optical machine 1, the inclination angle of the plane where the optical machine 1 is located and the focal length of the optical machine 1, and the optical machine driving chip 6 is in communication connection with the first motor 71, the second motor 91 and the focusing motor 10.

In this embodiment, referring to fig. 3 and 4, the image processing chip 5 controls the optical machines 1 to output the splicing calibration images to project onto the projection screen 8, the camera 2 continuously collects the projected splicing calibration images, the optical machine driving chip 6 analyzes the splicing calibration images collected by the camera 2, the driving module is controlled to adjust the included angle P formed by the light emitting directions of the two optical machines 1, the adjacent boundaries (two longitudinal boundaries perpendicular to and opposite to the transverse direction of the projection screen 8) of the two splicing calibration images, when the distance between the adjacent boundaries of the two splicing calibration images is too large, the driving module is controlled to decrease the included angle P formed by the light emitting directions of the two optical machines 1, when the distance between the adjacent boundaries of the two splicing calibration images is too small, the driving module is controlled to increase the included angle P formed by the light emitting directions of the two optical machines 1 until the adjacent boundaries of the two splicing calibration images are connected, at this time, the image processing chip 5 judges the relative positions of the two mosaic calibration images based on the two mosaic calibration images acquired by the camera 2 (if trapezoidal correction is completed before the mosaic calibration, the transverse width ratio obtained by analysis is 1:1, for example, the width ratio of the mosaic calibration images output by the two optical machines 1 is 1:1, namely, the two optical machines 1 output images with equal size, if the trapezoidal correction is performed after the mosaic calibration, the left and right projection screens project single-tone pictures with different whole screens, and the mosaic calibration is performed by detecting the colors of the adjacent areas of the two projection pictures), then the image processing chip 5 controls the optical machines 1 to output the projection pictures obtained by dividing and cutting the images to be displayed according to the width ratio, so that the two optical machines 1 output the projection pictures output by a single optical machine 1 in the conventional scheme together, and the amplitude of equal-scale reduction of actual projection pictures when a single optical machine system displays wide-screen images is reduced, the problems that the upper black edge and the lower black edge are large and the actual projection area of the displayed image is small during full-screen projection are solved, and the overall effect of an effective projection picture of the wide-screen projection system is improved.

Further, in another embodiment of the wide screen projection system, the driving assembly includes a first motor 71, a first mounting stage 72 and a second mounting stage 73, the first motor 71 is in communication connection with the opto-mechanical driving chip 6, the first mounting stage 72 and the second mounting stage 73 are circular gears, the first mounting stage 72 and the second mounting stage 73 are axially and rotatably connected to the base 4 with the direction perpendicular to the base 4, two vertical rotating shafts are penetratingly arranged in the middle of the first mounting stage 72 and the second mounting stage 73, the first mounting stage 72 and the second mounting stage 73 rotate around the vertical rotating shafts, the two opto-mechanical devices 1 are respectively mounted on the sides of the first mounting stage 72 and the second mounting stage 73 away from the base 4, the opto-mechanical devices 1 can synchronously rotate along with the rotation of the first mounting stage 72 and the second mounting stage 73, the lateral outer edges of the first mounting stage 72 and the second mounting stage 73 are provided with interlocking gear teeth, that is, the first mounting stage 72 and the second mounting stage 73 are themselves circular gears, the first mounting table 72 and the second mounting table 73 are engaged with the driving gear 711 of the first motor 71, and when the light emitting direction of the optical machine 1 needs to be adjusted, the first motor 71 controls the driving gear 711 to drive the first mounting table 72 and the second mounting table 73 to rotate, so that the light emitting directions of the two optical machines 1 are adjusted, and adjacent boundaries of two spliced calibration images output by the optical machines 1 are controlled to be connected.

Preferably, the first mounting table 72 and the second mounting table 73 are gear members having the same size and are engaged with each other, and the driving gear 711 of the first motor 71 is engaged with the first mounting table 72 or the second mounting table 73. Namely, the gear teeth of the first mounting table 72 and the second mounting table 73 are meshed and linked, the driving gear 711 of the first motor 71 only needs to be meshed with any one of the first mounting table 72 or the second mounting table 73, so that the first motor 71 drives the first mounting table 72 and the second mounting table 73 to synchronously rotate, the rotating directions of the light emitting directions of the two optical machines 1 are opposite, and the rotating amplitudes of the two optical machines will be consistent, the problem that a single splicing calibration image moves too fast and too much is not easy to occur in the splicing calibration image splicing process, the width ratio of the two splicing calibration images is effectively kept unchanged, the method is particularly suitable for the splicing high-precision adjustment situation that the width ratio of the splicing calibration image of the two optical machines 1 is 1:1, and the splicing efficiency and the splicing precision of adjacent boundaries of the splicing calibration image are improved. Certainly, the number of the first motors 71 can be two according to needs, the two first motors 71 respectively and independently drive the first mounting table 72 and the second mounting table 73 (at this time, the two mounting tables are separated), that is, the projection angles of the two optical machines can be independently adjusted, for some high-precision projection scenes with special requirements, a user needs to independently adjust the projection angles of the two optical machines 1, and the multi-scene projection requirements of the wide-screen projection system are met.

Optionally, the camera 2 is disposed on an angular bisector of an included angle P formed between the light emitting directions of the two optical machines 1, the wide-screen projection system further includes a projection screen 8 (i.e., a projection plane or a projection plane curtain) located in the light emitting directions of the two optical machines 1, and the lighting direction of the camera 2 is perpendicular to the projection screen 8. Camera 2 sets up on the angular bisector, camera 2's daylighting direction can be parallel with the angular bisector or coincide, and wide screen projection system's projection screen 8 sets up the dead ahead at camera 2, does not shelter from between camera 2 and the projection screen 8, thereby camera 2's light-emitting direction is perpendicular with projection screen 8, the lateral deviation can reduce as far as possible to the projected image on camera 2 gathers projection screen 8, improve camera 2 and gather the precision of concatenation calibration image, further promote the concatenation efficiency and the concatenation precision on the adjacent border of concatenation calibration image. In addition, under the structure that the projection angles of the two optical machines 1 are independently adjusted, the camera 2 is disposed at the midpoint between the two optical machines 1.

Further, in another embodiment of the wide-screen projection system, the wide-screen projection system further includes a physical horizontal angle calibration, which includes a second motor 91 and a horizontal rotating shaft 92, the second motor 91 is in communication connection with the optical engine driving chip 6, the horizontal rotating shaft 92 is fixedly connected with the base 4, the second motor 91 drives the horizontal rotating shaft 92 to rotate, so as to drive the base 4 to rotate along with the horizontal rotating shaft 92, a fixedly connected portion of the horizontal rotating shaft 92 and the base 4 can be a plate-shaped member, the plate-shaped member can be fixedly connected with a side of the base 4 away from the optical engine 1, because there is no rotating space between the base 4 and the plate-shaped member, the plate-shaped member and the base 4 will not move relatively, so that the second motor 91 drives the horizontal rotating shaft 92 to drive the base 4 to rotate more accurately, and therefore, when the base 4 where the optical engine 1 is located is placed on an inclined supporting surface, or the base 4 itself is not horizontal, or the base 4 is placed irregularly, resulting in the base 4 being tilted and thus in the light exit direction of the light engine 1 being tilted instead of horizontal. Therefore, after the adjacent boundaries of the calibration picture are connected, the second motor 91 drives the horizontal rotating shaft 92 to rotate so as to drive the base 4 to rotate, the image processing chip 5 controls the optical machine to output horizontal calibration images respectively, the optical machine driving chip 6 analyzes the horizontal calibration images acquired by the camera 2 synchronously, when the horizontal calibration image level is judged, namely, the plane included angle P of the planes where the two optical machines 1 are located is adjusted to be 0 degree, the planes where the two optical machines 1 are located are in a horizontal state, the second motor 91 is controlled to stop rotating, and therefore the projection of the optical machine 1 is ensured to meet the horizontal requirement. In addition, wide screen projection system still includes the gyroscope sensor that sets up on base 4, and ray apparatus drive chip 6 controls horizontal pivot 92 to rotate based on the data acquisition of gyroscope sensor to adjust two ray apparatus 1 place planes to the horizontality.

Optionally, horizontal rotating shaft 92 sets up in the one side that base 4 deviates from ray apparatus 1, the axial of horizontal rotating shaft 92 is parallel with the daylighting direction of camera 2, because the axial of horizontal rotating shaft 92 is unanimous in the daylighting direction of camera 2, then the axial perpendicular to projection screen 8 of horizontal rotating shaft 92, in the rotation process of horizontal rotating shaft 92, ensure that the turned angle of two ray apparatus 1 is unanimous, ensure that the light-emitting direction contained angle P of two ray apparatus 1 is unchangeable, when promoting wide-screen projection system's effective projection picture wholeness effect, avoid effective projection picture to appear the side to move. In addition, the preferred level of flattening of installation face of first mount table 72 and second mount table 73 is, and two ray apparatus 1 are in same horizontal plane to when horizontal rotating shaft 92 drove base 4 and rotates, two ray apparatus 1 are unanimous along with pivoted turned angle, have reduced the adjustment degree of difficulty that ray apparatus 1 adjusted to the horizontal plane, have further promoted the debugging efficiency before carrying out effective projection.

Further, referring to fig. 3 and 4, a reference mark is arranged on the side of the projection screen 8 facing the camera 2, the reference mark comprises a horizontal reference line, a vertical reference line and a splicing boundary reference line, the extension direction of the horizontal width of the horizontal calibration image should be parallel to the horizontal reference line, the extension direction of the longitudinal width of each type of calibration image (horizontal, splicing and focus calibration images) should be parallel to the vertical reference line, the projection splicing line when the adjacent boundaries of the two splicing calibration images are connected should coincide with the splicing boundary reference line, therefore, the reference mark can assist the optical-mechanical drive chip 6 in judging whether splicing of the spliced calibration images is completed or not and whether the plane where the optical-mechanical 1 is located (namely the horizontal calibration image) is located at the horizontal plane or not, and compared with the optical-mechanical drive chip 6 which is only analyzed according to the acquired image data of the camera 2, the calculation amount is less and the calculation efficiency is higher. The reference line of the splicing boundary is the projection splicing line in the claims and the specification of the application.

Optionally, the wide-screen projection system further includes a focusing motor 10, the focusing motor is in communication connection with the optical engine driving chip 6, and the focusing motor 10 is disposed at the lens of the optical engine 1 to adjust the focal length of the optical engine 1. Therefore, after the splicing calibration image is spliced and the plane of the optical machine 1 is horizontally calibrated (the horizontal calibration image is horizontal), the image processing chip 5 can control the optical machine 1 to respectively project two focal length calibration images, and control the respective focusing motors 10 of the two optical machines 1 to respectively adjust the focal lengths of the two optical machines 1, so that a clear projection effect is obtained. Finally, the image processing chip 5 cuts the image to be displayed in proportion according to the width proportion of the two projection areas after the trapezoidal correction, and then sends the image to the respective optical machines 1 for projection display.

The application also provides an operation guide method based on the wide-screen splicing, the screen projection method is applied to a wide-screen projection system, the wide-screen projection system comprises two optical machines and a camera which are arranged on the same plane, the camera is arranged between the two optical machines, and referring to fig. 5, the operation guide method based on the wide-screen splicing comprises the following steps:

step S10, after the wide screen projection system is started and the two optical machines carry out projection focusing, analyzing a setting interface of projection display or a microphone at the optical machines to collect voice information input by a user in real time;

the wide-screen projection system further comprises a microphone and a sound box, wherein the microphone is used for collecting voice of a user, the sound box can be used for playing various operation guides and various prompts, and the microphone and the sound box can be arranged in the position of the optical machine accessory.

When the power-on of an optical machine and a camera of the wide-screen projection system is detected, the fact that a user needs to use the wide-screen projection system is indicated, a setting interface is synchronously projected and displayed, a microphone and a sound box are started, the microphone collects the speaking voice of the user in real time, namely, the voice information input by the user is collected in real time, and the setting interface is used for the user to operate so as to carry out splicing calibration

Step S20, if detecting that the user triggers the projection calibration through the setting interface of the projection display or through the voice information (including the preset awakening words), controlling the two optical machines to project and splice the calibration images to the projection surfaces of the camera shooting direction;

the method comprises the steps of identifying voice information input by a user, obtaining voice keywords in the voice information, comparing the voice keywords with preset awakening words, wherein the preset awakening words can comprise starting, projecting, electrifying and the like, and triggering projection calibration if the voice information comprises the preset awakening words. Or, the user operates the setting interface based on a remote control or a key of the projection system to trigger the projection calibration of the projection system. The projection plane is arranged in the shooting direction of the camera.

The wide-screen projection system can comprise two optical machines, a camera, a circuit board and a base, wherein the two optical machines and the camera are arranged on the base and located on the same plane, the two optical machines are arranged on the base at intervals, a driving assembly for driving the optical machines to rotate to adjust the projection angle is arranged on the base, and the camera is arranged on the base between the two optical machines to collect various calibration images output by the optical machines. The circuit board is provided with a processor, and the processor comprises an image processing chip and an optical machine driving chip which are in communication connection with each other.

The projection plane can be for setting up curtain or the projection screen in camera shooting direction, and the projection plane is preferred to be perpendicular with camera shooting direction, and wherein camera shooting direction can be the income light direction of camera, and the camera is just to the projection plane, avoids because the camera deflects and leads to gathering the image deformation on the projection plane, need not to rectify the image that the camera was gathered, and then improves the collection efficiency and the collection precision of the image on the camera was gathered the projection plane.

Wherein, the calibration image can be including concatenation calibration image and focus calibration image, and the contained angle and two ray apparatus projection angle adjustment of two ray apparatus light-emitting directions are exclusively used in to concatenation calibration image, and focus calibration image is exclusively used in the adjustment of ray apparatus focus.

When the wide-screen projection system is powered on and started or reset, the optical machine driving chip can firstly control the light emitting directions of the two optical machines to be restored to the preset initial direction, the image processing chip then controls the two optical machines to respectively shoot the projection surfaces in the direction towards the camera, the spliced calibration image is projected, and the color difference of the two longitudinal boundaries relative to the spliced calibration image is large, so that the boundary identification is facilitated.

Step S30, shooting the collected images of the spliced calibration images based on the camera, and determining the position relation of the two spliced calibration images;

the camera dynamically collects splicing calibration images projected by the optical machine in real time, and the image processing chip carries out boundary recognition and distance analysis on the splicing calibration images collected dynamically in real time.

Under the condition of making trapezoid correction, two opposite longitudinal boundaries of the two spliced calibration images can be identified firstly, and then the distance between the two longitudinal boundaries is analyzed and calculated, wherein the distance between the two longitudinal boundaries is larger than 0, and the backgrounds of the two spliced calibration images are not overlapped, which indicates that no overlapping area exists between the two spliced calibration images; the distance between the two longitudinal boundaries is less than 0 and the backgrounds of the two stitched calibration images coincide, indicating that there is an overlapping region between the two stitched calibration images. One point of a longitudinal edge of a projection plane can be used as a zero point of a transverse coordinate axis, the distance between two longitudinal boundaries is equal to the difference between the abscissas of the two longitudinal boundaries on the transverse coordinate axis, specifically, the difference is equal to the difference between the abscissa of the longitudinal boundary far away from the zero point (hereinafter referred to as far coordinate) and the abscissa of the longitudinal boundary near to the spliced calibration image (hereinafter referred to as near coordinate), wherein the distance is a negative value, which indicates that the far coordinate is closer to the zero point of the transverse coordinate axis relative to the near coordinate, and then the existence of an overlapping region in the two spliced calibration images is judged.

Under the condition that trapezoidal correction is not carried out, the projection background 8 is white, one optical machine projects cyan preset by the whole screen, the other optical machine projects yellow preset by the whole screen, then the camera collects projection images, and if green colors close to preset values are identified in the middle area of the collected images, intersection is judged.

If there is no overlapping area between the two stitched calibration images and there is an area of the two stitched calibration images that does not belong to the two calibration images, the positional relationship is a phase separation. For example, when the projection background is white, one optical machine projects a preset cyan color on the whole screen, the other optical machine projects a preset yellow color on the whole screen, and then the camera collects the projection image, and if the non-green color is recognized in the middle area of the collected image, the positional relationship is a phase difference.

If no intersection or phase separation occurs, the two projections are tangent at this time.

Optionally, referring to fig. 6, step S30 specifically includes:

step S31, carrying out characteristic analysis on the collected images of the spliced calibration images shot by the camera, and detecting whether the two spliced calibration images have an overlapping area;

step S32, if the two spliced calibration images have an overlapping area, the position relationship is intersection; if the two spliced calibration images do not have an overlapping area and the two spliced calibration images have an area which does not belong to the two calibration images, the position relationship is a phase difference; and if the intersection or the phase separation phenomenon does not occur, judging that the two spliced calibration images are tangent.

For example, when the projection background is white, one optical machine projects a cyan color (one mosaic calibration image is cyan) preset in the whole screen, the other optical machine projects a yellow color (one mosaic calibration image is yellow) preset in the whole screen, then the camera collects the projection image, and if a green color with a similar preset value is identified in the middle area (the similar part of the two mosaic calibration images) of the collected images, intersection is determined.

For example, when the projection background is white, one optical machine projects a preset cyan color (one mosaic calibration image is cyan) on the whole screen, the other optical machine projects a preset yellow color (one mosaic calibration image is yellow), the camera captures the projection image, and if the non-green color is recognized in the middle area (the close part of the two mosaic calibration images) of the captured image, the positional relationship is separated.

The method comprises the steps of carrying out analysis on spliced calibration images in a mode that the distance between the two longitudinal boundaries is equal to the difference value of the abscissa of the two longitudinal boundaries and the abscissa of the transverse coordinate axis, judging whether the two spliced calibration images have an overlapping region conveniently, judging that the position relation is crossed when the two spliced calibration images have the overlapping region, judging that the two spliced calibration images have the overlapping region and the difference value is not 0, and judging that the position relation is separated.

And step S40, generating and outputting operation guide of the optical machines according to the position relation, so that a user can adjust the projection included angle of the two optical machines based on the operation guide until the two spliced calibration images are spliced seamlessly.

Generally speaking, the two stitching calibration images are mostly in a separated state, even if the two stitching calibration images are in an intersected state, the intersected state of the two stitching calibration images can be quickly judged through image analysis, generally, the colors of the two stitching calibration images are different, for example, one red and one blue are different, when a fourth color except for the colors of the red, the blue and the projection plane is detected, the two stitching calibration images are judged to be in the intersected state, a second operation guide for increasing the light-emitting direction included angle (namely the projection included angle) of the two optical machines is generated and output, the second operation guide can be used for outputting and guiding a user to quickly increase the projection angle of the two optical machines through voice until the fourth color is eliminated, the two longitudinal boundaries are overlapped, and the two stitching calibration images are seamlessly stitched.

Therefore, when the two spliced calibration images are in a phase separation state, the larger the distance between the two spliced calibration images and two longitudinal boundaries is, the larger the included angle formed by the light emitting directions of the two optical machines is, the included angle needs to be reduced, and then when the position relation is judged to be the phase separation, the first operation guide for reducing the included angle between the light emitting directions of the two optical machines is generated and output, the first operation guide can be used for outputting voice to guide a user to adjust at least one optical machine to rotate towards the direction close to the camera so as to adjust the projection angle of at least one optical machine, wherein the distance is positively correlated with the adjustment speed of the projection angle of the optical machines, namely when the distance is larger, the included angle formed by the light emitting directions of the two optical machines is larger, and the first operation guide can guide the user to adjust the projection angle of the optical machines at a larger rotation speed. In the process of continuously adjusting the projection angle of the optical machine, the processor continuously detects the distance between the two relative longitudinal boundaries of the two spliced calibration images based on the camera, and when the distance is 0, the two relative longitudinal boundaries of the two spliced calibration images are overlapped, so that the adjustment of the projection angle of the optical machine is finished. The first operation guide and the second operation guide can be physical buttons for guiding a user to press and adjust the included angle of the light emitting direction of the optical machine, the moving direction of the whole optical machine and the like.

Step S50, after the two spliced calibration images are spliced seamlessly, the two spliced calibration images are respectively subjected to trapezoidal correction and projection size correction until the sizes of the left spliced calibration image and the right spliced calibration image are consistent, and the process keeps seamless splicing of the two spliced calibration images;

after determining that the relative longitudinal boundaries of the spliced calibration images projected by the two optical machines are overlapped, the optical machine driving chip can control the two optical machines to output at least one frame of picture frame of the image to be displayed to the projection surface, and trapezoidal correction is respectively carried out on the two optical machines. Optionally, before the optical machine performs trapezoidal correction, the image processing chip performs trapezoidal correction on the optical machine a with a smaller projected picture frame to obtain a smaller trapezoidal correction image, a longitudinal boundary of the smaller trapezoidal correction image close to the other optical machine side is taken as a symmetry axis, a symmetric mapping region of the smaller trapezoidal correction image mapped by the symmetry axis is obtained, and according to a rectangular vertex coordinate of the symmetric mapping region, the larger picture frame projected by the optical machine B is subjected to trapezoidal correction to obtain another trapezoidal correction image with the same size as the smaller trapezoidal correction image. The image to be displayed is formal content projected by a wide-screen projection system required by a user, such as PPT, a movie, a television program and the like required by the user.

The size correction operation of the spliced calibration image is divided into two steps of longitudinal alignment and transverse alignment, and the size correction of the spliced calibration image is to ensure that the sizes of the left projection image display picture and the right projection image display picture of the optical machine are equal; the size correction of the two stitched calibration images includes a longitudinal alignment correction and a lateral alignment correction.

Step S60, after the projection trapezoid is corrected and the projection size is corrected, controlling two optical machines to project images to be displayed to the projection surface respectively, wherein the two images to be displayed are obtained by cutting an original image; the final two projection images are combined into the original image. Wherein the projection keystone correction comprises: firstly, trapezoidal correction is carried out on the optical machine A with a smaller projected picture frame to obtain a smaller trapezoidal correction image, a longitudinal boundary of the smaller trapezoidal correction image close to the other optical machine B side is taken as a symmetry axis, a symmetric mapping area of the smaller trapezoidal correction image mapped by the symmetry axis is obtained, trapezoidal correction is carried out on the larger picture frame projected by the optical machine B according to a rectangular vertex coordinate of the symmetric mapping area, so that another trapezoidal correction image with the same size as the smaller trapezoidal correction image is obtained, and the two trapezoidal correction images are spliced seamlessly.

As shown in fig. 7, the original image is a complete M image on the left side in fig. 7, the original image is subjected to picture splitting to obtain two images to be displayed (e.g., two split M sub-images at the upper and lower parts in the middle of fig. 7), the two optical machines of the projection system respectively project the two images to be displayed, and finally the projection images of the two optical machines are synthesized into the original image (e.g., a complete M image on the right side in fig. 7) to be displayed on the projection surface.

In this embodiment, the wide-screen projection is realized by setting two optical machines, and after a user measures a setting interface displayed by projection or voice information (including a preset awakening word), the two optical machines are controlled to respectively perform projection focusing, a splicing calibration image is projected onto a projection plane, and an operation guide of the optical machines is generated and output according to a position relationship of the splicing calibration image dynamically acquired by a camera, so that the user can adjust a projection angle of the optical machines based on the operation guide until the two splicing calibration images are seamlessly spliced; after the splicing operation is finished, performing trapezoidal correction and projection size correction on the two spliced calibration images respectively; and finally, controlling the two optical machines to project the image to be displayed on the projection surface, cutting the image to be displayed to form a left image A to be displayed and a right image B to be displayed, and then respectively and simultaneously displaying the left image and the right image by the two optical machines, so that the two optical machines jointly output the projection picture output by the single optical machine in the conventional scheme, the amplitude of the equal-scale reduction of the actual projection picture when the single optical machine system displays the wide-screen image is reduced, the problems of large upper and lower black edges and small projection area of the actual display image during full-screen projection are avoided, and the integral effect of the effective projection picture of the wide-screen projection system is improved.

Further, in another embodiment of the operation guidance method based on widescreen stitching according to the present application, the operation guidance method based on widescreen stitching further includes:

step A1, after detecting that the first operation guide is output, if the included angle is increased, outputting a direction adjustment error prompt;

step A2, after the output of the second operation guide is detected, if the included angle is decreased, outputting a direction adjustment error prompt.

The wide-screen projection system outputs a first operation guide to indicate that the position relation of the two spliced calibration images is separated, at the moment, the first operation guide guides a user to reduce an included angle (namely a projection included angle) of the light emitting directions of the two optical machines, if the included angle of the light emitting directions of the two optical machines is detected to be enlarged, the fact that the user can not understand or understand the error first operation guide is indicated, at the moment, the loudspeaker can output an error prompt of the adjustment direction in a voice mode to remind the user to change an adjustment strategy of the projection angle of the optical machines.

Similarly, the wide-screen projection system outputs a second operation guide to indicate that the position relationship of the two spliced calibration images is intersected, at the moment, the second operation guide guides the user to increase the included angle between the light emitting directions of the two optical machines, if the included angle between the light emitting directions of the two optical machines is detected to be reduced, the second operation guide indicates that the user can not understand or understand the error second operation guide, at the moment, the loudspeaker can output an error prompt of the adjustment direction in a voice mode to remind the user to change the adjustment strategy of the projection angle of the optical machines.

Further, after the step of generating and outputting the operation guidance of the optical engine according to the positional relationship in step S40, the method includes:

judging whether the two opposite longitudinal boundaries of the spliced calibration image are tangent or not based on a boundary identification algorithm; and if the two longitudinal boundaries are tangent, judging that the two spliced calibration images are spliced seamlessly, and outputting a successful splicing prompt.

After outputting the first operation guide or the second operation guide, guide the user to adjust the ray apparatus projection angle, in the adjustment process, the user adjusts the ray apparatus projection angle error, the suggestion of the wrong suggestion of adjustment direction is output synchronously, in addition, still based on the boundary identification algorithm, judge whether two relative vertical boundaries of concatenation calibration image are tangent, the relevant pixel of colour that does not have the plane of projection between two vertical boundaries promptly is discerned, judge two seamless concatenations of concatenation calibration image this moment, output concatenation success suggestion, in order to remind the user in time to know to adjust the ray apparatus projection angle and target in place, thereby the user in time knows two concatenation calibration images and accomplishes seamless concatenation, avoid the user to do useless work.

Optionally, the wide-screen projection system further includes a focusing motor, the focusing motor is disposed at a lens of the optical engine, and before projection focusing is performed on two optical engines of the wide-screen projection system and before step S10, the operation guidance method based on wide-screen stitching further includes:

b, controlling two optical machines to project focal length calibration images to the projection surface; and controlling a focusing motor to adjust the focal lengths of the two optical machines based on the definition of a focal length calibration image dynamically acquired by the camera until the definition reaches a preset definition threshold value.

Before the ray apparatus carries out the concatenation calibration, set up ray apparatus focus calibration flow, two ray apparatus of image processing chip control this moment are to the projection plane projection focus calibration image, and the focus of two ray apparatus of control focusing motor adjustment, and carry out the comparison to the definition and the budget definition threshold of the focus calibration image of gathering in real time through the camera, the definition when focus calibration image reaches preset definition threshold, show that the focus adjustment of two ray apparatus finishes, the ray apparatus can project clear projection picture this moment, guarantee the concatenation calibration image of the follow-up projection of ray apparatus, the definition of horizontal calibration image, be favorable to the camera to gather the calibration image of high definition, be favorable to the accurate analysis of concatenation calibration image and horizontal calibration image, the accuracy and the efficiency of image calibration have been improved.

The longitudinally aligning step includes: dividing a projection plane into two transverse areas by using the projection splicing line vertical bisector of the two spliced calibration images, wherein the splicing calibration image point far away from the vertical bisector in each transverse area moves to the plane where the splicing calibration image transverse boundary is located on the same side close to the vertical bisector until the transverse boundary end points of the two spliced calibration images in each transverse area are overlapped;

the laterally aligning step includes: and taking the projection splicing lines of the two spliced calibration images as a central line, wherein the two spliced calibration images respectively have a correction longitudinal edge which is parallel to the central line but not overlapped with the central line, and the correction longitudinal edge which is far away from the central line translates towards the direction close to the central line until the distances from the two correction longitudinal edges to the central line are equal.

step C1, after detecting the seamless splicing and the respective trapezoidal correction of the two spliced calibration images, carrying out the size correction of the two spliced calibration images, wherein the size correction operation of the spliced calibration images is divided into two steps of longitudinal alignment and transverse alignment;

the trapezoidal correction is divided into automatic trapezoidal correction and the vertex on the projection splicing line of two spliced calibration images can only be longitudinally adjusted, so that the seamless splicing effect is kept. The automatic trapezoidal correction is that the two optical machines respectively project a trapezoidal correction picture, the camera identifies vertex coordinates after collecting the trapezoidal correction picture, then the rectangular coordinates are reset according to the side where the vertex of the spliced side is located, and finally new rectangular correction coordinates are obtained, specifically, the paragraph content is refined by the technology of the step S50.

The size correction of the spliced calibration image is to ensure that the sizes of the left projection image and the right projection image of the optical machine are equal; the size correction of the two stitched calibration images includes a longitudinal alignment correction and a lateral alignment correction.

Step C2 the longitudinally aligning step includes: dividing a projection plane into two transverse areas by using the projection splicing line vertical bisector of the two spliced calibration images, wherein the splicing calibration image point far away from the vertical bisector in each transverse area moves to the plane where the splicing calibration image transverse boundary is located on the same side close to the vertical bisector until the transverse boundary end points of the two spliced calibration images in each transverse area are overlapped;

a longitudinal alignment step: and taking the projection splicing line vertical bisector of the two spliced calibration images as a reference, and moving a point far away from the vertical bisector to another point on the same side until the two projected splicing lines are overlapped. As shown in fig. 8, since L1 is larger than L2, the top side (i.e., the top transverse boundary) of the stitched calibration image projected to the left needs to be translated downward until L1 equals L2; since L3 is smaller than L4, the lower edge (lower lateral boundary) of the stitched calibration image projected to the right needs to be translated upwards until L4 equals L3.

Step C3 the step of laterally aligning includes: and taking the projection splicing lines of the two spliced calibration images as a central line, wherein the two spliced calibration images respectively have a correction longitudinal edge which is parallel to the central line but not overlapped with the central line, and the correction longitudinal edge which is far away from the central line translates towards the direction close to the central line until the distances from the two correction longitudinal edges to the central line are equal.

And (3) transverse alignment: and taking the projection splicing line of the two spliced calibration images as a central line, wherein the two projection surfaces respectively have a correction longitudinal edge which is parallel to the central line but not overlapped with the central line. The longitudinal edge far away from the central line needs to translate towards the direction of the central line until the distance of the longitudinal edge is equal to the distance of the other longitudinal edge; as shown in fig. 9 in lateral alignment, since L5 is larger than L6, the longitudinal left edge of the left projected stitched calibration image needs to be translated to the right until L5 equals L6.

In addition, after the step of collecting the voice information input by the user in real time based on the setting and the microphone at the optical machine in step S10, the method further includes:

step D1, if the voice information contains a key word for canceling the wide-screen projection, detecting the current projection brightness requirement of the wide-screen projection system;

after the voice information is detected to contain the preset awakening words, and the voice information is synchronously detected to contain the wide-screen projection keywords, the fact that the user does not need wide-screen projection currently is indicated, and the current projection brightness requirement of the wide-screen projection system is further detected.

Step D2, if the current projection brightness requirement is larger than or equal to the preset brightness threshold, controlling the two optical machines to project the spliced calibration images to the area where the shooting direction of the camera is vertical to the projection plane until the two spliced calibration images are completely overlapped;

if the current projection brightness requirement is larger than or equal to the preset brightness threshold value, it is indicated that the current ambient light of the user is bright, and brightness display needs to be enhanced, the two optical machines are controlled to project the spliced calibration images to the area where the shooting direction of the camera is perpendicular to the projection surface until the two spliced calibration images are completely overlapped, and the brightness of the projection images of the two optical machines is mutually enhanced to highlight the image to be displayed.

In addition, if the current projection brightness requirement is smaller than the preset brightness threshold, one optical machine is closed, and only one optical machine is used for projection, so that the brightness requirement of a user for projecting an image to be displayed is met, and the electric energy consumed by one optical machine is saved.

And D3, performing trapezoidal correction on the two optical machines, and controlling the two optical machines to project the same image to be displayed on the projection surface.

Specifically, the performing the keystone correction on the two optical engines and controlling the two optical engines to project the same image to be displayed onto the projection surface (as in steps S50 and D3) may include,

performing trapezoidal correction on the two optical machines to obtain the width proportion of the image after trapezoidal correction of the projection areas of the two optical machines; and cutting the image to be displayed based on the width proportion to obtain sub-images, and distributing the sub-images to respective optical machines for projection display.

In an embodiment of the present application, due to the deviation of the projection images projected by the two optical machines to the projection surface in the horizontal or vertical direction, the sizes of the projection images of the two optical machines are different, therefore, the image processing chip performs trapezoidal correction on the two optical machines, and the sizes of the images obtained after trapezoidal correction of the projection areas of the two optical machines are obtained may be different, so that trapezoidal correction and projection surface size correction are required after splicing, thereby realizing seamless splicing and wide-screen display of the image to be displayed after the trapezoidal correction, the reduction processing of the trapezoidal correction is influenced by the equal-scale reduction of the projection pictures of the two optical machines, therefore, the amplitude of the actual projection picture for reducing in equal proportion can be greatly reduced, the problems that the upper and lower black edges of the projection are large and the projection area of the actual display image is small are solved, and the overall effect of the effective projection picture of the wide-screen projection system is improved.

In addition, after detecting that the optical machine projects the image to be displayed on the projection surface, the operation guidance method based on the wide-screen splicing further comprises the following steps: detecting the similarity between images to be displayed projected by the optical machine, counting the duration of which the similarity is greater than or equal to a preset similarity threshold, if the duration is greater than the preset unit duration, outputting a prompt of whether the optical machine is turned off by the wide-screen projection system, wherein the prompt can be a voice prompt or an optical machine projection character prompt, and if the preset waiting duration after outputting the prompt of whether the optical machine is turned off is not responded, automatically turning off the optical machine; and if a shutdown instruction determined by a user or a shutdown instruction determined not to be performed is received, executing according to the user instruction. And if the similarity is smaller than the preset similarity threshold, clearing the duration of which the statistical similarity is greater than or equal to the preset similarity threshold so as to carry out statistics again. Therefore, when the optical machine projects the images which are basically the same for a long time, the duration of projecting the images which are basically the same starts to be counted, when the duration is longer than the duration of the preset unit, the fact that the user possibly sleeps in the projection process of the optical machine or the user is busy in other affairs indicates that the user possibly watches the optical machine, at the moment, in order to save electric energy and prolong the service life of the optical machine, at the moment, the wide-screen projection system outputs a prompt of whether to shut down, and a shutdown instruction or automatic shutdown can be further executed.

In order to achieve the above object, the present application further provides a readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the operation guidance method based on widescreen stitching.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the recitation of an element by the phrase "comprising an … …" does not exclude the presence of additional like elements in the process, method, article, or apparatus that comprises the element, and further, where similarly-named elements, features, or elements in different embodiments of the disclosure may have the same meaning, or may have different meanings, that particular meaning should be determined by their interpretation in the embodiment or further by context with the embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context. Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, in different orders, and may be performed alternately or at least partially with respect to other steps or sub-steps of other steps.

It should be noted that step numbers such as S10 and S20 are used herein for the purpose of more clearly and briefly describing the corresponding content, and do not constitute a substantial limitation on the sequence, and those skilled in the art may perform S20 first and then S10 in specific implementation, which should be within the scope of the present application.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An operation guiding method based on wide-screen splicing is characterized in that the operation guiding method based on wide-screen splicing is applied to a wide-screen projection system, the wide-screen projection system comprises two optical machines and a camera which are arranged on the same plane, and the camera is arranged between the two optical machines;

if the fact that a user triggers projection calibration through a setting interface of projection display or through voice information is detected, controlling two optical machines to project and splice calibration images to projection surfaces in the shooting direction of a camera; the method comprises the steps of recognizing voice information input by a user, acquiring voice keywords in the voice information, comparing the voice keywords with preset awakening words, and triggering projection calibration if the voice information comprises the preset awakening words; the projection surface is a curtain or a projection screen arranged in the shooting direction of the camera, and the projection surface is vertical to the shooting direction of the camera;

after the projection trapezoid is corrected and the projection size is corrected, controlling two optical machines to project images to be displayed to a projection surface respectively, wherein the two images to be displayed are obtained by cutting an original image; finally, synthesizing the two projection images into an original image;

wherein the projection keystone correction comprises: firstly, trapezoidal correction is carried out on the optical machine A with a smaller projected picture frame to obtain a smaller trapezoidal correction image, a longitudinal boundary of the smaller trapezoidal correction image close to the other optical machine B side is taken as a symmetry axis, a symmetric mapping area of the smaller trapezoidal correction image mapped by the symmetry axis is obtained, trapezoidal correction is carried out on the larger picture frame projected by the optical machine B according to a rectangular vertex coordinate of the symmetric mapping area, so that another trapezoidal correction image with the same size as the smaller trapezoidal correction image is obtained, and the two trapezoidal correction images are spliced seamlessly.

2. The operation guidance method based on the wide-screen stitching according to claim 1, wherein the step of determining the positional relationship between the two stitched calibration images based on the captured images of the stitched calibration images captured by the camera comprises:

and if the intersection or the phase separation phenomenon does not occur, judging that the two spliced calibration images are tangent.

3. The operation guidance method based on the wide-screen stitching according to claim 2, wherein the step of generating and outputting the operation guidance of the optical machine according to the positional relationship comprises:

4. The operation guidance method based on the wide-screen stitching according to claim 3, characterized in that the operation guidance method based on the wide-screen stitching further comprises:

5. The operation guidance method based on the wide-screen stitching according to claim 4, wherein after the step of generating and outputting the operation guidance of the optical machine according to the positional relationship, the operation guidance method comprises:

6. The operation guidance method based on the wide-screen stitching according to claim 5, characterized in that the operation guidance method based on the wide-screen stitching further comprises:

7. The operation guidance method based on the wide-screen stitching according to claim 6, characterized in that the operation guidance method based on the wide-screen stitching further comprises:

after seamless splicing and respective trapezoidal correction of the two spliced calibration images are detected, size correction of the two spliced calibration images is carried out, and size correction operation of the spliced calibration images is divided into two steps of longitudinal alignment and transverse alignment;

8. The operation guidance method based on the wide-screen stitching according to claim 7, wherein after the microphone at the optical machine collects the voice information input by the user in real time, the method further comprises:

9. A wide-screen projection system, comprising two optical machines and a camera arranged on the same plane, a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the camera is arranged between the two optical machines, and the computer program, when executed by the processor, implements the steps of the operation guidance method based on wide-screen stitching according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that a computer program is stored thereon, which, when being executed by a processor, carries out the steps of the widescreen stitching-based operation directing method according to any one of claims 1 to 8.