CN114615480A

CN114615480A - Projection picture adjusting method, projection picture adjusting device, projection picture adjusting apparatus, storage medium, and program product

Info

Publication number: CN114615480A
Application number: CN202210242201.7A
Authority: CN
Inventors: 王豪庆; 曹嘉航; 梁翔宇
Original assignee: Formovie Chongqing Innovative Technology Co Ltd
Current assignee: Formovie Chongqing Innovative Technology Co Ltd
Priority date: 2022-03-11
Filing date: 2022-03-11
Publication date: 2022-06-10

Abstract

The application relates to a projection picture adjusting method, a projection picture adjusting device, projection picture adjusting equipment, a storage medium and a program product. The method comprises the steps of obtaining an initial shooting image sent by a mobile terminal, obtaining image vertex coordinates of a test picture area and image vertex coordinates of a curtain area under an image coordinate system according to the initial shooting image, determining projection vertex coordinates of the curtain under a projection equipment coordinate system according to plane vertex coordinates of the curtain, projection vertex coordinates of an original projection picture, image vertex coordinates of the test picture area and image vertex coordinates of the curtain area, and sending the projection vertex coordinates of the curtain to projection equipment so that the projection equipment can adjust a projection picture projected by the projection equipment according to the projection vertex coordinates of the curtain. The method can improve the accuracy and convenience of automatic alignment of the projection picture and the curtain.

Description

Projection picture adjusting method, projection picture adjusting device, projection picture adjusting equipment, storage medium and program product

Technical Field

The present application relates to the field of projectors, and in particular, to a method, an apparatus, a device, a storage medium, and a program product for adjusting a projection screen.

Background

With the improvement of living standard of people, the laser television is favored by people because the life is full of science and technology and happiness. However, with the continuous popularization of laser televisions, laser televisions also face the challenge of realizing different functions in different application scenarios.

The laser television is a projector adopting a laser light source, and can adjust a projection picture projected on a curtain to ensure the projection effect of the laser television. In the related art, the most common laser television adjusts a projection picture in a manual mode, so that the projection picture is aligned with a curtain, and the projection effect is ensured.

However, the operation of adjusting the projection image is time-consuming and labor-consuming, and the accuracy is low.

Disclosure of Invention

In view of the foregoing, it is desirable to provide a method, an apparatus, a device, a storage medium, and a program product for adjusting a projection screen, which improve accuracy and convenience of adjusting the projection screen.

In a first aspect, the present application provides a method for adjusting a projection image, including:

acquiring an initial shooting image sent by a mobile terminal; the initial shooting image is obtained by the mobile terminal collecting a test picture projected by the projection equipment on the curtain, and the test picture is formed by the projection equipment scaling an original projection picture according to a preset scaling;

acquiring image vertex coordinates of a test picture area and image vertex coordinates of a curtain area under an image coordinate system according to the initial shooting image;

acquiring plane vertex coordinates of the curtain in a plane coordinate system of the curtain and projection vertex coordinates of an original projection picture in a coordinate system of projection equipment, and determining the projection vertex coordinates of the curtain in the coordinate system of the projection equipment according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of a test picture area and the image vertex coordinates of the curtain area;

and sending the projection vertex coordinates of the curtain to the projection equipment so that the projection equipment can adjust the projection picture projected by the projection equipment according to the projection vertex coordinates of the curtain.

In one embodiment, acquiring the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area in the image coordinate system according to the initial shooting image comprises:

preprocessing the initial shot image to obtain a projection test image;

and acquiring the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area under the image coordinate system according to the projection test image.

In one embodiment, in the projection test image, pixel values of regions where the boundary line of the test picture region and the boundary line of the curtain region are located are first pixel values, and pixel values of regions where the non-boundary lines in the projection test image are located are second pixel values; the first pixel value is greater than the second pixel value.

In one embodiment, acquiring the image vertex coordinates of the test frame area in the image coordinate system according to the projected test image includes:

sequentially comparing the pixel value of each pixel point in the first preset direction with the first pixel value along the first preset direction by taking the center of the projection test image as an initial point to determine the boundary point of the test picture area;

and sequentially comparing the pixel values of the pixel points in the first direction and the second direction of each pixel point in the second preset direction with the second pixel value along the second preset direction by taking the boundary point of the test picture area as an initial point, and determining the image vertex coordinates of the test picture area.

In one embodiment, acquiring the coordinates of the vertex of the image of the curtain area under the image coordinate system according to the projected test image comprises:

sequentially comparing the pixel value of each pixel point in a third preset direction with the first pixel value by taking the image vertex coordinate of the test picture area as an initial point along the third preset direction to determine the boundary point of the curtain area;

and sequentially comparing the pixel values of the pixel points in the third direction and the fourth direction of each pixel point in the fourth preset direction with the second pixel value along the fourth preset direction by taking the boundary point of the curtain area as an initial point, and determining the image vertex coordinates of the curtain area.

In one embodiment, determining projection vertex coordinates of the curtain in a projection device coordinate system according to plane vertex coordinates of the curtain and projection vertex coordinates of an original projection picture, image vertex coordinates of a test picture area and image vertex coordinates of a curtain area comprises:

determining a first conversion matrix according to the image vertex coordinates of the curtain area and the plane vertex coordinates of the curtain;

determining plane vertex coordinates of a test picture under a curtain plane coordinate system according to the first conversion matrix and the image vertex coordinates of the test picture area;

determining the plane vertex coordinates of the original projection picture under a curtain plane coordinate system according to the preset scaling and the plane vertex coordinates of the test picture;

determining a second transformation matrix according to the plane vertex coordinates of the original projection picture and the projection vertex coordinates of the original projection picture;

and determining the projection vertex coordinates of the curtain according to the second conversion matrix and the plane vertex coordinates of the curtain.

In one embodiment, the original projection picture is a projection picture formed when the projection direction of the projection device is perpendicular to the projection curtain.

In one embodiment, the vertex coordinates of each plane of the test picture are within the curtain area, and the vertex coordinates of each plane of the original projection picture are outside the curtain area.

The application also provides a projection picture adjusting method, which comprises the following steps:

collecting a test picture projected by the projection equipment on the curtain to obtain an initial shot image, wherein the test picture is formed by the projection equipment scaling an original projection picture according to a preset scaling;

the method comprises the steps of sending an initial shooting image to a server, instructing the server to obtain image vertex coordinates of a test picture and image vertex coordinates of a curtain under an image coordinate system according to the initial shooting image, determining projection vertex coordinates of the curtain under a projection equipment coordinate system according to plane vertex coordinates of the curtain, projection vertex coordinates of an original projection picture, image vertex coordinates of a test picture area and image vertex coordinates of the curtain area, and sending the projection vertex coordinates of the curtain to projection equipment so that the projection equipment can adjust a projection picture of the projection equipment according to the projection vertex coordinates of the curtain.

projecting a test picture formed by scaling the original projection picture according to a preset scaling on a curtain;

receiving projection vertex coordinates of the curtain under the projection equipment coordinate system sent by the server, and adjusting a projection picture of the projection equipment according to the projection vertex coordinates of the curtain;

the projection vertex coordinates of the curtain are determined by the server according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area after the image vertex coordinates of the test picture and the image vertex coordinates of the curtain are obtained under the image coordinate system according to the initial shooting image; the initial projection picture is obtained by collecting a test picture by the mobile terminal.

In a second aspect, an embodiment of the present application provides a projection image adjusting apparatus, including:

the first acquisition module is used for acquiring an initial shooting image sent by the mobile terminal, wherein the initial shooting image is obtained by the mobile terminal by acquiring a test picture projected by the projection equipment on the screen, and the test picture is formed by the projection equipment scaling an original projection picture according to a preset scaling;

the second acquisition module is used for acquiring the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area under the image coordinate system according to the initial shooting image;

the determining module is used for acquiring the plane vertex coordinates of the curtain in the plane coordinate system of the curtain and the projection vertex coordinates of the original projection picture in the coordinate system of the projection equipment, and determining the projection vertex coordinates of the curtain in the coordinate system of the projection equipment according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area;

the first sending module is used for sending the projection vertex coordinates of the curtain to the projection equipment so that the projection equipment can adjust the projection picture projected by the projection equipment according to the projection vertex coordinates of the curtain.

The application also provides a projection picture adjusting device, which further comprises:

the device comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a test picture projected by the projection equipment on the curtain to obtain an initial shot image, and the test picture is formed by the projection equipment scaling an original projection picture according to a preset scaling;

and the second sending module is used for sending the initial shot image to the server, instructing the server to obtain the image vertex coordinates of the test picture and the image vertex coordinates of the curtain under the image coordinate system according to the initial shot image, determining the projection vertex coordinates of the curtain under the projection equipment coordinate system according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area, and sending the projection vertex coordinates of the curtain to the projection equipment so that the projection equipment can adjust the projection picture of the projection equipment according to the projection vertex coordinates of the curtain.

the projection module is used for projecting a test picture formed by scaling the original projection picture according to a preset scaling on the curtain;

the receiving module is used for receiving the projection vertex coordinates of the curtain under the projection equipment coordinate system sent by the server and adjusting the projection picture of the projection equipment according to the projection vertex coordinates of the curtain;

In a third aspect, an embodiment of the present application provides a computer device, including a memory and a processor, where the memory stores a computer program, and the processor implements the steps of any one of the methods provided in the embodiments of the first aspect when executing the computer program.

In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of any one of the methods provided in the embodiments of the first aspect.

In a fifth aspect, the present application provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of any one of the methods provided in the embodiments of the first aspect.

According to the projection picture adjusting method, the projection picture adjusting device, the projection picture adjusting equipment, the storage medium and the program product, an initial shooting image sent by a mobile terminal is obtained, according to the initial shooting image, image vertex coordinates of a test picture area and image vertex coordinates of a curtain area under an image coordinate system are obtained, projection vertex coordinates of the curtain under a projection equipment coordinate system are determined according to plane vertex coordinates of the curtain, projection vertex coordinates of an original projection picture, image vertex coordinates of the test picture area and image vertex coordinates of the curtain area, and the projection vertex coordinates of the curtain are sent to the projection equipment, so that the projection equipment can adjust the projection picture projected by the projection equipment according to the projection vertex coordinates of the curtain. In the method, an initial shot image is obtained by acquiring a test picture projected by a projection device on a curtain by a mobile terminal, the test picture is formed by the projection device scaling an original projection picture according to a preset scaling, the test picture in the initial shot image is ensured to be in the curtain area, and the image vertex coordinates of the test picture area are all in the curtain area, so that the accuracy of the finally obtained projection vertex coordinates of the curtain under a projection device coordinate system can be ensured, and the projection picture of the projection device is automatically adjusted according to the projection vertex coordinates of the curtain, so that the vertex of the projection picture is aligned with the projection vertex coordinates of the curtain, and the manual adjustment of the alignment of the projection picture and the curtain is omitted; and the projection equipment adjusts the projected projection picture according to the acquired vertex coordinates of the screen projection, so that the accuracy of the alignment of the projection picture and the screen is improved.

Drawings

FIG. 1 is a diagram illustrating an exemplary embodiment of a projection screen adjustment method;

FIG. 2 is a flowchart illustrating a method for adjusting a projection frame according to an embodiment;

FIG. 3 is a flowchart illustrating a method for adjusting a projection frame according to another embodiment;

FIG. 4 is a schematic diagram of projecting a test image in one embodiment;

FIG. 5 is a flowchart illustrating a method for adjusting a projection frame according to another embodiment;

FIG. 6 is a diagram illustrating boundary points of a projected test image in one embodiment;

FIG. 7 is a schematic diagram of boundary points of a projected test image in another embodiment;

FIG. 8 is a schematic diagram of boundary points of a projected test image in another embodiment;

FIG. 9 is a schematic diagram of boundary points of a projected test image in another embodiment;

FIG. 10 is a schematic diagram of a vertex of a projected test image in one embodiment;

FIG. 11 is a flowchart illustrating a method for adjusting a projection screen according to another embodiment;

FIG. 12 is a schematic diagram of boundary points of a projected test image in another embodiment;

FIG. 13 is a schematic view of the vertices of a projected test image in another embodiment;

FIG. 14 is a flowchart illustrating a method for adjusting a projection screen according to another embodiment;

FIG. 15 is a schematic diagram illustrating a plane transformation of a projection screen adjustment method according to an embodiment;

FIG. 16 is a flowchart illustrating a method for adjusting a projection screen according to another embodiment;

FIG. 17 is a flowchart illustrating a method for adjusting a projection screen according to another embodiment;

FIG. 18 is a block diagram showing a configuration of a projection picture adjusting apparatus according to an embodiment;

FIG. 19 is a block diagram of a projection picture adjusting apparatus according to another embodiment;

FIG. 20 is a block diagram of a projection screen adjusting apparatus according to another embodiment;

FIG. 21 is a diagram illustrating an internal structure of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

The method for adjusting a projection picture provided by the embodiment of the application can be applied to the application environment shown in fig. 1. The projection device 102 communicates with the server 104 through a network, the mobile terminal 106 communicates with the server 104 through a network, and the projection device 102 communicates with the mobile terminal through a wireless mode, which may be a bluetooth mode or the like. The data storage system may store data that the server 104 needs to process. The data storage system may be integrated on the server 104, or may be located on the cloud or other network server. The projection device 102 may be an ultra-short-focus projection device, specifically, the projection device 102 may be a laser projection device, and it can be understood that the projection device 102 may also be a long-focus projection device or a short-focus projection device; the server 104 may be implemented as a stand-alone server or a server cluster composed of a plurality of servers; the mobile terminal 106 may be a mobile terminal device with a camera function, such as a mobile phone, a tablet computer, a notebook, a video camera, and a wearable device.

The embodiment of the application provides a projection picture adjusting method, a projection picture adjusting device, projection picture adjusting equipment, a storage medium and a program product, and can improve the accuracy and convenience of projection picture adjustment.

The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application.

In an embodiment, taking the application environment in fig. 1 as an example, the embodiment relates to a specific process of acquiring image vertex coordinates of a test picture area and image vertex coordinates of a curtain area in an image coordinate system according to an initial captured image sent by a mobile terminal, determining projection vertex coordinates of the curtain in a projection device coordinate system according to plane vertex coordinates of the curtain, projection vertex coordinates of an original projection picture, image vertex coordinates of the test picture area and image vertex coordinates of the curtain area, and then sending the projection vertex coordinates of the curtain to a projection device so that the projection device adjusts a projection picture of the projection device according to the projection vertex coordinates of the curtain, as shown in fig. 2, and the embodiment includes the following steps:

s201, acquiring an initial shooting image sent by the mobile terminal.

The initial shooting image is obtained by the mobile terminal collecting a test picture projected by the projection equipment on the curtain, and the test picture is formed by the projection equipment scaling an original projection picture according to a preset scaling.

In this embodiment, the original projection picture projected by the projection device can completely cover the curtain, and therefore, the original projection picture needs to be scaled by the preset scaling ratio, so that the test picture is ensured to be in the curtain, and the subsequent analysis and calculation of the position of the test picture relative to the curtain are facilitated.

Alternatively, the preset scaling may be 60%. The preset scaling referred to in the embodiments of the present application may be a value greater than 0 and less than 1, for example, the preset scaling may be 50%, 60%, 65%, or 70%. In practical applications, the present application does not limit the specific value of the preset scaling. The adjustment of the preset scaling of the original projection picture by the projection equipment is to reduce the original projection picture and ensure that the reduced test picture is in the curtain.

The mobile terminal may be a mobile phone, a tablet computer, a notebook, a camera, a wearable device, or the like, optionally, the type of the mobile terminal is not limited in the embodiment of the present application, and the mobile terminal may be any mobile terminal having a photographing function.

The projection equipment is equipment capable of projecting images or videos onto a curtain and can be connected with a computer, a game machine, a DV and the like through different interfaces to play corresponding video signals; projection devices may be used in homes, offices, schools, and entertainment venues.

The projection equipment in the embodiment of the application can be a laser television, the laser television adopts a reflective ultra-short focal projection principle, and compared with a long focal projector, the projection distance is shorter, the brightness is higher, and the display effect is better. The projection apparatus in the present application is explained by taking an ultra-short-focus projection apparatus as an example.

In general, the projection device cannot align the initially projected projection picture with the curtain due to the relationship of the placement position, and therefore, the projection picture needs to be adjusted to align the projection picture with the curtain; before adjusting the alignment of the projection picture with the curtain, the projection equipment needs to be tested. In the embodiment of the application, when the projection equipment performs the projection picture test, the projection equipment reduces the original projection picture by a preset scaling ratio, and then performs projection.

The screen surface is usually dark or black, when the projection equipment adjusts the preset proportion to the test picture, the test picture can be completely switched to white, and the purpose of switching the test picture projected by the projection equipment to white is to distinguish the test picture from the screen and facilitate obtaining the boundary line of the test image.

Optionally, the color of the test picture may be other colors besides white, and it is within the scope of the present invention as long as it is ensured that the color of the test picture can be distinguished from the color of the curtain, so as to facilitate obtaining the boundary line of the test picture on the curtain.

The projection equipment projects a test picture to the curtain, and the mobile terminal collects an initial shooting image according to the test picture projected on the curtain; the initial shooting image comprises a curtain and a test picture projected on the curtain by the projection equipment.

The mode of acquiring the initial shot image may be that the mobile terminal takes a picture of a curtain where the test picture is located to obtain the initial shot image, and then the mobile terminal sends the initial shot image to the server.

Before the initial shooting image is obtained, the mobile terminal is in communication connection with the projection equipment, so that after a user triggers a picture adjusting request in the mobile terminal, the picture adjusting request can be sent to the projection equipment, and after the projection equipment receives the picture adjusting request, a test picture projected to a curtain by the projection equipment can be adjusted to be a picture with a preset proportion.

In one embodiment, taking a mobile terminal as a mobile phone device as an example, the mobile phone device is in communication connection with a projection device, and the communication connection mode can be connected in a bluetooth mode, specifically, the mobile phone bluetooth and the projection device are opened, the mobile phone device is in communication connection with the projection device, then, a picture adjustment request is triggered on a small program or an application program home page in the mobile phone device, that is, a screen-matching function is clicked, the mobile phone device sends a picture adjustment instruction to the projection device, the projection device zooms an original projection picture at a preset zooming ratio of 60%, and a test picture is projected on a screen; meanwhile, the mobile phone device triggers the function of the mobile phone camera, then the test picture on the curtain is photographed at any angle by using the function of the mobile phone camera to obtain an initial shot image, and the initial shot image is sent to the server.

S202, acquiring the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area under the image coordinate system according to the initial shooting image.

Wherein a vertex is a point of an angle formed by two or more curves, lines or edges meeting, e.g., corners of polygons and polyhedrons are corner points; if the test picture of the projection equipment and the curtain are rectangular or square, 4 vertex coordinates of the image of the test picture and 4 vertex coordinates of the image of the curtain are provided.

The test picture area is an area where a test picture image is located in an image shot by the mobile terminal; the screen area refers to an area where a screen image is located in an image shot by the mobile terminal. Before acquiring the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area, an image coordinate system needs to be established by an initial shooting image.

For example, the vertex of the lower left corner of the initial shot image is taken as an origin coordinate, and the image vertex coordinate of the test picture area and the image vertex coordinate of the curtain area are respectively obtained; or respectively acquiring the image vertex coordinates of the test picture area and the curtain area by taking the central point of the initial shot image as the origin coordinates. In the embodiment of the present application, the origin coordinates of the image coordinate system are not specifically limited.

The initial captured image may be recognized using an Open Source Computer Vision Library (OpenCV), and the image vertex coordinates of the test screen area and the image vertex coordinates of the curtain area may be obtained.

Optionally, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area may also be obtained by training a preset neural network model, specifically, the initial shot image is used as an input of the neural network model, and the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area are finally output through analysis of the neural network model.

S203, acquiring the plane vertex coordinates of the curtain in the plane coordinate system of the curtain and the projection vertex coordinates of the original projection picture in the coordinate system of the projection equipment, and determining the projection vertex coordinates of the curtain in the coordinate system of the projection equipment according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area.

When the projection equipment projects the test picture, the test picture can be displayed through the curtain, a plane coordinate system of the curtain is established by the plane curtain, and the plane vertex coordinates of the curtain under the plane coordinate system of the curtain can be determined according to the resolution of the projection equipment.

For example, the resolution of the projection device is 1920 × 1080, and the final effect after the projection picture is adjusted is that the position of the projection picture is aligned with the position of the curtain, i.e., the top left vertex of the curtain can be regarded as the origin of coordinates of the curtain plane coordinate system, so the plane vertex coordinates of the curtain below the curtain plane coordinate system are (0, 0), (1920, 0), (0, 1080), (1920, 1080). It should be noted that, the curtain plane coordinate system is different from the traditional coordinate system, and the positive and negative in the coordinate system do not need to be distinguished, and are positive numbers.

The projection device coordinate system is a projection device coordinate system established under the angle of the projection device, and the projection device coordinate system may include a projection screen and a curtain of the projection device.

And the projection vertex coordinates of the original projection picture are the projection vertex coordinates of the original projection picture in a projection equipment coordinate system, and the projection vertex coordinates of the original projection picture are determined according to the characteristics of projection equipment.

Taking the resolution of the projection device as 1920 × 1080 as an example, the projection vertex coordinates of the original projection picture are (0, 0), (1920, 0), (0, 1080), (1920, 1080), and the projection device coordinate system takes the vertex at the upper left corner of the original projection picture as the origin coordinates, and it should be noted that the projection device coordinate system is different from the conventional coordinate system, and both the projection device coordinate system and the conventional coordinate system do not need to distinguish positive and negative numbers in the coordinate system.

In one embodiment, the projection vertex coordinates of the curtain in the projection device coordinate system may be obtained through a preset identification algorithm, specifically, the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area, and the image vertex coordinates of the curtain area are used as input of the identification algorithm, and the projection vertex coordinates of the curtain in the projection device coordinate system are output by running the algorithm.

In another embodiment, the projection vertex coordinates of the curtain in the projection device coordinate system may also be obtained through a preset neural network model, specifically, the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area, and the image vertex coordinates of the curtain area are used as inputs of the neural network model, and the projection vertex coordinates of the curtain in the projection device coordinate system are finally output through analysis of the neural network model.

And S204, sending the projection vertex coordinates of the curtain to the projection equipment so that the projection equipment can adjust the projection picture projected by the projection equipment according to the projection vertex coordinates of the curtain.

The server obtains the projection vertex coordinates of the curtain under the projection equipment coordinate system, and then sends the projection vertex coordinates of the curtain to the projection equipment, and after receiving the projection vertex coordinates of the curtain, the projection equipment can adjust the projection picture projected by the projection equipment according to the projection vertex coordinates of the curtain, so that the vertex coordinates of the projection picture projected by the projection equipment are aligned with the projection vertex coordinates of the curtain.

The projection picture adjusting method comprises the steps of obtaining an initial shooting image sent by a mobile terminal, obtaining image vertex coordinates of a test picture area and image vertex coordinates of a curtain area under an image coordinate system according to the initial shooting image, determining projection vertex coordinates of the curtain under a projection equipment coordinate system according to plane vertex coordinates of the curtain, projection vertex coordinates of an original projection picture, image vertex coordinates of the test picture area and image vertex coordinates of the curtain area, and sending the projection vertex coordinates of the curtain to projection equipment so that the projection equipment can adjust a projection picture projected by the projection equipment according to the projection vertex coordinates of the curtain. In the method, an initial shot image is obtained by acquiring a test picture projected by a projection device on a curtain by a mobile terminal, the test picture is formed by the projection device scaling an original projection picture according to a preset scaling ratio, the test picture in the initial shot image is ensured to be in the curtain area, image vertex coordinates of the test picture area are all in the curtain area, the accuracy of finally obtained projection vertex coordinates of the curtain under a projection device coordinate system can be ensured, and the projection picture of the projection device is automatically adjusted according to the projection vertex coordinates of the curtain, so that the vertex of the projection picture is aligned with the projection vertex coordinates of the curtain; and the projection equipment adjusts the projected projection picture according to the acquired vertex coordinates of the screen projection, so that the accuracy of the alignment of the projection picture and the screen is improved.

Based on the above embodiments, in an embodiment, obtaining the vertex coordinates of the image of the test picture area and the vertex coordinates of the image of the curtain area in the image coordinate system according to the initial captured image is described, as shown in fig. 3, the embodiment includes the following steps:

s301, preprocessing the initial shooting image to obtain a projection test image.

And performing preprocessing operation on the initial shot image, wherein the preprocessing operation comprises the steps of performing noise reduction on the initial shot image, performing edge detection on the initial shot image subjected to the noise reduction to obtain a boundary line of a test picture and a boundary line of a curtain, and finally performing highlighting on the boundary line of the test picture and the boundary line of the curtain to obtain a projected test image.

Firstly, carrying out noise reduction processing on an initial shot image; the quality of the image is directly related to the effect of subsequent image processing, such as: image segmentation, target recognition, edge extraction, etc., so that after the initial captured image is obtained, the initial projection test image is subjected to noise reduction processing.

The mode of performing noise reduction processing on the initial captured image may be to call a gaussian filter function in OpenCV to perform noise reduction on the initial captured image.

Optionally, the method of noise reduction processing further includes: an airspace pixel characteristic denoising algorithm, a transform domain denoising algorithm, a singular value decomposition method and the like; it should be noted that, in the embodiment of the present application, a method for performing noise reduction processing on an initial captured image is not limited.

And then, carrying out edge detection on the initial shot image subjected to noise reduction processing, and extracting a boundary line of a test picture and a boundary line of the curtain.

Edge detection is a fundamental problem in image processing and computer vision, and the purpose of edge detection is to identify points in a digital image where changes in brightness are significant, e.g., a typical border may be a red and yellow border.

The essence of edge detection is that a certain algorithm is adopted to extract the boundary line between an object and a background in an image, the edge can be defined as the boundary of a region with sharp change of the gray level in the image, and the change condition of the gray level of the image can be reflected by the gradient of the gray level distribution of the image, so that an edge detection operator can be obtained by using a local image differential technology. The edge detection method can achieve the purpose of detecting the edge by constructing an edge detection operator for a certain small neighborhood of pixels in the original image, and optionally, the edge detection operator comprises an edge operator of a first derivative, an edge operator of a second derivative and other edge operators.

The boundary line of the test picture and the boundary line of the curtain may be extracted by calling a Canny function in OpenCV to perform edge detection on the initial captured image after the noise reduction processing, and extracting the boundary line of the test picture and the boundary line of the curtain.

Optionally, the edge detection may be performed on the initial captured image after the noise reduction processing by using a cross-differentiation algorithm, so as to obtain a boundary line of the test picture and a boundary line of the curtain.

And finally, highlighting the boundary line of the test picture and the boundary line of the curtain according to the boundary line of the test picture and the boundary line of the curtain to obtain a projected test image.

Specifically, after extracting the boundary line of the test picture and the boundary line of the curtain in the initial shot image, carrying out uniform color processing on the non-boundary area, and then highlighting the boundary line of the test picture and the boundary line of the curtain to obtain a projected test image; projecting the test image can clearly distinguish the boundary line from the non-boundary line region, as shown in fig. 4, where the boundary line of the test picture and the boundary line of the curtain are included in fig. 4.

S302, according to the projection test image, obtaining the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area in the image coordinate system.

In one embodiment, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area in the image coordinate system may be obtained by using OpenCV to identify and project the test image and directly outputting the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area.

Optionally, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area may also be obtained by training a preset neural network model, specifically, the projection test image is used as an input of the neural network model, and the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area are finally output through analysis of the neural network model.

The projection picture adjusting method comprises the steps of preprocessing an initial shot image to obtain a projection test image, and obtaining the image vertex coordinates of a test picture area and the image vertex coordinates of a curtain area in an image coordinate system according to the projection test image. According to the method, the accuracy of the acquired image vertex coordinates of the test picture area and the acquired image vertex coordinates of the curtain area is improved by preprocessing the initial shot image, so that the accuracy of the alignment of the projection picture and the curtain is higher.

In one embodiment, in the projection test image, pixel values of regions where the boundary line of the test picture region and the boundary line of the curtain region are located are first pixel values, and pixel values of regions where non-boundary lines in the projection test image are located are second pixel values; the first pixel value is greater than the second pixel value.

After the boundary line of the test picture and the boundary line of the curtain are extracted from the initial shot image, the boundary lines can be highlighted, the pixel values of the area where the boundary lines are located are processed into first pixel values, and the pixel values of the area where the non-boundary lines are located are processed into second pixel values, so that a projection test image is obtained.

Alternatively, the first pixel value may be set to be greater than the second pixel value, which ensures that the pixel value of the boundary line is greater than the boundary value of the non-boundary line region, and the boundary line and the non-boundary line region may be clearly distinguished, for example, with continuing reference to fig. 4, the pixel value of the boundary line is processed to be 255 (i.e., the first pixel value) and the non-boundary line region is processed to be 0 (i.e., the second pixel value).

Based on the above embodiment, the description is made on acquiring the image vertex coordinates of the test picture area in the image coordinate system according to the projected test image, and in one embodiment, as shown in fig. 5, the embodiment includes the following steps:

s501, taking the center of the projected test image as an initial point, sequentially comparing the pixel value of each pixel point in the first preset direction with the first pixel value along the first preset direction, and determining the boundary point of the test picture area.

S502, taking the boundary point of the test picture area as an initial point, sequentially comparing the pixel values of the pixel points in the first direction and the second direction of each pixel point in the second preset direction with the second pixel value along the second preset direction, and determining the image vertex coordinates of the test picture area.

It should be noted that, in the present embodiment, in order to more clearly display each boundary point and vertex in the projection test image, in fig. 6-10 and 12-13, the non-boundary area in the projection test image is displayed in white and the boundary area is displayed in black, but in practical application, the colors of the non-boundary area and the boundary area in the projection test image in fig. 6-10 and 12-13 are not limited; in order to illustrate the areas of the upper left, lower left, upper right, and lower right, the center of the projected test image is used as a dividing point, and the upper left, lower left, upper right, and lower right are divided by the cross coordinate, which is specifically divided as shown in fig. 6-10, 12-13.

The first preset direction may be a preset direction, and includes an upper left direction, a lower left direction, an upper right direction, a lower right direction, and the like; the second predetermined direction is a direction parallel to a boundary line where the boundary point of the test frame region is located.

It is understood that the first predetermined direction is different, and the corresponding second predetermined direction is also different.

For example, as shown in FIG. 6, to determine a test drawingProcedure of image vertex coordinates of face region at upper left. At the moment, the first preset direction is the upper left direction, the center of the projected test image is taken as an initial point, the pixel values of all pixel points in the upper left direction are sequentially compared with the first pixel value along the upper left direction until the pixel point with the first pixel value as the first pixel value is found, and the pixel point is determined to be a boundary point of the test picture area in the upper left direction. Due to the influence of the slope in the upper left direction, there are two cases where the boundary point of the test frame region in the upper left direction is a, and fig. 6(a) shows that the slope in the upper left direction is a₁In this case, the boundary point at the upper left is on the upper boundary line of the test picture; FIG. 6(b) shows the slope b in the upper left direction₁In this case, the boundary point in the upper left direction is on the left boundary line of the test screen.

With reference to fig. 6, since there are two cases at the boundary point of the test frame region in the upper left direction, there are two cases correspondingly at the second predetermined direction. Specifically, when the upper-left boundary point is determined to be on the upper boundary line of the test picture area in fig. 6(a), the second predetermined direction is a direction parallel to the upper boundary line to the left, and when the upper-left boundary point is determined to be on the left boundary line of the test picture area in fig. 6(b), the second predetermined direction is a direction parallel to the left boundary line to the upper direction. At this time, the first azimuth and the second azimuth are left and upper, respectively. And taking the boundary point of the determined test picture area at the upper left as an initial point, namely the upper left boundary point. And if the pixel values of the pixel points at the left side and the upper side of the upper left boundary point are both second pixel values, determining the upper left boundary point as the image vertex coordinate of the test picture area at the upper left side. And if the pixel value of the pixel point at the left side of the upper left boundary point or the pixel value of the pixel point above the upper left boundary point is not the second pixel value, moving a pixel point forward along the second preset direction, updating the pixel point to be a new upper left boundary point until the pixel values of the pixel points at the left side and the upper side of the new upper left boundary point are the second pixel values, and determining the upper left boundary point at the moment as the image vertex coordinate of the test picture area at the upper left.

As shown in fig. 7, a process for determining the coordinates of the vertices of the image of the test picture area at the lower left. At this timeThe first preset direction is a left-lower direction, the center of the projection test image is taken as an initial point, the pixel values of all the pixel points in the left-lower direction are sequentially compared with the first pixel value along the left-lower direction until the pixel point with the first pixel value as the first pixel value is found, and the pixel point is determined to be a boundary point of the test picture area in the left-lower direction. There are two cases where the boundary point of the test picture region in the lower left direction is due to the influence of the lower left direction slope, and fig. 7(a) shows that the slope in the lower left direction is a₂In the case of (1), the boundary point at the lower left is at the lower boundary line of the test picture at this time; FIG. 7(b) shows the slope b in the lower left direction₂In this case, the boundary point in the lower left direction is on the left boundary line of the test screen.

With continued reference to fig. 7, since there are two cases for the boundary point of the test frame region in the lower left direction, there are two cases for the second predetermined direction correspondingly. Specifically, when the lower-left boundary point is determined to be on the lower boundary line of the test picture region in fig. 7(a), the second predetermined direction is a direction parallel to the lower boundary line to the left, and when the lower-left boundary point is determined to be on the left boundary line of the test picture region in fig. 7(b), the second predetermined direction is a direction parallel to the left boundary line to the bottom. At this time, the first azimuth and the second azimuth are the left and the lower, respectively. And taking the boundary point of the determined test picture area at the lower left as an initial point, namely a lower left boundary point. And if the pixel values of the pixel points to the left and below the lower left boundary point are both the second pixel values, determining the lower left boundary point as the image vertex coordinate of the test picture area at the lower left. And if the pixel value of the pixel point at the left side of the lower left boundary point or the pixel point below the lower left boundary point is not the second pixel value, moving a pixel point forward along a second preset direction, updating the pixel point to be a new lower left boundary point until the pixel values of the pixel points at the left side of the new lower left boundary point and the pixel points below the new lower left boundary point are the second pixel values, and determining the lower left boundary point at the moment as the image vertex coordinate of the test picture area at the lower left.

As shown in FIG. 8, the process of determining the coordinates of the vertices of the image with the test picture area at the top right is illustrated. At this time, the first preset direction is the upper right direction, and the center of the projection test image is used as the beginningAnd the initial point compares the pixel value of each pixel point in the upper right direction with the first pixel value in turn along the upper right direction until the pixel point with the first pixel value as the first pixel value is found, and determines the pixel point as a boundary point of the test picture area in the upper right direction. Due to the influence of the upper right-hand slope, the test frame region has two cases at the boundary point in the upper right-hand direction, and fig. 8(a) shows that the slope in the upper right-hand direction is a₃When the boundary point at the upper right is on the upper boundary line of the test picture; FIG. 8(b) shows the slope b in the upper right direction₃In this case, the boundary point in the upper right direction is on the right boundary line of the test screen.

With reference to fig. 8, since there are two cases in the boundary point of the test frame region in the upper right direction, there are two cases in the second predetermined direction correspondingly. Specifically, when the upper right boundary point is determined to be on the upper boundary line of the test picture area in fig. 8(a), the second predetermined direction is a direction parallel to the upper boundary line to the right, and when the upper right boundary point is determined to be on the right boundary line of the test picture area in fig. 8(b), the second predetermined direction is a direction parallel to the right boundary line to the upper direction. At this time, the first orientation and the second orientation are right and upper, respectively. And taking the boundary point of the determined test picture area at the upper right as an initial point, namely the upper right boundary point. And if the pixel values of the pixel points at the right and upper sides of the upper right boundary point are the second pixel values, determining the upper right boundary point as the image vertex coordinate of the test picture area at the upper right side. And if the pixel value of the pixel point at the right side of the upper right boundary point or the pixel point above the upper right boundary point is not the second pixel value, moving a pixel point forward along a second preset direction, updating the pixel point to be a new upper right boundary point until the pixel values of the pixel points at the right side and above the new upper right boundary point are the second pixel values, and determining the upper right boundary point at the moment as the image vertex coordinate of the test picture area at the upper right side.

For example, as shown in FIG. 9, a process for determining the coordinates of the vertices of the image in the lower right of the test picture area. At this time, the first preset direction is a lower right direction, the center of the projected test image is used as an initial point, and each of the lower right directions is sequentially arranged along the lower right directionAnd comparing the pixel value of the pixel point with the first pixel value until the pixel point with the first pixel value is found, and determining the pixel point as a boundary point of the test picture area in the right-lower direction. There are two cases where the boundary point of the test picture region in the lower right direction is due to the influence of the slope of the lower right direction, and fig. 9(a) shows that the slope of the lower right direction is a₄In the case of (1), the boundary point at the lower right side is at the lower boundary line of the test picture at the moment; FIG. 9(b) shows the slope b in the lower right direction₄In this case, the boundary point in the lower right direction is on the right boundary line of the test screen.

With continued reference to fig. 9, since there are two cases in the boundary point of the test frame region in the lower right direction, there are two cases in the second predetermined direction correspondingly. Specifically, when the lower-right boundary point is determined to be on the lower boundary line of the test picture area in fig. 9(a), the second predetermined direction is a direction parallel to the lower boundary line to the right, and when the lower-right boundary point is determined to be on the right boundary line of the test picture area in fig. 9(b), the second predetermined direction is a direction parallel to the right boundary line to the lower direction. At this time, the first orientation and the second orientation are right and lower, respectively. And taking the boundary point of the determined test picture area at the lower right as an initial point, namely the lower right boundary point. And if the pixel values of the pixel points at the right side and the lower side of the lower right boundary point are the second pixel values, determining the lower right boundary point as the vertex coordinates of the image at the lower right side of the test picture area. And if the pixel value of the pixel point at the right side of the lower right boundary point or the pixel point at the lower side is not the second pixel value, moving a pixel point forward along a second preset direction, updating the pixel point to be a new lower right boundary point until the pixel values of the pixel points at the right side of the new lower right boundary point and the pixel values of the pixel points at the lower side are the second pixel values, and determining the lower right boundary point at the moment as the image vertex coordinate of the test picture area at the lower right side.

Optionally, the image coordinate system is a coordinate system established by projecting the test image, and the origin of the coordinate is not limited, and the coordinates of the corresponding vertex of the image are different at different origins.

Acquiring the image vertex coordinates of the test picture, and acquiring all the vertex coordinates on the test picture in different directions; as shown in fig. 10, fig. 10 is an image vertex coordinate of the test screen in the upper left direction, the lower left direction, the upper right direction, and the lower right direction, respectively.

The projection picture adjusting method comprises the steps of taking the center of a projection test image as an initial point, sequentially comparing the pixel value of each pixel point in the first preset direction with the first pixel value along the first preset direction, determining the boundary point of a test picture area, sequentially comparing the pixel values of the pixel points in the first direction and the second direction of each pixel point in the second preset direction with the second pixel value along the second preset direction by taking the boundary point of the test picture area as the initial point, and determining the image vertex coordinate of the test picture area. The method comprises the steps of firstly determining boundary points of a test picture area, then finding out image vertex coordinates of the test picture area according to the boundary points of the test picture area, and accurately identifying the image vertex coordinates of the test picture area under an image coordinate system.

In one embodiment, as shown in fig. 11, acquiring the coordinates of the vertex of the image of the curtain area under the image coordinate system according to the projected test image includes the following steps:

and S1101, sequentially comparing the pixel value of each pixel point in the third preset direction with the first pixel value along the third preset direction by taking the image vertex coordinate of the test picture area as an initial point, and determining the boundary point of the curtain area.

And S1102, comparing pixel values of pixel points in a third direction and a fourth direction of each pixel point in the fourth preset direction with second pixel values along the fourth preset direction by taking the boundary point of the curtain area as an initial point, and determining the image vertex coordinates of the curtain area.

The third preset direction may be a preset direction, and includes an upper left direction, a lower left direction, an upper right direction, a lower right direction, and the like, and the fourth preset direction is a direction parallel to a boundary line where a boundary point of the curtain region is located.

After the image vertex coordinates of the test picture area are determined, the image vertex coordinates are used as initial points, the initial points continue to sequentially compare the pixel values of all the pixel points in the third preset direction with the first pixel values along the third preset direction until the pixel points with the first pixel values are found, and the pixel points are determined as boundary points of the curtain area. And then, sequentially comparing pixel values of pixel points in a third direction and a fourth direction of each pixel point in the fourth preset direction with the second pixel value along the fourth preset direction by taking the boundary point of the curtain area as an initial point, and determining the image vertex coordinates of the curtain area.

As shown in fig. 12, when determining the top left image coordinate of the curtain area, taking the top left image coordinate of the test picture area as an initial point, sequentially comparing the pixel values of the pixel points in the top left direction with the first pixel value along the top left direction, and determining the boundary point of the curtain area in the top left direction; due to the influence of the slope of the upper left direction, the boundary point of the curtain region in the upper left direction may be on the upper boundary line of the curtain region, and the fourth predetermined direction is the left direction parallel to the upper boundary line of the curtain region, as shown in fig. 12 (a); the boundary point of the curtain region in the upper left direction may also be on the left boundary line of the curtain region, and the fourth predetermined direction is the upward direction parallel to the left boundary line of the curtain region, as shown in fig. 12 (b); and determining the specific direction of the fourth preset direction according to the position of the boundary point of the curtain area in the upper left direction. And then, taking the boundary point of the curtain area in the upper left direction as an initial point, sequentially comparing the pixel values of the pixel points on the left and upper sides of each pixel point in the fourth preset direction with the second pixel value along the fourth preset direction, and determining the vertex coordinates of the image on the upper left side of the curtain area.

When determining the vertex coordinates of the image at the left lower side of the curtain area, taking the vertex coordinates of the image at the left lower side of the test picture area as an initial point, and sequentially comparing the pixel values of all pixel points at the left lower side with the first pixel values along the left lower direction to determine the boundary points of the curtain area at the left lower direction; due to the effect of the downward left directional slope, the boundary point of the curtain region in the downward left direction may be on the lower boundary line of the curtain region, and the fourth predetermined direction is the leftward direction parallel to the lower boundary line of the curtain region, as shown in fig. 12 (a); the boundary point of the curtain region in the lower left direction may also be on the left boundary line of the curtain region, and the fourth predetermined direction is the downward direction parallel to the left boundary line of the curtain region, as shown in fig. 12 (b); and determining the specific direction of the fourth preset direction according to the position of the boundary point of the curtain area in the left lower direction. And then, taking the boundary point of the curtain area in the left lower direction as an initial point, sequentially comparing the pixel values of the pixel points on the left and the lower sides of each pixel point in the fourth preset direction with the second pixel value along the fourth preset direction, and determining the vertex coordinates of the image on the left lower side of the curtain area.

When determining the image vertex coordinate of the upper right of the curtain area, taking the image vertex coordinate of the upper right of the test picture area as an initial point, sequentially comparing the pixel value of each pixel point of the upper right with the first pixel value along the upper right direction, and determining the boundary point of the curtain area in the upper right direction; due to the influence of the right-upper directional slope, the boundary point of the curtain region in the right-upper direction may be on the upper boundary line of the curtain region, and the fourth predetermined direction is a direction parallel to the upper boundary line of the curtain region to the right, as shown in fig. 12 (a); the boundary point of the curtain region in the upper right direction may also be on the right boundary line of the curtain region, and the fourth predetermined direction is the upward direction parallel to the right boundary line of the curtain region, as shown in fig. 12 (b); and determining the specific direction of the fourth preset direction according to the position of the boundary point of the curtain area in the upper right direction. And then, taking the boundary point of the curtain area in the upper right direction as an initial point, sequentially comparing the pixel values of the pixel points at the right and upper sides of each pixel point in the fourth preset direction with the second pixel value along the fourth preset direction, and determining the vertex coordinates of the image in the upper right of the curtain area.

When determining the vertex coordinates of the image at the lower right of the curtain area, taking the vertex coordinates of the image at the lower right of the test picture area as initial points, sequentially comparing the pixel values of all pixel points at the lower right with the first pixel values along the lower right direction, and determining the boundary points of the curtain area at the lower right direction; due to the influence of the downward right directional slope, the boundary point of the curtain region in the downward right direction may be on the lower boundary line of the curtain region, and the fourth predetermined direction is the rightward direction parallel to the lower boundary line of the curtain region, as shown in fig. 12 (a); the boundary point of the curtain region in the lower right direction may also be on the right boundary line of the curtain region, and the fourth predetermined direction is the downward direction parallel to the right boundary line of the curtain region, as shown in fig. 12 (b); and determining the specific direction of the fourth preset direction according to the position of the boundary point of the curtain area in the right-lower direction. And then, taking the boundary point of the curtain area in the right lower direction as an initial point, sequentially comparing the pixel values of the pixel points at the right and lower sides of each pixel point in the fourth preset direction with the second pixel value along the fourth preset direction, and determining the vertex coordinates of the image at the right lower side of the curtain area.

As shown in fig. 13, fig. 13 is the image vertex coordinates of the curtain area. The specific process of determining the image vertex coordinates of the curtain region is similar to the process of determining the image vertex coordinates of the test picture region, and is not described herein again.

The projection picture adjusting method comprises the steps of taking the image vertex coordinates of a test picture area as initial points, sequentially comparing the pixel values of all pixel points in the third preset direction with the first pixel values along the third preset direction to determine the boundary points of a curtain area, sequentially comparing the pixel values of all pixel points in the third direction and the fourth direction with the second pixel values along the fourth preset direction with the boundary points of the curtain area as the initial points, and determining the image vertex coordinates of the curtain area. The method can accurately determine the image vertex coordinates of the curtain area, thereby improving the accuracy of automatic alignment of the projection picture and the curtain.

In one embodiment, as shown in fig. 14, determining the projection vertex coordinates of the curtain under the projection apparatus coordinate system according to the plane vertex coordinates of the curtain and the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area includes the following steps:

s1401, according to the image vertex coordinates of the curtain area and the plane vertex coordinates of the curtain, a first conversion matrix is determined.

And calculating a first conversion matrix by calling a perspective transformation getPerpective transform function of OpenCV based on the image vertex coordinates of the curtain area and the plane vertex coordinates of the curtain, wherein the first conversion matrix can be a conversion matrix under an image coordinate system and a plane coordinate system.

The perspective transformation is to transfer the projection to a new plane, also called projection mapping, as shown in fig. 15, and fig. 15 is to obtain a ' B ' C ' by perspective transformation ABC.

As an example of the basic transformation, [ x ', y', z '] is the transformed coordinates, [ u, v, w ] is the coordinates before transformation, the a matrix is the transformation matrix, and the perspective transformation is the transformation in the 3-dimensional space, so there are 3 parameters, but generally, the two-dimensional image is processed, so w ═ w' of the source coordinates is 1, and the target coordinates can be transformed into two-dimensional.

The transformed coordinates x, y are respectively: x ═ x '/w', and y ═ y '/w'.

Wherein the content of the first and second substances,

a perspective transformation matrix is represented that is,

representing a linear transformation, [ a ]₃₁a₃₂]For translation.

Given the coordinate information of projection changes in 2 different coordinate systems, such as the image vertex coordinates of the curtain region and the plane vertex coordinates of the curtain, the first transformation matrix in the two different coordinate systems can be calculated through perspective changes.

S1402, determining the plane vertex coordinates of the test picture under the curtain plane coordinate system according to the first conversion matrix and the image vertex coordinates of the test picture area.

The first conversion matrix is a conversion matrix under an image coordinate system and a plane coordinate system, and the plane vertex coordinates of the test picture under the curtain plane coordinate system can be determined according to the image vertex coordinates of the test picture area under the image coordinate system.

The plane vertex coordinates of the test picture under the curtain plane coordinate system can be determined through a preset neural network model, the first conversion matrix and the region image vertex coordinates of the test picture are used as the input of the neural network model, and the plane vertex coordinates of the test picture under the curtain plane coordinate system are output through the analysis of the neural network model.

The image vertex coordinates of the test picture are image vertex coordinates of a preset proportion in an image coordinate system, and the first conversion matrix is a conversion matrix in the image coordinate system and a plane coordinate system, so that the image vertex coordinates of the test picture are multiplied by the first conversion matrix to obtain the plane vertex coordinates of the test picture of the preset proportion in the curtain plane coordinate system, namely the plane vertex coordinates of the test picture.

And S1403, determining the plane vertex coordinates of the original projection picture under the curtain plane coordinate system according to the preset scaling and the plane vertex coordinates of the test picture.

The test picture area is a projection picture obtained by scaling the original projection picture according to the preset scaling, and the image vertex coordinate of the test picture area is the image vertex coordinate after the preset scaling, so the plane vertex coordinate of the test picture is the vertex coordinate after the preset scaling.

Wherein the original projected picture represents an original scaled projected picture, the original scaled projected picture being a 100% scaled projected picture that is not scaled.

When the projection equipment projects the test picture, the original projection picture is formed by adjusting the original projection picture through the preset scaling, so that when the plane coordinate vertex of the test picture under the curtain plane coordinate system is obtained, the plane vertex coordinate of the test picture needs to be scaled, the plane vertex coordinate of the preset scale needs to be expanded to 100% in an equal proportion, and the plane vertex coordinate of 100% of the test picture under the plane coordinate system, namely the plane vertex coordinate of the original projection picture under the curtain plane coordinate system, is obtained.

And S1404, determining a second conversion matrix according to the plane vertex coordinates of the original projection picture and the projection vertex coordinates of the original projection picture.

And determining a second conversion matrix based on the plane vertex coordinates of the original projection picture and the projection vertex coordinates of the original projection picture, wherein the second conversion matrix is a conversion matrix for converting the curtain plane coordinate system into the projection equipment coordinate system.

The obtaining method of the second transformation matrix is the same as the obtaining method of the first transformation matrix, and is not described herein again.

And S1405, determining the projection vertex coordinates of the curtain according to the second conversion matrix and the plane vertex coordinates of the curtain.

The second conversion matrix is a conversion matrix for converting the plane coordinate system into the projection equipment coordinate system, so that the plane vertex coordinates of the curtain under the curtain plane coordinate system are multiplied by the second conversion matrix to obtain the projection vertex coordinates of the curtain under the projection equipment coordinate system.

The projection picture adjusting method comprises the steps of determining a first conversion matrix according to image vertex coordinates of a curtain area and plane vertex coordinates of a curtain, then determining plane vertex coordinates of a test picture under a curtain plane coordinate system according to the first conversion matrix and the image vertex coordinates of the test picture area, determining plane vertex coordinates of an original projection picture under the curtain plane coordinate system according to a preset scaling and the plane vertex coordinates of the test picture, determining a second conversion matrix according to the plane vertex coordinates of the original projection picture and the projection vertex coordinates of the original projection picture, and determining projection vertex coordinates of the curtain according to the second conversion matrix and the plane vertex coordinates of the curtain. In the method, through the conversion from the image coordinate system to the screen plane coordinate system and then from the screen plane coordinate system to the projection equipment coordinate system, the projection vertex coordinates of the screen under the projection equipment coordinate system can be accurately obtained through two conversions, and because the projection equipment can adjust the projection picture of the projection equipment according to the projection vertex coordinates of the screen, the accuracy rate of the alignment between the projection picture and the screen is improved, and the projection picture is automatically adjusted, so that the labor cost is saved, and the method has high convenience.

The original projection picture is a picture projected by 100% when the projection direction of the projection equipment is vertical to the projection curtain.

The test picture is projected after the projection equipment performs preset scaling on the original projection picture, and the test picture area is on the curtain, so that the plane vertex coordinates of the test picture are all in the curtain area.

The plane vertex coordinates of the original projection picture are all outside the curtain area, for example, the original projection picture area can cover the curtain area, one or two vertex coordinates of the original projection picture are correspondingly superposed with the vertex coordinates of the curtain, or the original projection picture area partially covers the curtain area.

In an embodiment, as shown in fig. 16, a method for adjusting a projection picture is provided, where the embodiment relates to a specific process of acquiring a test picture projected by a projection apparatus on a curtain to obtain an initial captured image, sending the initial captured image to a server, instructing the server to determine projection vertex coordinates of the curtain in a projection apparatus coordinate system, and sending the projection vertex coordinates of the curtain to the projection apparatus, so that the projection apparatus adjusts the projection picture of the projection apparatus according to the projection vertex coordinates of the curtain. This embodiment comprises the steps of:

s1601, collecting a test picture projected by the projection equipment on a curtain to obtain an initial shot image, wherein the test picture is formed by the projection equipment scaling an original projection picture according to a preset scaling.

The mobile terminal collects a test picture projected by the projection equipment on the curtain to obtain an initial shooting image.

And S1602, sending the initial shot image to a server, instructing the server to acquire the image vertex coordinates of the test picture and the image vertex coordinates of the curtain under the image coordinate system according to the initial shot image, determining the projection vertex coordinates of the curtain under the projection equipment coordinate system according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area, and sending the projection vertex coordinates of the curtain to projection equipment so that the projection equipment adjusts the projection picture of the projection equipment according to the projection vertex coordinates of the curtain.

After the mobile terminal collects the initial shooting image, the initial shooting image is sent to the server.

The implementation principle and technical effect of each step in the projection picture adjustment method provided in this embodiment are similar to those in the foregoing projection picture adjustment method embodiments, and are not described herein again.

In an embodiment, as shown in fig. 17, a method for adjusting a projection picture is provided, where the embodiment relates to a specific process of projecting a test picture formed by scaling an original projection picture according to a preset scaling on a curtain, receiving projection vertex coordinates of the curtain in a projection device coordinate system sent by a server, and adjusting the projection picture of a projection device according to the projection vertex coordinates of the curtain. This embodiment comprises the steps of:

s1701, a test picture formed by scaling the original projection picture according to a preset scaling ratio is projected on a curtain.

The projection equipment projects a test picture formed by scaling the original projection picture according to a preset scaling on the curtain.

And S1702, receiving the projection vertex coordinates of the curtain in the projection device coordinate system sent by the server, and adjusting the projection picture of the projection device according to the projection vertex coordinates of the curtain.

And the projection equipment receives the projection vertex coordinates of the curtain under the projection equipment coordinate system sent by the server, and adjusts the projection picture of the projection equipment according to the projection vertex coordinates of the curtain.

In one embodiment, the projection vertex coordinates of the curtain in the projection device coordinate system are determined according to the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area, and the projection vertex coordinates of the test picture in the image coordinate system are scaled up to be the image vertex coordinates of the original projection picture in the image coordinate system, and the projection vertex coordinates of the original projection picture in the image coordinate system and the image vertex coordinates of the original projection picture in the image coordinate system are preset to obtain a transformation matrix, wherein the transformation matrix is a transformation matrix from the image coordinate system to the projection device coordinate system, and therefore the projection vertex coordinates of the curtain in the projection device coordinate system are obtained by multiplying the image vertex coordinates of the curtain in the image coordinate system by the transformation matrix.

In an embodiment, a projection picture adjustment method according to an embodiment of the present application is described with reference to a projection device, a mobile terminal, and a server, where the mobile terminal is a mobile phone, and the embodiment includes the following steps:

s1, opening the Bluetooth of the mobile phone, selecting equipment connection, and establishing communication contact between the mobile phone equipment and the projection equipment;

s2, opening an applet or an application program in the mobile phone, clicking a screen alignment function by one time on a home page of the applet or the application program, sending a picture adjustment instruction to the projection equipment by the mobile phone, and triggering a camera of the mobile phone;

s3, the projection equipment zooms the original projection picture at a preset zoom ratio of 60% according to the picture adjusting instruction, projects a test picture on the curtain, switches the test picture into white, ensures that the test picture is in the curtain, and then uses a mobile phone to photograph the projection picture on the curtain at any angle;

s4, transmitting the initial shot image to a server through a mobile phone, and preprocessing the image by the server to obtain a preprocessed projection test image;

in the projection test image, pixel values of regions where the boundary line of the test picture region and the boundary line of the curtain region are located are first pixel values, and pixel values of regions where the non-boundary lines in the projection test image are located are second pixel values; the first pixel value is greater than the second pixel value, e.g., the first pixel value is 255, the second pixel value is 0;

s5, the server takes the center of the projection test image as an initial point, and sequentially compares the pixel value of each pixel point in the first preset direction with the first pixel value along the first preset direction to determine the boundary point of the test picture area; and then, sequentially comparing the pixel values of the pixel points in the first direction and the second direction of each pixel point in the second preset direction with the second pixel value along the second preset direction by taking the boundary point of the test picture area as an initial point, and determining the image vertex coordinates of the test picture area. The first preset direction comprises an upper left direction, a lower left direction, an upper right direction and a lower right direction, and the second preset direction is a direction parallel to a boundary line where a boundary point of the test picture area is located;

s6, the server takes the image vertex coordinates of the test picture area as an initial point, and sequentially compares the pixel value of each pixel point in the third preset direction with the first pixel value along the third preset direction to determine the boundary point of the curtain area; sequentially comparing pixel values of pixel points in a third direction and a fourth direction of each pixel point in the fourth preset direction with second pixel values along the fourth preset direction by taking the boundary point of the curtain area as an initial point, and determining the image vertex coordinates of the curtain area; the third preset direction comprises an upper left direction, a lower left direction, an upper right direction and a lower right direction, and the fourth preset direction is a direction parallel to a boundary line where a boundary point of the curtain area is located;

s7, determining a first conversion matrix M1 according to the image vertex coordinates of the curtain area and the plane vertex coordinates of the curtain;

the coordinates of four plane vertexes of the curtain under the plane coordinate system are (0, 0), (1920, 0), (0, 1080), (1920, 1080), and the first conversion matrix M1 is a conversion matrix for converting the image coordinate system into the plane coordinate system;

s8, determining the plane vertex coordinates of the test picture under the curtain plane coordinate system according to the first conversion matrix M1 and the image vertex coordinates of the test picture area;

s9, determining the plane vertex coordinates of the original projection picture under the curtain plane coordinate system according to the preset scaling and the plane vertex coordinates of the test picture; then determining the plane vertex coordinates of the original projection picture under the curtain plane coordinate system according to the preset scaling and the plane vertex coordinates of the test picture;

s10, determining a second transformation matrix M2 according to the plane vertex coordinates of the original projection picture and the projection vertex coordinates of the original projection picture;

the four projection vertex coordinates of the original projection picture in the projection device coordinate system are (0, 0), (1920, 0), (0, 1080), (1920, 1080), and the second conversion matrix M2 is a conversion matrix for converting the curtain plane coordinate system into the projection device coordinate system;

s11, determining the projection vertex coordinates of the curtain according to the second conversion matrix M2 and the plane vertex coordinates of the curtain;

and S12, the server sends the projection vertex coordinates of the screen under the projection equipment coordinate system to the mobile phone, and then the projection equipment transmits the projection vertex coordinates to the mobile phone, the projection equipment adjusts the projected picture according to the four projection vertex coordinates of the screen, so that the top surface of the adjusted projection picture is aligned with the vertex of the screen, and the automatic screen alignment function can be completed.

For specific limitations of the projection image adjustment method provided in this embodiment, reference may be made to the above step limitations of each embodiment in the projection image adjustment method, and details are not described herein again.

It should be understood that, although the respective steps in the flowcharts attached in the above-described embodiments are sequentially shown as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a part of the steps in the figures attached to the above-mentioned embodiments may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least a part of the steps or stages in other steps.

In an embodiment, as shown in fig. 18, an embodiment of the present application further provides a projection screen adjusting apparatus 1800, where the apparatus 1800 includes: a first obtaining module 1801, a second obtaining module 1802, a determining module 1803, and a first sending module 1804, wherein:

a first obtaining module 1801, configured to obtain an initial captured image sent by a mobile terminal, where the initial captured image is obtained by the mobile terminal by collecting a test picture projected by a projection device on a curtain, and the test picture is formed by scaling an original projection picture by the projection device according to a preset scaling;

a second obtaining module 1802, configured to obtain, according to the initial captured image, an image vertex coordinate of the test picture area and an image vertex coordinate of the curtain area in the image coordinate system;

a determining module 1803, configured to obtain a plane vertex coordinate of the curtain in a plane coordinate system of the curtain and a projection vertex coordinate of the original projection picture in a coordinate system of the projection device, and determine the projection vertex coordinate of the curtain in the coordinate system of the projection device according to the plane vertex coordinate of the curtain, the projection vertex coordinate of the original projection picture, the image vertex coordinate of the test picture area, and the image vertex coordinate of the curtain area;

and the first sending module 1804 is configured to send the projection vertex coordinates of the curtain to the projection device, so that the projection device adjusts the projection picture projected by the projection device according to the projection vertex coordinates of the curtain.

In one embodiment, the second obtaining module 1802 includes:

the preprocessing unit is used for preprocessing the initial shot image to obtain a projection test image;

and the acquisition unit is used for acquiring the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area in the image coordinate system according to the projection test image.

In one embodiment, in the projection test image, pixel values of regions where a boundary line of the test picture region and a boundary line of the curtain region are located are first pixel values, and pixel values of regions where non-boundary lines in the projection test image are located are second pixel values; the first pixel value is greater than the second pixel value.

In one embodiment, the obtaining unit includes:

the first determining subunit is used for sequentially comparing the pixel value of each pixel point in the first preset direction with the first pixel value along the first preset direction by taking the center of the projection test image as an initial point, and determining the boundary point of the test picture area;

and the second determining subunit is used for sequentially comparing the pixel values of the pixel points in the first direction and the second direction of each pixel point in the second preset direction with the second pixel value along the second preset direction by taking the boundary point of the test picture area as an initial point, and determining the image vertex coordinates of the test picture area.

In one embodiment, the obtaining unit includes:

the third determining subunit is used for sequentially comparing the pixel value of each pixel point in the third preset direction with the first pixel value along the third preset direction by taking the image vertex coordinate of the test picture area as an initial point, and determining the boundary point of the curtain area;

and the fourth determining subunit is used for sequentially comparing the pixel values of the pixel points in the third direction and the fourth direction of each pixel point in the fourth preset direction with the second pixel value along the fourth preset direction by taking the boundary point of the curtain area as the initial point, and determining the image vertex coordinates of the curtain area.

In one embodiment, the determining module 1803 includes:

the first determining unit is used for determining a first conversion matrix according to the image vertex coordinates of the curtain area and the plane vertex coordinates of the curtain;

the second determining unit is used for determining plane vertex coordinates of the test picture under the curtain plane coordinate system according to the first conversion matrix and the image vertex coordinates of the test picture area;

the third determining unit is used for determining the plane vertex coordinates of the original projection picture under the curtain plane coordinate system according to the preset scaling and the plane vertex coordinates of the test picture;

the fourth determining unit is used for determining a second conversion matrix according to the plane vertex coordinates of the original projection picture and the projection vertex coordinates of the original projection picture;

and the fifth determining unit is used for determining the projection vertex coordinates of the curtain according to the second conversion matrix and the plane vertex coordinates of the curtain.

As shown in fig. 19, the present application further provides a projection picture adjusting apparatus 1900, which further includes:

an acquisition module 1901, configured to acquire a test picture projected by the projection apparatus on a curtain to obtain an initial shot image, where the test picture is formed by scaling an original projection picture by the projection apparatus according to a preset scaling ratio;

the second sending module 1902 is configured to send the initial captured image to the server, instruct the server to obtain, according to the initial captured image, the image vertex coordinates of the test picture and the image vertex coordinates of the curtain in the image coordinate system, determine, according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area, and the image vertex coordinates of the curtain area, the projection vertex coordinates of the curtain in the projection apparatus coordinate system, and send the projection vertex coordinates of the curtain to the projection apparatus, so that the projection apparatus adjusts the projection picture of the projection apparatus according to the projection vertex coordinates of the curtain.

As shown in fig. 20, the present application further provides a projection picture adjusting apparatus 2000, which further includes:

a projection module 2001, configured to project, on a curtain, a test picture formed by scaling an original projection picture according to a preset scaling;

the receiving module 2002 is configured to receive the projection vertex coordinates of the curtain in the projection device coordinate system sent by the server, and adjust the projection picture of the projection device according to the projection vertex coordinates of the curtain;

the projection vertex coordinates of the curtain are determined by the server according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area after the image vertex coordinates of the test picture and the image vertex coordinates of the curtain under the image coordinate system are obtained according to the initial shooting image; the initial projection picture is obtained by collecting a test picture by the mobile terminal.

For specific limitations of the projection image adjusting apparatus, reference may be made to the above limitations of each step in the projection image adjusting method, which are not described herein again. All or part of each module in the projection picture adjusting device can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a target device, and can also be stored in a memory of the target device in a software form, so that the target device can call and execute operations corresponding to the modules.

In one embodiment, a computer device is provided, as shown in fig. 21, which includes a processor, a memory, a communication interface, a display screen, and an input device connected through a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a projection picture adjustment method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.

It will be appreciated by those skilled in the art that the structural description of the computer apparatus described above is only a part of the structure associated with the present application, and does not constitute a limitation of the computer apparatus to which the present application applies, and a particular computer apparatus may comprise more or less components than those shown in the figures, or may combine certain components, or have a different arrangement of components.

In one embodiment, a computer device is further provided, which includes a memory and a processor, the memory stores a computer program, and the processor implements the steps of the above method embodiments when executing the computer program.

In the steps implemented by the processor in this embodiment, the implementation principle and technical effect are similar to those of the projection picture adjusting method described above, and are not described herein again.

In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.

In the present embodiment, the implementation principle and technical effect of each step implemented when the computer program is executed by the processor are similar to the principle of the projection picture adjusting method, and are not described herein again.

In an embodiment, a computer program product is provided, comprising a computer program which, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.

It should be noted that, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, presented data, etc.) referred to in the present application are information and data authorized by the user or sufficiently authorized by each party.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high-density embedded nonvolatile Memory, resistive Random Access Memory (ReRAM), Magnetic Random Access Memory (MRAM), Ferroelectric Random Access Memory (FRAM), Phase Change Memory (PCM), graphene Memory, and the like. Volatile Memory can include Random Access Memory (RAM), external cache Memory, and the like. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others. The databases referred to in various embodiments provided herein may include at least one of relational and non-relational databases. The non-relational database may include, but is not limited to, a block chain based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, quantum computing based data processing logic devices, etc., without limitation.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.

Claims

1. A method for adjusting a projection picture, the method comprising:

acquiring the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area under an image coordinate system according to the initial shot image;

acquiring plane vertex coordinates of the curtain in a plane coordinate system of the curtain and projection vertex coordinates of the original projection picture in a coordinate system of projection equipment, and determining the projection vertex coordinates of the curtain in the coordinate system of the projection equipment according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area;

and sending the projection vertex coordinates of the curtain to the projection equipment so that the projection equipment adjusts the projection picture projected by the projection equipment according to the projection vertex coordinates of the curtain.

2. The method according to claim 1, wherein the obtaining of the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area in an image coordinate system according to the initial shot image comprises:

preprocessing the initial shot image to obtain a projection test image;

and acquiring the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area in the image coordinate system according to the projection test image.

3. The method according to claim 2, wherein in the projection test image, pixel values of a region where a boundary line of the test picture region and a boundary line of the curtain region are located are all first pixel values, and pixel values of a region where a non-boundary line in the projection test image is located are all second pixel values; the first pixel value is greater than the second pixel value.

4. The method of claim 3, wherein said obtaining image vertex coordinates of said test frame area in said image coordinate system from said projected test image comprises:

sequentially comparing the pixel value of each pixel point in a first preset direction with the first pixel value along the first preset direction by taking the center of the projection test image as an initial point to determine the boundary point of the test picture area;

5. The method of claim 4, wherein obtaining image vertex coordinates of the curtain region in the image coordinate system from the projected test image comprises:

and sequentially comparing pixel values of pixel points in a third direction and a fourth direction of each pixel point in the fourth preset direction with second pixel values along the fourth preset direction by taking the boundary point of the curtain area as an initial point, and determining the image vertex coordinates of the curtain area.

6. The method of claim 1, wherein determining the projection vertex coordinates of the curtain in a projection device coordinate system based on the plane vertex coordinates of the curtain and the projection vertex coordinates of the original projection screen, the image vertex coordinates of the test screen region, and the image vertex coordinates of the curtain region comprises:

determining plane vertex coordinates of the test picture under the curtain plane coordinate system according to the first conversion matrix and the image vertex coordinates of the test picture area;

determining the plane vertex coordinates of the original projection picture under the curtain plane coordinate system according to the preset scaling and the plane vertex coordinates of the test picture;

determining a second conversion matrix according to the plane vertex coordinates of the original projection picture and the projection vertex coordinates of the original projection picture;

7. The method of claim 6, wherein the original projection picture is a projection picture formed when a projection direction of the projection device is perpendicular to the projection curtain.

8. The method of claim 6, wherein the planar vertex coordinates of the test frame are within the curtain area and the planar vertex coordinates of the original projection frame are outside the curtain area.

9. A method for adjusting a projection picture, the method comprising:

collecting a test picture projected by a projection device on a curtain to obtain an initial shot image, wherein the test picture is formed by the projection device scaling an original projection picture according to a preset scaling;

sending the initial shooting image to a server, instructing the server to obtain the image vertex coordinates of the test picture and the image vertex coordinates of the curtain under an image coordinate system according to the initial shooting image, determining the projection vertex coordinates of the curtain under a projection equipment coordinate system according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area, and sending the projection vertex coordinates of the curtain to the projection equipment so that the projection equipment adjusts the projection picture of the projection equipment according to the projection vertex coordinates of the curtain.

10. A method for adjusting a projection picture, the method comprising:

receiving projection vertex coordinates of a curtain under a projection equipment coordinate system sent by a server, and adjusting a projection picture of the projection equipment according to the projection vertex coordinates of the curtain;

the projection vertex coordinates of the curtain are determined by the server according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area after the server obtains the image vertex coordinates of the test picture and the image vertex coordinates of the curtain in an image coordinate system according to the initial shooting image; the initial projection picture is obtained by collecting the test picture by the mobile terminal.

11. An apparatus for adjusting a projection screen, the apparatus comprising:

the device comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring an initial shooting image sent by a mobile terminal, the initial shooting image is obtained by acquiring a test picture projected by a projection device on a curtain by the mobile terminal, and the test picture is formed by scaling an original projection picture by the projection device according to a preset scaling;

the second acquisition module is used for acquiring the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area under an image coordinate system according to the initial shooting image;

the determining module is used for acquiring the plane vertex coordinates of the curtain in a plane coordinate system of the curtain and the projection vertex coordinates of the original projection picture in a projection equipment coordinate system, and determining the projection vertex coordinates of the curtain in the projection equipment coordinate system according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area;

12. An apparatus for adjusting a projection screen, the apparatus comprising:

the device comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a test picture projected by projection equipment on a curtain to obtain an initial shot image, and the test picture is formed by the projection equipment scaling an original projection picture according to a preset scaling;

and the second sending module is used for sending the initial shot image to a server, instructing the server to obtain the image vertex coordinates of the test picture and the image vertex coordinates of the curtain under an image coordinate system according to the initial shot image, determining the projection vertex coordinates of the curtain under a projection equipment coordinate system according to the plane vertex coordinates of the curtain, the projection vertex coordinates of the original projection picture, the image vertex coordinates of the test picture area and the image vertex coordinates of the curtain area, and sending the projection vertex coordinates of the curtain to the projection equipment so that the projection equipment adjusts the projection picture of the projection equipment according to the projection vertex coordinates of the curtain.

13. An apparatus for adjusting a projection screen, the apparatus comprising:

14. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor realizes the steps of the method of any one of claims 1 to 10 when executing the computer program.

15. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 10.

16. A computer program product comprising a computer program, characterized in that the computer program realizes the steps of the method of any one of claims 1 to 10 when executed by a processor.