WO2018129963A1 - 一种显示方法和装置和计算机存储介质 - Google Patents

一种显示方法和装置和计算机存储介质 Download PDF

Info

Publication number
WO2018129963A1
WO2018129963A1 PCT/CN2017/105460 CN2017105460W WO2018129963A1 WO 2018129963 A1 WO2018129963 A1 WO 2018129963A1 CN 2017105460 W CN2017105460 W CN 2017105460W WO 2018129963 A1 WO2018129963 A1 WO 2018129963A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
image
terminal
terminals
screen
Prior art date
Application number
PCT/CN2017/105460
Other languages
English (en)
French (fr)
Inventor
姜伟
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018129963A1 publication Critical patent/WO2018129963A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the present disclosure relates to mobile communication technologies, and more particularly to a display method and apparatus and computer storage medium.
  • the current multi-screen splicing technology solutions mainly have the following three types:
  • the first type utilizes a limit connection buckle on the back panel of the main terminal, a buckle connection from the limit of the mobile terminal, a USB connection line, and the like. To put it simply, the mobile terminal is filled in with a fixed frame, and then each mobile terminal is set to display different contents, thereby ensuring the overall display effect.
  • the method of using the image acquired by the front camera requires the mobile terminal to store the relative relationship between the front camera position information and the screen display position information in advance, and completes each mobile terminal by using an auxiliary positioned checkerboard reference object.
  • the information of the front camera is collected at the same time, and then the position relative information of each mobile terminal is located through position calculation, and then the images sent from the main control unit are respectively displayed by the respective mobile terminals to realize multi-screen splicing.
  • a fixed backplane is required, and multiple mobile terminals must be properly matched with the backplane.
  • the compatibility of the backplane is not good, many mobile terminals cannot be included in the system;
  • the third way is to use the image captured by the front camera to complete the auxiliary positioning. Although no special original is needed, the mobile terminal needs to store the relative relationship between the front camera position information and the screen display position information in advance, and the mobile terminal without the information will Limited, multi-screen stitching is not possible.
  • the embodiments of the present disclosure provide a display method and apparatus, determine the relative positions of the display terminals, and implement screen splicing of each display terminal.
  • the embodiment of the present disclosure provides a display method, in which the display terminals to be spliced are arranged in a set posture, so that the display screens of the display terminals are located on the same plane; the method includes:
  • the main control terminal determines a first display unit composed of display screens of the display terminals according to the third image and the fourth image.
  • the main control terminal respectively acquires the first image and the second image of each display terminal when displaying the first display image by using the first camera and the second camera, including:
  • the main control terminal sends first display data to the display terminals, where the first display data causes the display terminal to display a first display image on a display screen;
  • the master terminal acquires a first image including the display terminals through a first camera, and acquires a second image including the display terminals by using a second camera.
  • the first display image displayed on the display screen by the display terminal includes: a number and a horizontal line located below the number and perpendicular to any of the borders of the display terminal;
  • the main control terminal performs image recognition on the first image and the second image, and extracts two set feature points on the horizontal line from the first image and the second image to determine two settings.
  • a vector in which feature points are connected from left to right, and a vector direction is used as a display direction of a display screen of the display terminal.
  • the method further includes:
  • the master terminal extracts three feature points that are not on the same line from the first image and the second image, and determines a plane of the display screen of the display terminal according to the three feature points.
  • the determining a vector of two set feature points from left to right includes:
  • the main control terminal respectively acquires the third image and the fourth image of each display terminal when the second display image is displayed by using the first camera and the second camera, including:
  • the main control terminal sends second display data to the display terminals, and the second display data causes the display terminal to display a second display image of a single color on the display screen;
  • a third image including the display terminals is acquired by the first camera, and a fourth image including the display terminals is acquired by the second camera.
  • the method further includes:
  • the third position is divided according to the relative position information of the display screen of each display terminal in the first display unit and the proportion of the first display unit. Displaying data, and determining a display direction of each divided third display data on a corresponding display display screen, and transmitting the divided third display data to a display screen of each display terminal to cause the respective displays
  • the display screen of the terminal displays the received divided third display data in the determined display direction, so that the first display unit displays the third display data to form a third display image.
  • the determining, by the main control terminal, the first display unit, which is composed of the display screens of the display terminals, according to the third image and the fourth image includes:
  • the main control terminal performs image recognition on the third image and the fourth image, and acquires coordinate information of the four outermost end points of the display screen of each display terminal arranged in the set posture on the plane And determining, according to the coordinate information, each display screen in the quadrilateral formed by the four outermost end line connections as the first display unit.
  • the main control terminal determines relative position information of the display screens of the display terminals in the first display unit according to the third image and the fourth image, and in the The proportion of a display unit, including:
  • the determining the display direction of each of the divided third display data on the corresponding display display screen, and transmitting the divided third display data to the display screen of each display terminal include:
  • the method includes:
  • the main control terminal displays the third display data, the display direction of the display screen of each display terminal, the relative position information of the display screen of each display terminal in the first display unit, and the a proportion of a display unit is sent to each display terminal;
  • Corresponding display data is determined by each display terminal, and the display direction of the display screen of any of the display terminals is used as a reference direction, and the determined display data is displayed according to the reference direction, so that the first display unit displays the third display data.
  • a third display image is formed.
  • the embodiment of the present disclosure provides a display device, in which the display terminals to be spliced are arranged in a set posture, so that the display screens of the display terminals are located on the same plane; the device includes: a first processing module and a second processing module And a third processing module; wherein
  • the first processing module is configured to acquire, by the first camera and the second camera, respectively, the first image and the second image of each display terminal when the first display image is displayed, and when the second display image is displayed a third image and a fourth image of each display terminal;
  • the second processing module is configured to determine a display direction of the display screen of each display terminal according to the first image and the second image;
  • the third processing module is configured to determine, according to the third image and the fourth image, a first display unit composed of display screens of the display terminals.
  • the first processing module is configured to send first display data to the display terminals, the first display data causing the display terminal to display a first display image on a display screen;
  • the first image including the display terminals is acquired by the first camera, and the second image including the display terminals is acquired by the second camera.
  • the first display image displayed on the display screen by the display terminal includes: a number and a horizontal line located below the number and perpendicular to any of the borders of the display terminal;
  • the second processing module is configured to: perform image recognition on the first image and the second image, and extract two set feature points on the horizontal line from the first image and the second image A vector in which two set feature points are connected from left to right is determined, and the vector direction is used as the display direction of the display screen of the display terminal.
  • the second processing module is configured to extract three feature points that are not on the same line from the first image and the second image, and determine the display of the display terminal according to the three feature points.
  • the plane of the screen is configured to extract three feature points that are not on the same line from the first image and the second image, and determine the display of the display terminal according to the three feature points. The plane of the screen.
  • the second processing module is configured to determine coordinates of the set feature point on the plane, and determine two set feature points from left to right according to coordinates of the set feature point A vector connected to the right, using the vector direction as the display direction of the display screen of the display terminal.
  • the first processing module is configured to: send second display data to the display terminals, where the second display data causes the display terminal to display a second color of a single color on the display screen Display image
  • a third image including the display terminals is acquired by the first camera, and a fourth image including the display terminals is acquired by the second camera.
  • the third processing module is further configured to: determine, according to the third image and the fourth image, a relative position of a display screen of each display terminal in the first display unit Information and the proportion in the first display unit.
  • the apparatus further includes a fourth processing module, and the fourth processing module is configured to determine, after determining the third display data, the first display unit according to the display screen of each display terminal. Separating the third display data by the relative position information in the first display unit and determining the display direction of each of the divided third display data on the corresponding display display screen, and dividing The third display data is sent to the display screen of each display terminal, so that the display screen of each display terminal displays the received divided third display data according to the determined display direction, so that the first display The unit displays the third display data to form a third display image.
  • the third processing module is configured to: the third image and the fourth Performing image recognition on the image, acquiring coordinate information of four endpoints of the outermost periphery of the display screen of each display terminal arranged in a set pose on the plane, and determining, by the coordinate information, forming the four outermost end lines Each display screen in the quadrilateral as the first display unit;
  • the fourth processing module is configured to adjust the display direction of the display screens of the other display terminals and the reference direction by using the display direction of the display screen of any of the display terminals as a reference direction. Consistently; determining, according to the adjusted direction, a display direction of each of the divided third display data on the corresponding display display screen; and transmitting the cut third display data to the display screen of the display terminal.
  • the device further includes a fourth processing module, and the fourth processing module is configured to: after determining the third display data, display the third display data and the display terminals The display direction of the screen, the relative position information of the display screen of each display terminal in the first display unit, and the proportion in the first display unit are sent to each display terminal;
  • Corresponding display data is determined by each display terminal, and the display direction of the display screen of any of the display terminals is used as a reference direction, and the determined display data is displayed according to the reference direction, so that the first display unit displays the third display data.
  • a third display image is formed.
  • Embodiments of the present disclosure also provide a computer storage medium having stored therein one or more programs executable by a computer, the one or more programs being executed by the computer to cause the computer to perform any of the foregoing method.
  • the display terminals to be spliced are arranged in a set posture, so that the display screens of the display terminals are located on the same plane; the main control terminal is respectively obtained by the first camera and the second camera. And including a first image and a second image of each display terminal when the first display image is displayed, and a third image and a fourth image of each display terminal when the second display image is displayed; the main control terminal Determining, according to the first image and the second image, a display direction of the display screen of each display terminal; the main control terminal determining, according to the third image and the fourth image, by each display terminal The first display unit composed of the display screens.
  • the method and apparatus provided by the embodiments of the present disclosure introduce two cameras to collect an image of a display screen of the display terminal, and determine, according to the collected image, a relative position of the display terminal and the main control terminal, and a plane of the display screen of each display terminal.
  • a plurality of display terminals are cooperatively displayed to display the same image or content.
  • FIG. 1 is a schematic flowchart of a display method according to an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of a multi-display terminal splicing according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a first display image according to an embodiment of the present disclosure.
  • FIG. 4 is a schematic diagram of an image display in which display directions are not uniform according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic diagram of a principle of using a dual camera ranging according to an embodiment of the present disclosure
  • FIG. 6 is a schematic flowchart of another display method according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic structural diagram of a display device according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of a display system according to an embodiment of the present disclosure.
  • the display terminals to be spliced are arranged in a set posture, so that the display screens of the display terminals are located on the same plane; the main control terminal respectively acquires the display by the first camera and the second camera. a first image and a second image of each display terminal when the image is first displayed, and a third image and a fourth image of each display terminal when the second display image is displayed; Determining, by the first image and the second image, a display direction of a display screen of each display terminal; the main control terminal determining a display screen by the display terminals according to the third image and the fourth image The first display unit composed.
  • FIG. 1 is a schematic flowchart of a display method according to an embodiment of the present disclosure; as shown in FIG. 1 , display terminals to be spliced are arranged in a set posture, so that display screens of display terminals are located on the same plane; Methods, including:
  • Step 101 The main control terminal acquires, by using the first camera and the second camera, respectively, the first image and the second image of each display terminal when the first display image is displayed, and the Displaying a third image and a fourth image of the terminal;
  • the main control terminal may be a communication terminal with a dual camera, a tablet computer, a computer, etc., or may be a device connected to a dual camera.
  • the display terminal may be a communication terminal, a tablet computer or the like having a display screen and capable of communicating with the main control terminal.
  • the main control terminal stores information of two cameras, including the relative distance between the two cameras, the focal length information of the two cameras, and the like.
  • the master terminal and the display terminal have the same wireless communication protocol, such as Wireless Fidelity (WIFI).
  • WIFI Wireless Fidelity
  • the main control terminal is connected to each display terminal through a wireless communication protocol.
  • the display terminal rows are arranged according to a user's set posture arrangement.
  • the main control terminal can be fixed by the long arm mobile phone bracket and adjusted to monitor the angle of all display terminals, thus determining the relative position of all display terminals and the main control terminal.
  • the connection is established by using the miracast protocol
  • the main control terminal is used as a message source
  • the display terminal is used as a message receiving end.
  • the The master terminal gives each display terminal a unique identifier to convey the accuracy of the information.
  • WIFI wireless network
  • the WIFI address can be used as a unique identifier to identify different display terminals; and each display terminal number, such as A, B, C, ... Z, if exceeded 26 units can be numbered in the style of AA, AB, AC...ZZ.
  • the master terminal acquires, by using the first camera and the second camera, the first image and the second image of each display terminal when the first display image is displayed, including:
  • the main control terminal sends first display data to the display terminals, where the first display data causes the display terminal to display a first display image on a display screen;
  • the master terminal acquires a first image including the display terminals through a first camera, and acquires a second image including the display terminals by using a second camera.
  • the first display image displayed on the display screen by the display terminal includes: a number and a horizontal line located below the number and perpendicular to any of the borders of the display terminal.
  • the first display data may also adopt other data, and it is only required to ensure that the first display image is significantly different from the image before the rotation after being rotated by 180 degrees.
  • the first image and the second image are images respectively captured by the first camera and the second camera, including respective display terminals when the first display image is displayed on the display screen;
  • the first image and the second image each include: a display screen of each display terminal, a first display image on the display screen, and the like; the main control terminal can determine each by identifying the first image and the second image. Displays the display orientation of the display screen of the terminal.
  • the master control terminal respectively acquires, by using the first camera and the second camera, the second display including the display
  • the third image and the fourth image of each display terminal at the time of the image include:
  • the main control terminal sends second display data to the display terminals, and the second display data causes the display terminal to display a second display image of a single color on the display screen;
  • the second display image of the single color may be an image of pure blue or pure red.
  • the third image and the fourth image are images of respective display terminals when the second display image is displayed on the display screen, which are respectively captured by the first camera and the second camera;
  • the third image and the fourth image each include information such as a display screen of each display terminal, a second display image on the display screen, and the like; the main control terminal can determine each by identifying the third image and the fourth image.
  • the total display screen composed of the display screens of the display terminals, and the relative positions, proportions, and the like of the respective display screens on the total display screen.
  • Step 102 The main control terminal determines a display direction of a display screen of each display terminal according to the first image and the second image.
  • the determining, by the main control terminal, the display direction of the display screen of each display terminal according to the first image and the second image including:
  • the main control terminal performs image recognition on the first image and the second image, and extracts two set feature points on the horizontal line from the first image and the second image to determine two settings.
  • a vector in which feature points are connected from left to right, and a vector direction is used as a display direction of a display screen of the display terminal.
  • the image recognition refers to a technique of processing, analyzing, and understanding an image by using a computer to identify targets and objects of various modes.
  • the image recognition software is used to perform recognition processing according to the grayscale difference of the image, such as Cognex, graphic intelligence, and the like.
  • Image recognition is an important field of artificial intelligence. It provides different image recognition models by compiling computer programs that simulate human image recognition activities. For example, when there is a letter A and A template, the size, orientation and shape of the letter A are similar to the A template, and the features of the letter A and the letter A can be identified.
  • the method further includes:
  • the master terminal extracts three feature points that are not on the same line from the first image and the second image, and determines a coordinate system of a plane of the display screen of the display terminal according to the three feature points.
  • the determining the vector of the two set feature points from left to right includes:
  • the main control terminal can determine the display direction of the display screen of each display terminal.
  • the main control terminal sends the first display data to any one of the display terminals, and is recorded as the A terminal.
  • the display screen of the A terminal displays an image according to the first display data, and the dual camera of the main control terminal is in the field of view. Start searching if there is a view based on the first displayed image. If the corresponding first display image cannot be found within the unit time (the unit time can be 2 seconds), the system is considered to be faulty, and the user is prompted to send the first display data of the A terminal through the human-machine interaction interface, but the A cannot be found. No. terminal; if the image of terminal A can be normally recognized in unit time, the relative position of the current terminal A is determined according to the display condition.
  • the first display image of the terminal A uses the first display image of the terminal A to determine the first display image, such as the apex of the letter A and the center of the two feet, and the spatial coordinates of the three points are determined by the spatial positioning function of the dual camera. Then, using 3 points to determine the principle of a plane, determine the plane of the display terminal.
  • the plane is the plane where all the display terminals are located, and the positioning information of the subsequent display terminals is added on the information of the plane.
  • the display direction of terminal A can be used as the reference direction.
  • the method for determining the reference direction may include: obtaining, by the first camera and the second camera, a spatial position of two points laterally left and right below the letter A; and a direction from the left point to the right point as the X axis of the XY plane coordinate system In the positive direction, the left point is used as the origin of the display plane coordinate system.
  • Step 103 The main control terminal determines, according to the third image and the fourth image, a first display unit composed of display screens of the display terminals.
  • the determining, by the main control terminal, the first display unit, which is composed of the display screens of the display terminals, according to the third image and the fourth image includes:
  • the main control terminal performs image recognition on the third image and the fourth image, and acquires four endpoints of the outermost periphery of the display screen of each display terminal arranged in a set pose, and the outermost four Each display screen in the quadrilateral formed by the end point connection is used as the first display unit;
  • the first display unit is a screen after the display screen of each display terminal is spliced
  • the method further includes:
  • the master terminal performs image recognition on the third image and the fourth image, and determines end points of the four corners of the display screen of the display terminal according to the third image and the fourth image.
  • the coordinate information on the plane determines the relative position information of the quadrilateral formed by the end points of the four corners in the first display unit and the proportion in the first display unit according to the coordinate information.
  • the master terminal can send an image of a single color (eg, pure blue) to each display terminal, and then use dual camera positioning to detect the coordinates of the four corners of the pure blue region where the display terminal is located. Therefore, the display screen of the display terminal is determined according to the coordinates of the four corners, and in order to avoid errors, such as the problem that the display area is not accurately calculated due to the blue background around the display terminal, after the blue image is positioned, it is also available. Other monochrome (pure green, pure red, etc.) images are positioned, and the results of multiple positioning are combined to determine the display screen to ensure that it is not disturbed by the background color.
  • a single color eg, pure blue
  • the main control terminal determines, according to the third image and the fourth image, relative position information of the display screen of each display terminal in the first display unit and the first display unit.
  • the method may further include:
  • the third position is divided according to the relative position information of the display screen of each display terminal in the first display unit and the proportion of the first display unit. Displaying data, and determining a display direction of each divided third display data on a corresponding display display screen, and transmitting the divided third display data to a display screen of each display terminal to cause the respective displays
  • the display screen of the terminal displays the received divided third display data in the determined display direction, so that the first display unit displays the third display data to form a third display image.
  • the determining the display direction of each of the divided third display data on the display screen corresponding to the display, and transmitting the divided third display data to the display screen of each display terminal including:
  • the final stitched image may be misaligned if the transmitted image does not consider the display direction.
  • the method may further include:
  • the main control terminal displays the third display data, the display direction of the display screen of each display terminal, the relative position information of the display screen of each display terminal in the first display unit, and the a proportion of a display unit is sent to each display terminal;
  • Corresponding display data is determined by each display terminal, and the display direction of the display screen of any of the display terminals is used as a reference direction, and the determined display data is displayed according to the reference direction, so that the first display unit displays the third display data.
  • a third display image is formed.
  • FIG. 2 is a schematic diagram of splicing of a multi-display terminal according to an embodiment of the present disclosure; as shown in FIG. 2, if a user needs to cooperate to display an image or cooperatively play a video by using a plurality of display terminals, a plurality of display terminals may be flattened. After being arranged on a table and arranged in a set posture, each display terminal is spliced to obtain a whole display area, that is, a first display unit, and the first display unit can be set to display a whole image.
  • the main control terminal communicates with each display terminal, and the main control terminal sends the first display data and the second display data to all the display terminals, and the main control terminal passes the dual camera's shooting display terminal, and utilizes the dual camera's ranging function. Calculate the relative position of each display terminal, the display direction of the display screen of the display terminal, and test the area of the display screen of each display terminal, thereby determining the precise position and direction of all display terminals.
  • FIG. 3 is a schematic diagram of a first display image according to an embodiment of the present disclosure; as shown in FIG. 3, the figure includes a number and a horizontal line; the image may be used for a letter that is indistinguishable after being rotated by 180 degrees such as "O". To determine the display direction, there is no requirement for the numbered content of the image.
  • the main control terminal performs image analysis on the first image and the second image obtained after the first display image is captured, and extracts feature points, such as the vertices of the letter A and the points of the two feet; and the spatial positioning function of the dual camera determines 3 The spatial coordinates of the points.
  • the specific method may include: extracting any three points, determining the coordinates of the three points, determining a plane according to the coordinates of the three points; extracting any two points on the horizontal line, determining the coordinates of the two points, and constructing the coordinates according to the two points In the XY plane coordinate system, set one of them to the coordinate origin to determine the positive direction of the X axis.
  • FIG. 4 is a schematic diagram of image display in which display directions are not uniform according to an embodiment of the present disclosure.
  • the X axis of the plane coordinate system may be the positive direction, and when the direction of the image displayed by the other display terminals is different from the positive direction of the X axis, the corresponding angle is calculated, and the angle value is used.
  • the image is rotated by the corresponding angle, and the angle is the angle, and the cut image is rotated correspondingly, so that the projected content does not cause the partial image display image to be reversed.
  • each display terminal receives and displays the image that it receives, and finally presents the effect to the user. That is, the same image is displayed after all the display terminals are spliced; if the video is to be displayed, the actual processing method can repeat the process of cutting, rotating, and transmitting the image of each frame to realize the display of the video effect.
  • content such as PPT can also be displayed in the spliced display area by the above process of image cutting, rotation, and transmission.
  • the main control terminal can turn off the dual camera and stop monitoring each display terminal.
  • the main control terminal does not need to be fixed on the bracket, and can move the position arbitrarily; or can continue to monitor without closing the dual camera.
  • the display terminal can reposition the dual camera if there is a large displacement of the display terminal.
  • repositioning can be performed only for one display terminal that moves, without affecting the playback process of other display terminals. In this way, for the displacement processing of a single display terminal during playback, the burst processing capability of the system during smooth operation is improved, and the problem of requiring full re-initialization after an accident is avoided.
  • the main control terminal starts the initialization process of the individual display terminals according to the adjusted display terminal, so that the operation can not affect the running fluency of the entire system.
  • a new display terminal may be added.
  • only the initialization process for the new display terminal is required, including: determining the display direction, display range, and relative of the display screen of the new display terminal. Location and so on.
  • the main control terminal determines the display area of each display terminal according to the newly added display terminal, performs image cutting, rotation, and transmission, and displays the image by the first display unit spliced by each display terminal including the new display terminal.
  • the zoom of the screen display can still be adjusted at any time while the system is running.
  • the algorithm may include but is not limited to the following three types:
  • the display terminal has all the images: the display area of all display terminals is required to have a screen display;
  • 80% of the content of the center is completely displayed: 80% of the center is determined, and the 4 corners corresponding to 80% of the center need to be fully displayed on the display terminal.
  • the relative position of the feature point in the space relative to the camera group can be determined by using the relative distance of the two cameras, the parallax of the independent imaging between the feature points, and the focal length information of the camera at that time.
  • FIG. 5 is a schematic diagram of the principle of using a dual camera ranging method according to an embodiment of the present disclosure; as shown in FIG. 5, the dual camera is specifically used, and the first camera and the second camera are used to perform spatial positioning, and the dual cameras are on the same horizontal plane. At the same time, an object is photographed, here denoted by P, and the first figure and the second figure are respectively obtained.
  • P l and P r are respectively obtained on the first figure and the second figure obtained by the shooting, and these two points form a plane coordinate with respect to the center point of the figure.
  • the algorithm calculates the relative position of point P relative to the dual camera group; the relative position here can be represented by a three-dimensional coordinate system, and the plane composed of the X-axis and the Y-axis in the three-dimensional coordinate system is the display plane.
  • the relative position of each display terminal relative to the main control terminal can be determined by the above method.
  • FIG. 6 is a schematic flowchart of another display method according to an embodiment of the present disclosure; as shown in FIG. 6, the method includes:
  • Step 601 After all display terminals are connected to the main control terminal, the main control terminal sets a number for each display terminal.
  • Step 602 Each display terminal is arranged in a set posture, and the dual cameras of the main control terminal are fixed to ensure that the dual cameras can capture the respective display terminals;
  • Step 603 The main control terminal sends the first display data to the display terminal, and the display terminal enters an initialization process.
  • Step 604 The master terminal determines whether the image displayed by the display terminal according to the first display data can be detected, and if the image can be detected, the process proceeds to step 606, and if the image cannot be detected, the process proceeds to step 605;
  • Step 605 Give the user a prompt, for example, "the image is not found, please confirm that the camera of the master terminal can cover all display terminals", return to step 602;
  • Step 606 The master terminal acquires a first image that includes the display terminals by using a first camera, acquires a second image that includes the display terminals by using a second camera, and uses feature information of the first image and the second image. Complete the coordinate system of the display plane;
  • Step 607 Determine a display direction of display screens of all display terminals, and display a relative position of the terminal;
  • Step 608 The main control terminal sends second display data to the display terminals, where the second display number
  • the display terminal is configured to display a second display image of a single color on the display screen;
  • the main control terminal acquires a third image including the display terminals through the first camera, and acquires the inclusion by the second camera a fourth image of each display terminal;
  • the main control terminal determines display areas of all display terminals according to the third image and the fourth image, thereby determining a first display unit that is spliced by the respective display terminals;
  • Step 609 The main control terminal performs matching of the display range between the first display unit and the original image, and determines content that needs to be displayed on the display screen of each display terminal.
  • Step 610 The main control terminal completes the cutting of the third display data, and sends it to each corresponding display terminal, and the display of the corresponding image is completed by each display terminal.
  • Step 611 At this point, the display of the same screen can be completed by using a plurality of display terminals.
  • FIG. 7 is a schematic structural diagram of a display device according to an embodiment of the present disclosure; as shown in FIG. 7 , each display terminal to be spliced is arranged in a set posture, so that display screens of the display terminals are located on the same plane, and the device is The first processing module 701, the second processing module 702, and the third processing module 703;
  • the first processing module 701 is configured to acquire, by using the first camera and the second camera, the first image and the second image of each display terminal when the first display image is displayed, and when the second display image is displayed a third image and a fourth image of each display terminal;
  • the first processing module 701 is configured to send first display data to the display terminals, where the first display data causes the display terminal to display a first display image on a display screen;
  • the first image including the display terminals is acquired by the first camera, and the second image including the display terminals is acquired by the second camera.
  • the first processing module 701 is configured to send second display data to the display terminals, where the second display data causes the display terminal to display a second display image of a single color on the display screen;
  • the first image and the second image are images respectively captured by the first camera and the second camera including respective display terminals when the first display image is displayed on the display screen; by identifying the first image and the second image The image can determine the display direction of the display screen of each display terminal.
  • the third image and the fourth image are images of respective display terminals when the second display image is displayed on the display screen, which are respectively captured by the first camera and the second camera; by identifying the third image and the The four images may determine a total display screen composed of display screens of the respective display terminals, and each display screen is in the The relative position, proportion, etc. on the screen are always displayed.
  • the dual camera can be used for spatial positioning, and the dual cameras are on the same horizontal surface, and an object is photographed at the same time, and the image is positioned according to the captured image. Therefore, the information of the dual camera may be stored in the device, including: a relative distance between the first camera and the second camera, focal length information of the first camera and the second camera, and the like.
  • the second processing module 702 is configured to determine a display direction of the display screen of each display terminal according to the first image and the second image;
  • the first display image displayed on the display screen by the display terminal includes: a number and a horizontal line located below the number and perpendicular to any frame of the display terminal;
  • the second processing module 702 is configured to perform image recognition on the first image and the second image, and extract two set feature points on the horizontal line from the first image and the second image A vector in which two set feature points are connected from left to right is determined, and the vector direction is used as the display direction of the display screen of the display terminal.
  • the second processing module 702 is configured to extract three feature points that are not on the same line from the first image and the second image, and determine a display screen of the display terminal according to the three feature points. flat.
  • the second processing module 702 is configured to determine coordinates of the set feature point on the plane, and determine two set feature points from left to right according to the coordinates of the set feature point.
  • the vector is obtained by using the vector direction as the display direction of the display screen of the display terminal.
  • the third processing module 703 is configured to determine, according to the third image and the fourth image, a first display unit composed of display screens of the display terminals.
  • the third processing module 703 is configured to perform image recognition on the third image and the fourth image, and acquire the outermost four of the display screens of the display terminals arranged in the set posture.
  • the coordinate information of the endpoints on the plane determines, according to the coordinate information, each display screen in the quadrilateral formed by the four outermost end-end lines as the first display unit.
  • the third processing module 703 is further configured to determine relative position information of the display screens of the display terminals in the first display unit according to the third image and the fourth image, and The proportion of the first display unit.
  • the third processing module 703 is configured to determine coordinate information of the endpoints of the four corners of the display screen of the display terminal on the plane, and determine that the quadrilateral formed by the four corners of the four corners is first according to the coordinate information. Relative position information in the display unit and a proportion in the first display unit.
  • the device further includes: the fourth processing module 704;
  • the fourth processing module 704 is configured to: according to the relative position information of the display screen of each display terminal in the first display unit and the first display unit, after determining the third display data Dividing the third display data into a ratio, and determining a display direction of each of the divided third display data on a corresponding display display screen, and transmitting the divided third display data to a display screen of each display terminal And displaying, by the display screen of each display terminal, the received divided third display data according to the determined display direction, so that the first display unit displays the third display data to form a third display image.
  • the fourth processing module 704 is configured to adjust the display direction of the display screens of the other display terminals to the reference direction by using the display direction of the display screen of any of the display terminals as a reference direction; And determining, according to the adjusted direction, a display direction of each of the divided third display data on the corresponding display display screen; and transmitting the third display data after the cutting to the display screen of the display terminal.
  • the fourth processing module 704 may be further configured to: after determining the third display data, display the third display data, the display direction of the display screen of each display terminal, and the display screen of each display terminal The relative position information in the first display unit and the proportion in the first display unit are sent to each display terminal;
  • Corresponding display data is determined by each display terminal, and the display direction of the display screen of any of the display terminals is used as a reference direction, and the determined display data is displayed according to the reference direction, so that the first display unit displays the third display data.
  • a third display image is formed.
  • FIG. 8 is a schematic structural diagram of a display system according to an embodiment of the present disclosure; as shown in FIG. 8 , the system includes: a display device, a wireless transmission module 811, a dual camera module 812, a setting module 813, and a storage module 814;
  • the display device the device shown in FIG. 7 can be used, and details are not described herein;
  • the wireless transmission module 811 is configured to connect to each display terminal, and transmit first display data, second display data, third display data, and the like;
  • the dual camera module 812 includes two cameras configured to capture respective display terminals
  • the storage module 814 is configured to save data in the calculation process, related information of the dual camera, and record the preference setting of the user;
  • the setting module 813 is configured to set a user's preference; the preference includes: an equal scaling algorithm.
  • the related information of the dual camera includes: a relative distance between two cameras, focal length information of two cameras, and the like.
  • the display device is the same as the display device provided in the above embodiments, and details are not described herein.
  • embodiments of the present disclosure can be provided as a method, system, or computer program product. Accordingly, the present disclosure may take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware aspects. Moreover, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • the display terminals to be spliced are arranged in a set posture, so that the display screens of the display terminals are located on the same plane; the main control terminal respectively acquires the first display including the display through the first camera and the second camera.
  • the main control terminal respectively acquires the first display including the display through the first camera and the second camera.
  • Each of the images Displaying a first image and a second image of the terminal, and including a third image and a fourth image of each display terminal when the second display image is displayed; the main control terminal according to the first image and the second image
  • the image determines a display direction of the display screen of each display terminal; the main control terminal determines a first display unit composed of display screens of the display terminals according to the third image and the fourth image.
  • the method and apparatus provided by the embodiments of the present disclosure introduce two cameras to collect an image of a display screen of the display terminal, and determine, according to the collected image, a relative position of the display terminal and the main control terminal, and a plane of the display screen of each display terminal.
  • a plurality of display terminals are cooperatively displayed to display the same image or content.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种显示方法及显示装置，方法包括：主控终端通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像（101）；所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向（102）；所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元（103）。

Description

一种显示方法和装置和计算机存储介质 技术领域
本公开涉及移动通信技术，尤其涉及一种显示方法和装置和计算机存储介质。
背景技术
掌上屏幕时代，让越来越多的移动终端出现在人们的生活中，多屏拼接技术的出现更加丰富移动终端的交互方式，有力的推进移动终端用户的体验度。
目前的多屏拼接技术方案的主要有以下三种：
第一种，利用一张背板上面有主终端的限位连接卡扣，从移动终端的限位连接卡扣，USB连接线等。简单来说，就是利用一个固定框架将移动终端填充进去，再设置每个移动终端显示不同的内容，从而保证整体的显示效果。
第二种，不需要利用上述的背板，通过移动终端侧边自带的连接装置，完成多个移动终端之间的连接；再根据不同的连接触点传输对应的数据，完成多个移动终端屏幕之间的定位与通讯。
第三种，利用前摄像头采集的图像的方式；这种方式需要移动终端事先存储好前摄像头位置信息与屏幕显示位置信息的相对关系，利用一个辅助定位的棋盘格参考物，来完成各个移动终端的前摄像头的信息同时采集，然后经过位置计算定位各个移动终端相对位置的信息，再由各个移动终端分别显示从主控机发来的图像，实现多屏拼接。
上述三种方法分别具有以下缺陷：
第一种方式，需要固定的背板，多个移动终端必须与这个背板都有需要恰当的匹配进去，当背板的兼容性不好时，很多移动终端都不能纳入系统中；
第二种方式，只有特定的具有侧边连接装置的移动终端才能实现多屏拼接，应用场景大为受限；
第三种方式，利用前摄像头采集的图像来完成辅助定位，虽然无需特殊原件，但需要移动终端事先存储好前摄像头位置信息与屏幕显示位置信息的相对关系，对于没有这些信息的移动终端就会受限，不能进行多屏拼接。
发明内容
为解决现有存在的技术问题，本公开实施例提供一种显示方法和装置，确定各显示终端的相对位置，实现各显示终端的屏幕拼接。
本公开实施例提供了一种显示方法，待拼接的各显示终端以设定位姿排列，使各显示终端的显示屏幕位于同一平面上；所述方法包括：
主控终端通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像；
所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向；
所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元。
根据一示例性实施例，所述主控终端通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，包括：
所述主控终端向所述各显示终端发送第一显示数据，所述第一显示数据使所述显示终端在显示屏幕上显示第一显示图像；
所述主控终端通过第一摄像头获取包含所述各显示终端的第一图像，通过第二摄像头获取包含所述各显示终端的第二图像。
根据一示例性实施例，所述显示终端在显示屏幕上显示的第一显示图像，包括：编号和位于所述编号下方且垂直于显示终端的任一边框的横线；
所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向，包括：
所述主控终端对所述第一图像和所述第二图像进行图像识别，从所述第一图像和第二图像上提取所述横线上的两个设定特征点，确定两个设定特征点从左至右连成的向量，向量方向作为所述显示终端的显示屏幕的显示方向。
根据一示例性实施例，所述主控终端对所述第一图像和所述第二图像进行图像识别之后，还包括：
所述主控终端从所述第一图像和第二图像上提取不在同一直线上的三个特征点，根据三个特征点确定所述显示终端的显示屏幕的平面。
根据一示例性实施例，所述确定两个设定特征点从左至右连成的向量，包括：
确定所述设定特征点在所述平面上的坐标，根据所述设定特征点的坐标确定两个设定特征点从左至右连成的向量，将向量方向作为所述显示终端的显示屏幕的显示方向。
根据一示例性实施例，所述主控终端通过第一摄像头和第二摄像头分别获取包含显示第二显示图像时的所述各显示终端的第三图像和第四图像，包括：
所述主控终端向所述各显示终端发送第二显示数据，所述第二显示数据使所述显示终端在显示屏幕上显示单一颜色的第二显示图像；
通过第一摄像头获取包含所述各显示终端的第三图像，通过第二摄像头获取包含所述各显示终端的第四图像。
根据一示例性实施例，所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元之后，所述方法还包括：
所述主控终端根据所述第三图像和所述第四图像确定所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例；
所述主控终端确定第三显示数据后，根据所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例分割所述第三显示数据，并确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向，将分割后的第三显示数据向所述各显示终端的显示屏幕发送，使所述各显示终端的显示屏幕按所确定的显示方向显示所接收的分割后的第三显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
根据一示例性实施例，所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元，包括：
所述主控终端对所述第三图像和所述第四图像进行图像识别，获取以设定位姿排列的各显示终端的显示屏幕的最外围的四个端点在所述平面上的坐标信息，根据坐标信息确定所述最外围的四个端点连线形成的四边形内的各显示屏幕作为所述第一显示单元。
根据一示例性实施例，所述主控终端根据所述第三图像和所述第四图像确定所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例，包括：
确定所述显示终端的显示屏幕的四角的端点在所述平面上的坐标信息，根据坐标信息确定四角的端点连线形成的四边形在第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
根据一示例性实施例，所述确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向，将分割后的第三显示数据向所述各显示终端的显示屏幕发送，包括：
以任一所述显示终端的显示屏幕的显示方向为基准方向，将其他显示终端的显示屏幕的显示方向与所述基准方向调整一致；根据调整后的方向确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向；将切割后的第三显示数据向所述显示终端的显示屏幕发送。
根据一示例性实施例，所述主控终端确定第三显示数据之后，所述方法包括：
所述主控终端将所述第三显示数据、所述各显示终端的显示屏幕的显示方向、所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例发送给各显示终端；
由各显示终端确定对应的显示数据，以任一所述显示终端的显示屏幕的显示方向为基准方向，按所述基准方向显示确定的显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
本公开实施例提供了一种显示装置，待拼接的各显示终端以设定位姿排列，使各显示终端的显示屏幕位于同一平面上；所述装置包括：第一处理模块、第二处理模块和第三处理模块；其中，
所述第一处理模块，设置为通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像；
所述第二处理模块，设置为根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向；
所述第三处理模块，设置为根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元。
根据一示例性实施例，所述第一处理模块，设置为向所述各显示终端发送第一显示数据，所述第一显示数据使所述显示终端在显示屏幕上显示第一显示图像；
通过第一摄像头获取包含所述各显示终端的第一图像，通过第二摄像头获取包含所述各显示终端的第二图像。
根据一示例性实施例，所述显示终端在显示屏幕上显示的第一显示图像，包括：编号和位于所述编号下方且垂直于显示终端的任一边框的横线；
所述第二处理模块，设置为：对所述第一图像和所述第二图像进行图像识别，从所述第一图像和第二图像上提取所述横线上的两个设定特征点，确定两个设定特征点从左至右连成的向量，向量方向作为所述显示终端的显示屏幕的显示方向。
根据一示例性实施例，所述第二处理模块，设置为从所述第一图像和第二图像上提取不在同一直线上的三个特征点，根据三个特征点确定所述显示终端的显示屏幕的平面。
根据一示例性实施例，所述第二处理模块，设置为确定所述设定特征点在所述平面上的坐标，根据所述设定特征点的坐标确定两个设定特征点从左至右连成的向量，将向量方向作为所述显示终端的显示屏幕的显示方向。
根据一示例性实施例，所述第一处理模块，设置为：向所述各显示终端发送第二显示数据，所述第二显示数据使所述显示终端在显示屏幕上显示单一颜色的第二显示图像；
通过第一摄像头获取包含所述各显示终端的第三图像，通过第二摄像头获取包含所述各显示终端的第四图像。
根据一示例性实施例，所述第三处理模块，还设置为：根据所述第三图像和所述第四图像确定所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
根据一示例性实施例，所述装置，还包括第四处理模块；所述第四处理模块，设置为确定第三显示数据后，根据所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例分割所述第三显示数据，并确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向，将分割后的第三显示数据向所述各显示终端的显示屏幕发送，使所述各显示终端的显示屏幕按所确定的显示方向显示所接收的分割后的第三显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
根据一示例性实施例，所述第三处理模块，设置为：对所述第三图像和所述第四 图像进行图像识别，获取以设定位姿排列的各显示终端的显示屏幕的最外围的四个端点在所述平面上的坐标信息，根据坐标信息确定所述最外围的四个端点连线形成的四边形内的各显示屏幕作为所述第一显示单元；
确定所述显示终端的显示屏幕的四角的端点在所述平面上的坐标信息，根据坐标信息确定四角的端点连线形成的四边形在第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
根据一示例性实施例，所述第四处理模块，设置为：以任一所述显示终端的显示屏幕的显示方向为基准方向，将其他显示终端的显示屏幕的显示方向与所述基准方向调整一致；根据调整后的方向确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向；将切割后的第三显示数据向所述显示终端的显示屏幕发送。
根据一示例性实施例，所述装置，还包括第四处理模块；所述第四处理模块，设置为：确定第三显示数据后，将所述第三显示数据、所述各显示终端的显示屏幕的显示方向、所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例发送给各显示终端；
由各显示终端确定对应的显示数据，以任一所述显示终端的显示屏幕的显示方向为基准方向，按所述基准方向显示确定的显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
本公开实施例还提供一种计算机存储介质，所述计算机存储介质中存储有计算机可执行的一个或多个程序，所述一个或多个程序被所述计算机执行时使所述计算机执行任意前述方法。
本公开实施例所提供的显示方法和装置，待拼接的各显示终端以设定位姿排列，使各显示终端的显示屏幕位于同一平面上；主控终端通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像；所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向；所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元。本公开实施例提供的方法和装置，引入两个摄像头采集显示终端的显示屏幕的图像，根据采集的图像确定显示终端与所述主控终端相对位置、所述各显示终端的显示屏幕的平面，实现多个显示终端合作显示同一图像或内容。
附图说明
图1为本公开实施例提供的一种显示方法流程示意图；
图2为本公开实施例提供的一种多显示终端拼接的示意图；
图3为本公开实施例提供的一种第一显示图像的示意图；
图4为本公开实施例提供的显示方向不统一的图像显示示意图，
图5为本公开实施例提供的利用双摄像头测距原理的示意图；
图6为本公开实施例提供的另一种显示方法流程示意图；
图7为本公开实施例提供的一种显示装置结构示意图；
图8为本公开实施例提供的一种显示系统结构示意图。
具体实施方式
在本公开的各种实施例中，待拼接的各显示终端以设定位姿排列，使各显示终端的显示屏幕位于同一平面上；主控终端通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像；所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向；所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元。
下面结合实施例对本公开再作详细的说明。
图1为本公开实施例提供的一种显示方法流程示意图；如图1所示，待拼接的各显示终端以设定位姿排列，使各显示终端的显示屏幕位于同一平面上；所述显示方法，包括：
步骤101：主控终端通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像；
可选地，所述主控终端可以是具有双摄像头的通信终端、平板电脑、计算机等，也可以是连接双摄像头的设备。
所述显示终端可以是具有显示屏幕并能够与所述主控终端进行通信的通信终端、平板电脑等设备。
所述主控终端中保存有两个摄像头的信息，包括两个摄像头之间的相对距离，两个摄像头的焦距信息等。
所述主控终端和显示终端具有相同的无线通讯协议，如无线保真(WIFI)等。通过无线通讯协议，主控终端与各个显示终端连接。
所述显示终端排根据用户的设定位姿排列进行排列。主控终端可以通过长臂手机支架固定起来，调整到可以监控到所有显示终端的角度，这样就确定所有显示终端与主控终端的空间相对位置。
在本公开实施例中，使用miracast协议建立连接，所述主控终端作为消息发送(source)端，显示终端作为消息接收(sink)端，多台显示终端与主控终端建立连接时，所述主控终端给各个显示终端一个唯一的标识符，以便传输信息的准确性。这里，使用无线网(WIFI，WIreless-Fidelity)连接，可以用WIFI地址作为唯一标识符，来标识不同的显示终端；还可以为各个显示终端编号，如A，B，C……Z，如果超过26台，可以用AA、AB、AC……ZZ的样式继续编号。
可选地，所述主控终端通过第一摄像头和第二摄像头获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，包括：
所述主控终端向所述各显示终端发送第一显示数据，所述第一显示数据使所述显示终端在显示屏幕上显示第一显示图像；
所述主控终端通过第一摄像头获取包含所述各显示终端的第一图像，通过第二摄像头获取包含所述各显示终端的第二图像。
所述显示终端在显示屏幕上显示的第一显示图像，包括：编号和位于所述编号下方且垂直于显示终端的任一边框的横线。
所述第一显示数据还可以采用其他数据，只需保证所述第一显示图像在旋转180度后与旋转前的图像存在明显区别即可。
所述第一图像和所述第二图像为分别由第一摄像头和第二摄像头拍摄的包括显示屏幕上显示第一显示图像时的各个显示终端的图像；
这里，所述第一图像和所述第二图像，均包括：各显示终端的显示屏幕、显示屏幕上的第一显示图像等信息；主控终端通过识别第一图像和第二图像可以确定各个显示终端的显示屏幕的显示方向。
可选地，所述主控终端通过第一摄像头和第二摄像头分别获取包含显示第二显示 图像时的所述各显示终端的第三图像和第四图像，包括：
所述主控终端向所述各显示终端发送第二显示数据，所述第二显示数据使所述显示终端在显示屏幕上显示单一颜色的第二显示图像；
通过所述第一摄像头获取包含所述各显示终端的第三图像，通过所述第二摄像头获取包含所述各显示终端的第四图像。
这里，所述单一颜色的第二显示图像，可以是纯蓝色、纯红色等图像。
所述第三图像和所述第四图像为分别由第一摄像头和第二摄像头拍摄的包括在显示屏幕上显示第二显示图像时的各个显示终端的图像；
这里，所述第三图像和所述第四图像，均包括：各显示终端的显示屏幕、显示屏幕上的第二显示图像等信息；主控终端通过识别第三图像和第四图像可以确定各个显示终端的显示屏幕组成的总显示屏幕，及各个显示屏幕在所述总显示屏幕上的相对位置、所占比例等。
步骤102：所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向；
可选地，所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向，包括：
所述主控终端对所述第一图像和所述第二图像进行图像识别，从所述第一图像和第二图像上提取所述横线上的两个设定特征点，确定两个设定特征点从左至右连成的向量，向量方向作为所述显示终端的显示屏幕的显示方向。
需要说明的是，所述图像识别，是指利用计算机对图像进行处理、分析和理解，以识别各种不同模式的目标和对像的技术。一般采用摄像头拍摄图像后，利用图像识别软件根据图像灰阶差做识别处理，图像识别软件例如：康耐视、图智能等。图像识别是人工智能的一个重要领域，通过编制模拟人类图像识别活动的计算机程序，提供不同的图像识别模型。举例来说，当有一个字母A和A模板，字母A的大小、方位、形状都与A模板相似，字母A及字母A的特征均可被识别。
可选地，所述主控终端对所述第一图像和所述第二图像进行图像识别之后，所述方法还包括：
所述主控终端从所述第一图像和第二图像上提取不在同一直线上的三个特征点，根据三个特征点确定所述显示终端的显示屏幕的平面的坐标系。
这里，所述确定两个设定特征点从左至右连成的向量，包括：
确定所述设定特征点在所述平面上的坐标，根据所述设定特征点的坐标确定两个设定特征点从左至右连成的向量，将向量方向作为所述显示终端的显示屏幕的显示方向。
通过步骤102，所述主控终端即可确定各个显示终端的显示屏幕的显示方向。
举例来说，所述主控终端发送第一显示数据给任意一个显示终端，记做A号终端，A号终端的显示屏幕根据第一显示数据显示图像，主控终端的双摄像头在视野范围内开始搜索是否有根据第一显示图像在视野中。单位时间(所述单位时间可以为2秒)内无法找到对应的第一显示图像，则认为系统出现故障，通过人机交互界面提示用户“已经发送A号终端第一显示数据，但是无法找到A号终端”；如果单位时间内可以正常识别到A号终端的图像，则根据显示情况确定当前A号终端的相对位置。利用A号终端的第一显示图像，在第一显示图像上找到3个特征点，比如字母A的顶点与两个底脚的中心，利用双摄像头的空间定位功能，确定3个点的空间坐标，再利用3点确定一个平面的原理，确定出显示终端的平面。该平面即为所有显示终端所在的平面，后续的显示终端的定位信息均在该平面的信息上添加。
A号终端的显示方向，可以用作基准方向。确定所述基准方向的方法可以包括：通过第一摄像头和第二摄像头获得字母A下方横向左右两个点的空间位置；从左边点指向右边点的方向，把它作为XY平面坐标系的X轴正方向，左边点就作为显示平面坐标系的原点。
步骤103：所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元。
可选地，所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元，包括：
所述主控终端对所述第三图像和所述第四图像进行图像识别，获取以设定位姿排列的各显示终端的显示屏幕的最外围的四个端点，将所述最外围的四个端点连线形成的四边形内的各显示屏幕作为第一显示单元；
这里，所述第一显示单元即为各显示终端的显示屏幕拼接后的屏幕；
可选地，步骤103之后，所述方法还包括：
所述主控终端根据所述第三图像和所述第四图像确定所述各显示终端的显示屏 幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
具体来说，所述主控终端对所述第三图像和所述第四图像进行图像识别，根据所述第三图像和所述第四图像确定所述显示终端的显示屏幕的四角的端点在所述平面上的坐标信息，根据坐标信息确定四角的端点连线形成的四边形在第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
举例来说，所述主控终端可以发送单一颜色(如：纯蓝色)的图像给各个显示终端，再利用双摄像头定位，检测到显示终端所在位置的纯蓝色区域的四个角的坐标，从而根据四个角的坐标确定显示终端的显示屏幕，为了避免误差，比如显示终端的周围本身有蓝色背景而导致的显示区域计算不准的问题，在蓝色的图像定位后，还可用其他单色(纯绿色、纯红色等)的图像进行定位，多次定位的结果综合确定显示屏幕，确保不受背景颜色干扰。
可选地，所述主控终端根据所述第三图像和所述第四图像确定所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例之后，所述方法还可以包括：
所述主控终端确定第三显示数据后，根据所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例分割所述第三显示数据，并确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向，将分割后的第三显示数据向所述各显示终端的显示屏幕发送，使所述各显示终端的显示屏幕按所确定的显示方向显示所接收的分割后的第三显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
可选地，所述确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向，将分割后的第三显示数据向所述各显示终端的显示屏幕发送，包括：
以任一所述显示终端的显示屏幕的显示方向为基准方向，将其他显示终端的显示屏幕的显示方向与所述基准方向调整一致；根据调整后的方向确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向；将切割后的第三显示数据向所述显示终端的显示屏幕发送。
这里是考虑到如果传输的图像不考虑显示方向，最终拼接出来的图像可能会出拼接错位的问题。
可选地，所述主控终端确定第三显示数据之后，所述方法还可以包括：
所述主控终端将所述第三显示数据、所述各显示终端的显示屏幕的显示方向、所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例发送给各显示终端；
由各显示终端确定对应的显示数据，以任一所述显示终端的显示屏幕的显示方向为基准方向，按所述基准方向显示确定的显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
图2为本公开实施例提供的一种多显示终端拼接的示意图；如图2所示，用户若需要用若干台显示终端合作显示一幅图像或者合作播放一个视频，可以将若干台显示终端平铺在一张桌子上，按设定位姿排列完成后，各显示终端拼接后获得一整块显示区域，即第一显示单元，所述第一显示单元可以设置为显示一整副图像。
主控终端与各显示终端进行通信，由主控终端发送第一显示数据和第二显示数据给所有显示终端，所述主控终端通过双摄像头的拍摄显示终端，利用双摄像头的测距功能，计算出每个显示终端的相对位置、显示终端的显示屏幕的显示方向，测试各个显示终端的显示屏幕的面积，从而确定所有显示终端的精确位置与方向。
图3为本公开实施例提供的一种第一显示图像的示意图；如图3所示，图中包括编号和横线；该图像可以针对如“O”等旋转180度后无区别的字母用来确定显示方向的，对图像的编号内容无要求。
主控终端对拍摄第一显示图像后获得的第一图像和第二图像进行图像分析，提取特征点，例如字母A的顶点和两个底脚的点；通过双摄像头的空间定位功能，确定3个点的空间坐标。具体方法可以包括：提取任意三点，确定三点的坐标，根据这三点的坐标确定一个平面；提取横线上的任意两点，确定这两点的坐标，根据这两点的坐标可以构建XY平面坐标系，再设定其中一点为坐标原点，从而确定X轴的正方向。
图4为本公开实施例提供的显示方向不统一的图像显示示意图，如图4所示，若未统一显示终端的显示屏幕的显示方向，图像的显示方向会发生错乱。因此，本公开实施例中，可以以平面坐标系的X轴为正方向，当其他显示终端显示的图像的方向与X轴正方向不同时，计算出对应的夹角，利用夹角数值，在发送图像给显示终端的之前，将图像旋转对应的角度，夹角为多少，切割的图像就相应旋转多少角度，从而投影出来的内容不会产生某个局部区域显示图像颠倒的情况。
需要说明的是，每个显示终端接收并显示自己收到的图像，最终给用户呈现的效 果即为所有显示终端拼接后显示同一张图像；若要显示视频，实际处理方式可以将每一帧图像重复上述图像切割、旋转、发送的过程，实现视频效果的显示。同理，如PPT等内容也可以通过上述图像切割、旋转、发送的过程显示在拼接的显示区域内。
当显示终端开始显示各个切割后的图像后，主控终端可以关闭双摄像头，停止监控各个显示终端，主控终端也无需固定在支架上，可以任意移动位置；也可以不关闭双摄像头，继续监控显示终端，若出现显示终端发生较大位移的情况，双摄像头可以重新进行定位。这时，由于图像已经在正常播放，可以只针对移动的一台显示终端来执行重新定位，而不影响其他显示终端的播放过程。这样针对播放过程中的单个显示终端的位移处理，提高系统平稳运行时的突发情况处理能力，避免发生意外后需要重新全面初始化的问题。
在运行过程中，因为电量太低或者其他突发情况出现的有一台显示终端退出显示系统的情况时，可以先不作任何处理，继续其他显示终端的内容显示；在用户针对剩余显示终端做了调整后，主控终端再根据调整的显示终端，启动个别显示终端的初始化过程，如此操作可以不影响整个系统的运行流畅度。
运行过程中，可以有新的显示终端的加入，当有新的显示终端加入时只需要针对新的显示终端进行初始化过程，包括：确定新的显示终端的显示屏幕的显示方向、显示范围、相对位置等。主控终端根据加入的新的显示终端重现确定各显示终端的显示区域，进行图像切割、旋转、发送，由包括新的显示终端的各个显示终端拼接后的第一显示单元来显示图像。
当系统运行过程中，仍然可以随时调整画面显示的缩放。
显示终端进入、退出不影响的播放流畅度，当然若大量显示终端加入或退出时，还可以调整画面的显示比例，完成更广泛的适应性。
这里，系统调整画面显示的缩放比例时，可以在主控终端中预制几种通用的算法，可以在初始化的时候完成自动缩放，提高操作的简便性。所述算法可以包括但不限于以下三种：
1、画面全显示：要求待显示的图像的4个角，能够完全显示在显示终端；
2、显示终端全部有图像：要求所有显示终端的显示区域都有画面显示；
3、中心80％内容完全显示：确定中心的80％区域，中心的80％区域对应的4个角都需要能够完全显示在显示终端上。
本公开实施例中，利用两个摄像头的相对距离、特征点之间的独立成像的视差，以及摄像头的当时的焦距信息，可以确定特征点在空间中的相对于摄像头组的相对位置。
图5为本公开实施例中利用双摄像头测距原理的示意图；如图5所示，运用双摄像头，具体包括：第一摄像头和第二摄像头，进行空间定位时，双摄像头处于同一水平面上，同时对某一物体拍照，这里用P表示，分别获得第一图形和第二图形。
在拍摄获得的第一图形和第二图形上分别获得Pl和Pr，这两点相对于图形的中心点构成一个平面坐标。利用相似三角形原理，通过两个摄像头在移动终端上的相对位置，确定Ol和Or两点的相对位置。OlPl和OrPr的向量方向与OlP和OrP的向量方向完全对应；根据Ol和Or两点的相对位置、摄像头的焦距信息等信息，运用双摄像头空间定位的算法计算出P点相对于双摄像头组的相对位置；这里相对位置可以用一个三维坐标系表示，该三维坐标系中的X轴和Y轴组成的平面即为显示平面。
通过上述方法即可确定各个显示终端相对于所述主控终端的相对位置。
图6为本公开实施例提供的另一种显示方法流程示意图；如图6所示，所述方法包括：
步骤601：将所有显示终端与主控终端连接后，主控终端为每个显示终端设置一个编号；
步骤602：各显示终端按设定位姿排列，将主控终端的双摄像头固定，保证双摄像头能够拍摄到各个显示终端；
步骤603：主控终端发送第一显示数据给显示终端，显示终端进入初始化过程；
步骤604：主控终端判断是否能检测到显示终端根据所述第一显示数据显示的图像，能够检测到图像则进入步骤606，不能检测到图像则进入步骤605；
步骤605：给用户一个提示，例如“未找到图像，请确认主控终端的摄像头可以覆盖到所有显示终端”，返回步骤602；
步骤606：主控终端通过第一摄像头获取包含所述各显示终端的第一图像，通过第二摄像头获取包含所述各显示终端的第二图像，利用第一图像和第二图像的特征信息，完成显示平面的坐标系建立；
步骤607：确定所有显示终端的显示屏幕的显示方向，以及显示终端的相对位置；
步骤608：所述主控终端向所述各显示终端发送第二显示数据，所述第二显示数 据使所述显示终端在显示屏幕上显示单一颜色的第二显示图像；所述主控终端通过所述第一摄像头获取包含所述各显示终端的第三图像，通过所述第二摄像头获取包含所述各显示终端的第四图像；主控终端根据第三图像和第四图像确定所有显示终端的显示区域，从而确定由各个显示终端拼接而成的第一显示单元；
步骤609：主控终端将第一显示单元与原始图像进行显示范围的匹配，确定每个显示终端的显示屏幕需要显示的内容；
步骤610：主控终端完成第三显示数据的切割，发送给每一台对应的显示终端，由各个显示终端完成对应图像的显示；
步骤611：至此，可以利用多台显示终端合作完成同一个画面的显示。
图7为本公开实施例提供的一种显示装置结构示意图；如图7所示，待拼接的各显示终端以设定位姿排列，使各显示终端的显示屏幕位于同一平面上，所述装置包括：第一处理模块701、第二处理模块702、第三处理模块703；其中，
所述第一处理模块701，设置为通过第一摄像头和第二摄像头获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像；
可选地，所述第一处理模块701，设置为向所述各显示终端发送第一显示数据，所述第一显示数据使所述显示终端在显示屏幕上显示第一显示图像；
通过第一摄像头获取包含所述各显示终端的第一图像，通过第二摄像头获取包含所述各显示终端的第二图像。
可选地，所述第一处理模块701，设置为向所述各显示终端发送第二显示数据，所述第二显示数据使所述显示终端在显示屏幕上显示单一颜色的第二显示图像；
通过所述第一摄像头获取包含所述各显示终端的第三图像，通过所述第二摄像头获取包含所述各显示终端的第四图像。
这里，所述第一图像和所述第二图像为分别由第一摄像头和第二摄像头拍摄的包括显示屏幕上显示第一显示图像时的各个显示终端的图像；通过识别第一图像和第二图像可以确定各个显示终端的显示屏幕的显示方向。
这里，所述第三图像和所述第四图像为分别由第一摄像头和第二摄像头拍摄的包括在显示屏幕上显示第二显示图像时的各个显示终端的图像；通过识别第三图像和第四图像可以确定各个显示终端的显示屏幕组成的总显示屏幕，及各个显示屏幕在所述 总显示屏幕上的相对位置、所占比例等。
需要说明的是，这里可以运用双摄像头进行空间定位，双摄像头处于同一水平面上，同时对某一物体拍照，根据拍摄的图像进行定位。因此，所述装置中可以保存有双摄像头的信息，包括：所述第一摄像头和所述第二摄像头之间的相对距离，所述第一摄像头和所述第二摄像头的焦距信息等。
所述第二处理模块702，设置为根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向；
可选地，所述显示终端在显示屏幕上显示的第一显示图像，包括：编号和位于所述编号下方且垂直于显示终端的任一边框的横线；
所述第二处理模块702，设置为对所述第一图像和所述第二图像进行图像识别，从所述第一图像和第二图像上提取所述横线上的两个设定特征点，确定两个设定特征点从左至右连成的向量，向量方向作为所述显示终端的显示屏幕的显示方向。
可选地，所述第二处理模块702，设置为从所述第一图像和第二图像上提取不在同一直线上的三个特征点，根据三个特征点确定所述显示终端的显示屏幕的平面。
可选地，所述第二处理模块702，设置为确定所述设定特征点在所述平面上的坐标，根据所述设定特征点的坐标确定两个设定特征点从左至右连成的向量，将所述向量方向作为所述显示终端的显示屏幕的显示方向。
所述第三处理模块703，设置为根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元。
具体来说，所述第三处理模块703，设置为：对所述第三图像和所述第四图像进行图像识别，获取以设定位姿排列的各显示终端的显示屏幕的最外围的四个端点在所述平面上的坐标信息，根据坐标信息确定所述最外围的四个端点连线形成的四边形内的各显示屏幕作为所述第一显示单元。
可选地，所述第三处理模块703，还设置为根据所述第三图像和所述第四图像确定所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
具体来说，所述第三处理模块703，设置为确定所述显示终端的显示屏幕的四角的端点在所述平面上的坐标信息，根据坐标信息确定四角的端点连线形成的四边形在第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
所述装置，还包括：所述第四处理模块704；
所述第四处理模块704，设置为在确定第三显示数据后，根据所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例分割所述第三显示数据，并确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向，将分割后的第三显示数据向所述各显示终端的显示屏幕发送，使所述各显示终端的显示屏幕按所确定的显示方向显示所接收的分割后的第三显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
可选地，所述第四处理模块704，设置为：以任一所述显示终端的显示屏幕的显示方向为基准方向，将其他显示终端的显示屏幕的显示方向与所述基准方向调整一致；根据调整后的方向确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向；将切割后的第三显示数据向所述显示终端的显示屏幕发送。
所述第四处理模704，还可以设置为：在确定第三显示数据后，将所述第三显示数据、所述各显示终端的显示屏幕的显示方向、所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例发送给各显示终端；
由各显示终端确定对应的显示数据，以任一所述显示终端的显示屏幕的显示方向为基准方向，按所述基准方向显示确定的显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
图8为本公开实施例提供的一种显示系统结构示意图；如图8所示，所述系统包括：显示装置、无线传输模块811、双摄像头模块812、设置模块813、存储模块814；其中，
所述显示装置，可以采用图7所示的装置，不再赘述；
所述无线传输模块811，设置为连接各个显示终端，传输第一显示数据、第二显示数据、第三显示数据等；
所述双摄像头模块812，包括两个摄像头，设置为拍摄各个显示终端；
所述存储模块814，设置为保存计算过程中的数据、双摄像头的相关信息，同时记录用户的偏好设置；
所述设置模块813，设置为设置用户的偏好；所述偏好包括：等比缩放的算法。
所述双摄像头的相关信息包括：两个摄像头之间的相对距离，两个摄像头的焦距信息等。
所述显示装置与上述实施例提供的显示装置相同，不再赘述。
本领域内的技术人员应明白，本公开的实施例可提供为方法、系统、或计算机程序产品。因此，本公开可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且，本公开可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
本公开是参照根据本公开实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
以上所述，仅为本公开的较佳实施例而已，并非用于限定本公开的保护范围，凡在本公开的精神和原则之内所作的任何修改、等同替换和改进等，均应包含在本公开的保护范围之内。
工业实用性
本公开实施例提供的技术方案可以应用于移动通信技术领域。在本公开实施例中，待拼接的各显示终端以设定位姿排列，使各显示终端的显示屏幕位于同一平面上；主控终端通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各 显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像；所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向；所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元。本公开实施例提供的方法和装置，引入两个摄像头采集显示终端的显示屏幕的图像，根据采集的图像确定显示终端与所述主控终端相对位置、所述各显示终端的显示屏幕的平面，实现多个显示终端合作显示同一图像或内容。

Claims (23)

  1. 一种显示方法，其中，待拼接的各显示终端以设定位姿排列，使各显示终端的显示屏幕位于同一平面上；所述方法包括：
    主控终端通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像；
    所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向；
    所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元。
  2. 根据权利要求1所述的方法，其中，所述主控终端通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，包括：
    所述主控终端向所述各显示终端发送第一显示数据，所述第一显示数据使所述显示终端在显示屏幕上显示第一显示图像；
    所述主控终端通过第一摄像头获取包含所述各显示终端的第一图像，通过第二摄像头获取包含所述各显示终端的第二图像。
  3. 根据权利要求2所述的方法，其中，所述显示终端在显示屏幕上显示的第一显示图像，包括：编号和位于所述编号下方且垂直于显示终端的任一边框的横线；
    所述主控终端根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向，包括：
    所述主控终端对所述第一图像和所述第二图像进行图像识别，从所述第一图像和第二图像上提取所述横线上的两个设定特征点，确定两个设定特征点从左至右连成的向量，向量方向作为所述显示终端的显示屏幕的显示方向。
  4. 根据权利要求3所述的方法，其中，所述主控终端对所述第一图像和所述第二图像进行图像识别之后，还包括：
    所述主控终端从所述第一图像和第二图像上提取不在同一直线上的三个特征点，根据三个特征点确定所述显示终端的显示屏幕的平面。
  5. 根据权利要求4所述的方法，其中，所述确定两个设定特征点从左至右连成的向量，包括：
    确定所述设定特征点在所述平面上的坐标，根据所述设定特征点的坐标确定两个设定特征点从左至右连成的向量，将向量方向作为所述显示终端的显示屏幕的显示方向。
  6. 根据权利要求1所述的方法，其中，所述主控终端通过第一摄像头和第二摄像头分别获取包含显示第二显示图像时的所述各显示终端的第三图像和第四图像，包括：
    所述主控终端向所述各显示终端发送第二显示数据，所述第二显示数据使所述显示终端在显示屏幕上显示单一颜色的第二显示图像；
    通过第一摄像头获取包含所述各显示终端的第三图像，通过第二摄像头获取包含所述各显示终端的第四图像。
  7. 根据权利要求4所述的方法，其中，所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元之后，所述方法还包括：
    所述主控终端根据所述第三图像和所述第四图像确定所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例；
    所述主控终端确定第三显示数据后，根据所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例分割所述第三显示数据，并确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向，将分割后的第三显示数据向所述各显示终端的显示屏幕发送，使所述各显示终端的显示屏幕按所确定的显示方向显示所接收的分割后的第三显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
  8. 根据权利要求7所述的方法，其中，所述主控终端根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元，包括：
    所述主控终端对所述第三图像和所述第四图像进行图像识别，获取以设定位姿排列的各显示终端的显示屏幕的最外围的四个端点在所述平面上的坐标信息，根据坐标信息确定所述最外围的四个端点连线形成的四边形内的各显示屏幕作为所述第一显示单元。
  9. 根据权利要求7所述的方法，其中，所述主控终端根据所述第三图像和所述第四图像确定所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例，包括：
    确定所述显示终端的显示屏幕的四角的端点在所述平面上的坐标信息，根据坐标信息确定四角的端点连线形成的四边形在第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
  10. 根据权利要求7所述的方法，其中，所述确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向，将分割后的第三显示数据向所述各显示终端的显示屏幕发送，包括：
    以任一所述显示终端的显示屏幕的显示方向为基准方向，将其他显示终端的显示屏幕的显示方向与所述基准方向调整一致；根据调整后的方向确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向；将切割后的第三显示数据向所述显示终端的显示屏幕发送。
  11. 根据权利要求7所述的方法，其中，所述主控终端确定第三显示数据之后，所述方法包括：
    所述主控终端将所述第三显示数据、所述各显示终端的显示屏幕的显示方向、所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例发送给各显示终端；
    由各显示终端确定对应的显示数据，以任一所述显示终端的显示屏幕的显示方向为基准方向，按所述基准方向显示确定的显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
  12. 一种显示装置，其中，待拼接的各显示终端以设定位姿排列，使各显示终端的显示屏幕位于同一平面上；所述装置包括：第一处理模块、第二处理模块和第三处理模块；其中，
    所述第一处理模块，设置为通过第一摄像头和第二摄像头分别获取包含显示第一显示图像时的所述各显示终端的第一图像和第二图像，及包含显示第二显示图像时的所述各显示终端的第三图像和第四图像；
    所述第二处理模块，设置为根据所述第一图像和所述第二图像确定所述各显示终端的显示屏幕的显示方向；
    所述第三处理模块，设置为根据所述第三图像和所述第四图像确定由所述各显示终端的显示屏幕组成的第一显示单元。
  13. 根据权利要求12所述的装置，其中，所述第一处理模块，设置为向所述各显示终端发送第一显示数据，所述第一显示数据使所述显示终端在显示屏幕上显示第一显示图像；
    通过第一摄像头获取包含所述各显示终端的第一图像，通过第二摄像头获取包含所述各显示终端的第二图像。
  14. 根据权利要求13所述的装置，其中，所述显示终端在显示屏幕上显示的第一显示图像，包括：编号和位于所述编号下方且垂直于显示终端的任一边框的横线；
    所述第二处理模块，设置为：对所述第一图像和所述第二图像进行图像识别，从所述第一图像和第二图像上提取所述横线上的两个设定特征点，确定两个设定特征点从左至右连成的向量，向量方向作为所述显示终端的显示屏幕的显示方向。
  15. 根据权利要求14所述的装置，其中，所述第二处理模块，设置为从所述第一图像和第二图像上提取不在同一直线上的三个特征点，根据三个特征点确定所述显示终端的显示屏幕的平面。
  16. 根据权利要求15所述的装置，其中，所述第二处理模块，设置为确定所述设定特征点在所述平面上的坐标，根据所述设定特征点的坐标确定两个设定特征点从左至右连成的向量，将向量方向作为所述显示终端的显示屏幕的显示方向。
  17. 根据权利要求12所述的装置，其中，所述第一处理模块，设置为：向所述各显示终端发送第二显示数据，所述第二显示数据使所述显示终端在显示屏幕上显示单一颜色的第二显示图像；
    通过第一摄像头获取包含所述各显示终端的第三图像，通过第二摄像头获取包含所述各显示终端的第四图像。
  18. 根据权利要求12所述的装置，其中，所述第三处理模块，还设置为：根据所述第三图像和所述第四图像确定所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
  19. 根据权利要求12所述的装置，其中，所述装置，还包括第四处理模块；所述第四处理模块，设置为确定第三显示数据后，根据所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例分割所述第 三显示数据，并确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向，将分割后的第三显示数据向所述各显示终端的显示屏幕发送，使所述各显示终端的显示屏幕按所确定的显示方向显示所接收的分割后的第三显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
  20. 根据权利要求15所述的装置，其中，所述第三处理模块，设置为：对所述第三图像和所述第四图像进行图像识别，获取以设定位姿排列的各显示终端的显示屏幕的最外围的四个端点在所述平面上的坐标信息，根据坐标信息确定所述最外围的四个端点连线形成的四边形内的各显示屏幕作为所述第一显示单元；
    确定所述显示终端的显示屏幕的四角的端点在所述平面上的坐标信息，根据坐标信息确定四角的端点连线形成的四边形在第一显示单元中的相对位置信息及在所述第一显示单元中所占比例。
  21. 根据权利要求19所述的装置，其中，所述第四处理模块，设置为：以任一所述显示终端的显示屏幕的显示方向为基准方向，将其他显示终端的显示屏幕的显示方向与所述基准方向调整一致；根据调整后的方向确定各分割后的第三显示数据在对应的显示指定的显示屏幕上的显示方向；将切割后的第三显示数据向所述显示终端的显示屏幕发送。
  22. 根据权利要求12所述的装置，其中，所述装置，还包括第四处理模块；所述第四处理模块，设置为：确定第三显示数据后，将所述第三显示数据、所述各显示终端的显示屏幕的显示方向、所述各显示终端的显示屏幕在所述第一显示单元中的相对位置信息及在所述第一显示单元中所占比例发送给各显示终端；
    由各显示终端确定对应的显示数据，以任一所述显示终端的显示屏幕的显示方向为基准方向，按所述基准方向显示确定的显示数据，使所述第一显示单元显示第三显示数据形成第三显示图像。
  23. 一种计算机存储介质，所述计算机存储介质中存储有计算机可执行的一个或多个程序，所述一个或多个程序被所述计算机执行时使所述计算机执行如根据权利要求1-11中任一项所述的方法。
PCT/CN2017/105460 2017-01-11 2017-10-10 一种显示方法和装置和计算机存储介质 WO2018129963A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710020474.6A CN108304148B (zh) 2017-01-11 2017-01-11 一种多屏拼接显示的方法和装置
CN201710020474.6 2017-01-11

Publications (1)

Publication Number Publication Date
WO2018129963A1 true WO2018129963A1 (zh) 2018-07-19

Family

ID=62840006

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/105460 WO2018129963A1 (zh) 2017-01-11 2017-10-10 一种显示方法和装置和计算机存储介质

Country Status (2)

Country Link
CN (1) CN108304148B (zh)
WO (1) WO2018129963A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114697570A (zh) * 2020-12-30 2022-07-01 华为技术有限公司 用于显示图像的方法、电子设备及芯片

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110187857A (zh) * 2019-06-16 2019-08-30 刘兴丹 一种多屏图像定位显像的方法、装置
CN110719522B (zh) * 2019-10-31 2021-12-24 广州视源电子科技股份有限公司 一种视频显示方法、装置、存储介质及电子设备
CN112099741B (zh) * 2020-07-30 2022-07-12 华为技术有限公司 显示屏位置识别方法、电子设备及计算机可读存储介质
CN114942735A (zh) * 2021-02-08 2022-08-26 华为技术有限公司 一种屏幕组合方法和装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105336289A (zh) * 2015-10-30 2016-02-17 京东方科技集团股份有限公司 一种拼接控制方法、装置以及拼接屏系统
CN105468326A (zh) * 2016-01-08 2016-04-06 京东方科技集团股份有限公司 一种显示装置及其信息通道的调整方法和装置
CN105786431A (zh) * 2016-03-04 2016-07-20 京东方科技集团股份有限公司 拼接屏以及实现拼接屏的显示内容自动分配的方法和装置
US20160300549A1 (en) * 2015-04-10 2016-10-13 Boe Technology Group Co., Ltd. Splicer, splicing display system and splicing display method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102855114A (zh) * 2012-08-20 2013-01-02 北京小米科技有限责任公司 多移动终端屏幕拼接方法、屏幕拼接服务器和移动终端
CN105739934B (zh) * 2014-12-11 2018-09-21 华为终端（东莞）有限公司 多屏拼接显示处理方法和设备
CN105094739B (zh) * 2015-08-25 2018-06-12 北京航空航天大学 一种基于移动终端前置摄像头的多终端屏幕自动拼接方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160300549A1 (en) * 2015-04-10 2016-10-13 Boe Technology Group Co., Ltd. Splicer, splicing display system and splicing display method
CN105336289A (zh) * 2015-10-30 2016-02-17 京东方科技集团股份有限公司 一种拼接控制方法、装置以及拼接屏系统
CN105468326A (zh) * 2016-01-08 2016-04-06 京东方科技集团股份有限公司 一种显示装置及其信息通道的调整方法和装置
CN105786431A (zh) * 2016-03-04 2016-07-20 京东方科技集团股份有限公司 拼接屏以及实现拼接屏的显示内容自动分配的方法和装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114697570A (zh) * 2020-12-30 2022-07-01 华为技术有限公司 用于显示图像的方法、电子设备及芯片
CN114697570B (zh) * 2020-12-30 2024-04-26 华为技术有限公司 用于显示图像的方法、电子设备及芯片

Also Published As

Publication number Publication date
CN108304148B (zh) 2020-10-16
CN108304148A (zh) 2018-07-20

Similar Documents

Publication Publication Date Title
WO2018129963A1 (zh) 一种显示方法和装置和计算机存储介质
US11747893B2 (en) Visual communications methods, systems and software
US9584766B2 (en) Integrated interactive space
KR102291461B1 (ko) 디스플레이를 위한 캡처된 이미지의 시각을 조정하는 기술들
US8398246B2 (en) Real-time projection management
US10726625B2 (en) Method and system for improving the transmission and processing of data regarding a multi-user virtual environment
WO2017152803A1 (zh) 图像处理方法和设备
EP3910905A1 (en) Viewing a virtual reality environment on a user device
US11288871B2 (en) Web-based remote assistance system with context and content-aware 3D hand gesture visualization
JP7191853B2 (ja) ヘッドマウントディスプレイおよび方法
CN109040736A (zh) 一种人眼空间位置的标定方法、装置、设备和存储介质
US10694115B2 (en) Method, apparatus, and terminal for presenting panoramic visual content
CN109002248B (zh) Vr场景截图方法、设备及存储介质
US10986401B2 (en) Image processing apparatus, image processing system, and image processing method
TWI712001B (zh) 用以將選定的二維影像投影成裸視三維影像之系統
CN111163280B (zh) 非对称性视频会议系统及其方法
EP3665656B1 (en) Three-dimensional video processing
CN112770095B (zh) 全景投影方法、装置及电子设备
KR101651777B1 (ko) 사물인터넷 기반의 카메라 입력방식을 적용한 증강현실 3d 콘텐츠 디스플레이 모니터링 기능을 갖는 3d 프린팅 시스템 및 이를 이용한 3d 콘텐츠 제작방법
WO2021197016A1 (en) System and method for enhancing subjects in videos
Grogorick et al. Gaze and motion-aware real-time dome projection system
TWI490628B (zh) Virtual reality video control method
CN111918089A (zh) 视频流处理方法、视频流显示方法、装置及设备
WO2023284072A1 (zh) 一种控制投影设备的方法、装置及电子设备
CN105138215B (zh) 一种信息处理方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17891991

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17891991

Country of ref document: EP

Kind code of ref document: A1