CN109196860B

CN109196860B - Control method of multi-view image and related device

Info

Publication number: CN109196860B
Application number: CN201680086281.4A
Authority: CN
Inventors: 陈明裕; 孙增才; 陈永
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2016-07-30
Filing date: 2016-07-30
Publication date: 2020-09-18
Anticipated expiration: 2036-07-30
Also published as: JP2019527847A; CN109196860A; JP6770100B2; WO2018023216A1

Abstract

A control method and relevant device of the multi-view image, this method includes the multi-view display device and terminal set up the connection (S301), the said terminal station displays the picture to divide n view display images (S302) that the display screen on the display screen of the said terminal station divides into, confirm n display areas corresponding to display image of said n view, n is the positive integer; the multi-view display apparatus displays the n view display images within the n display regions, respectively (S304); after the multi-view display device detects a control operation signal in n detection areas corresponding to the n display areas, the multi-view display device transmits the control operation signal to the terminal (S305). Therefore, the method can realize intelligent interaction with the user and improve user experience.

Description

Control method of multi-view image and related device

Technical Field

The invention relates to the technical field of image control, in particular to a control method of a multi-view image and a related device.

Background

Currently, due to the display requirements, multi-view display devices exist in the market. The multi-view display device converts the planar image displayed on the terminal display screen into the multi-view image by using optical equipment such as a lens or a reflector, and the multi-view image can present different images to observers at different positions, so that the multi-view display device can realize three-dimensional display of the planar image. And the carrying is convenient, and the display requirement is convenient. Taking four front, rear, left and right views as examples of the multi-view angle, the planar image provided by the terminal is as shown in fig. 1-a, after being converted by the multi-view angle display device, the multi-view image is respectively observed from the four front, rear, left and right views, and the displayed display effect is as shown in fig. 1-b. Thereby enabling different images to be presented to viewers in different positions.

However, such a multi-view display device can only convert a flat display image on a terminal into a multi-view image to be presented to a user, but cannot perform intelligent interaction with the user, thereby reducing user experience.

Disclosure of Invention

The embodiment of the invention discloses a control method and a related device of multi-view images, which can realize intelligent interaction with a user, thereby improving the user experience.

The first aspect of the embodiments of the present invention discloses a method for controlling a multi-view image, including: after the multi-view display device is connected with a terminal, determining n display areas corresponding to n view display images according to the n view display images divided from a display picture on a display screen of the terminal, wherein n is a positive integer; the multi-view display device displays the n view display images in the n display areas respectively; after the multi-view display device detects the control operation signals in the n detection areas corresponding to the n display areas, the multi-view display device transmits the control operation signals to the terminal.

It is thus clear that multi-view display device can establish connection with the terminal, and can confirm n display area according to n visual angle display image that the terminal was divided, thereby can be at n visual angle display image in n display area, with formation multi-view visual angle display image, can also detect control operation signal in n detection area that n display area corresponds, and transmit it to the terminal, thereby can make the terminal carry out control operation according to control operation signal to visual angle display image, and then realized carrying out intelligent interaction with the user, user experience has been promoted.

In some possible implementations of the first aspect, the determining, by the multi-view display apparatus, n display regions corresponding to n view display images divided from a display screen on the display screen of the terminal includes: the multi-view display device receives first division information of the terminal, wherein the first division information comprises n display views which are respectively corresponding to the n display views and the number of the terminal division view display images, and the multi-view display device determines n display areas which correspond to the n display views according to the received first division information; or the multi-view display device receives second division information sent by the terminal, the second division information includes that the number of the view display images divided by the terminal is n, and the multi-view display device determines n display areas corresponding to the n view display images according to the received second division information.

In some possible implementations of the first aspect, after the multi-view display device detects the control operation signal in n detection areas corresponding to the n display areas, the method further includes: the multi-view display device determines a control operation object and a control operation instruction corresponding to the control operation signal, wherein the control operation object is the display picture or the view display image; wherein the multi-view display device transmits the control operation signal to the terminal, including: after the multi-view display device determines that the control operation object corresponding to the control operation signal is the display picture, the multi-view display device transmits first control information to the terminal, wherein the first control information comprises the control operation object corresponding to the control operation signal which is the display picture and a control operation instruction corresponding to the control operation signal; and after the multi-view display device determines that the control operation object corresponding to the control operation signal is a view display image, the multi-view display device transmits second control information to the terminal, wherein the second control information comprises the control operation object corresponding to the control operation signal is a view display image and a control operation instruction corresponding to the control operation signal.

In some possible implementation manners of the first aspect, after the multi-view display device determines that the control operation object corresponding to the control operation signal is a view display image, the method further includes: if the view display image comprises an image element, the multi-view display device determines whether a control operation object corresponding to the control operation signal is the image element, wherein the image element comprises at least one of an application icon and an application window; wherein the multi-view display device transmits the control operation signal to the terminal, including: after the multi-view display device determines that the control operation object corresponding to the control operation signal is the image element, the multi-view display device transmits third control information to the terminal, wherein the third control information includes that the control operation object corresponding to the control operation signal is the image element and a control operation instruction corresponding to the control operation signal.

In some possible implementations of the first aspect, the control operation signal includes at least one of a gesture operation signal and a voice operation signal.

The second aspect of the embodiments of the present invention discloses a method for controlling a multi-view image, including: after the terminal is connected with a multi-view display device, dividing a display picture on a display screen of the terminal into n view display images; and the terminal receives the control operation signal transmitted by the multi-view display device and controls and operates the display picture according to the control operation signal.

Therefore, after the terminal can be connected with the multi-view display device, intelligent interaction can be carried out between the terminal and a user through the multi-view display device, and user experience is improved.

In some possible implementations of the second aspect, the dividing, by the terminal, a display on a display screen of the terminal into n view-angle display images includes: the terminal determines that a display picture on a display screen of the terminal is divided into n visual angle display images according to n display areas supported by the multi-visual angle display device; or the terminal determines to divide a display picture on a display screen of the terminal into n visual angle display images according to the currently opened n display areas of the multi-visual angle display device; or the terminal determines to divide the display picture on the display screen of the terminal into n view angle display images according to n display views of the images presented by the display picture on the display screen of the terminal.

In some possible implementations of the second aspect, after the terminal establishes the connection with the multi-view display device and before the terminal divides a display screen on a display screen of the terminal into n view display images, the method further includes: and the terminal starts a multi-view image display mode.

In some possible implementation manners of the second aspect, the performing, by the terminal, a control operation on the display screen according to the control operation signal includes: the terminal determines a control operation object corresponding to the control operation signal according to the control operation signal, wherein the control operation object comprises the display picture, at least one view display image in the n view display images, or an image element in the view display image, and the image element comprises at least one of an application icon and an application window; the terminal analyzes a control operation instruction corresponding to the control operation signal; and the terminal performs control operation on the control operation object according to the control operation instruction.

In a third aspect, an embodiment of the present invention discloses a multi-view display device, which includes means for performing the method of the first aspect.

In a fourth aspect, an embodiment of the present invention discloses a terminal, which includes a unit configured to perform the method in the second aspect.

In a fifth aspect, an embodiment of the present invention discloses a multi-view display device, which may include a processor configured to support the multi-view display device to perform corresponding functions in the method provided in the first aspect. The multi-view display apparatus may also include a memory for coupling with the processor that retains program instructions and data necessary for the communication device. The multi-view display apparatus may further include a communication interface for the multi-view display apparatus to communicate with a terminal or a communication network.

In a sixth aspect, an embodiment of the present invention discloses a terminal, which may include a processor configured to support the terminal to execute corresponding functions in the method provided in the second aspect. The terminal may also include a memory, coupled to the processor, that retains program instructions and data necessary for the terminal. The terminal may further include a communication interface for the terminal to communicate with the multi-view display device or a communication network.

In a seventh aspect, an embodiment of the present invention discloses a computer storage medium for storing computer software instructions for the multi-view display device provided in the fifth aspect, which includes a program designed to execute the method in the first aspect.

In an eighth aspect, an embodiment of the present invention discloses a computer storage medium for storing computer software instructions for the terminal provided in the above sixth aspect, which contains a program designed to execute the method in the second aspect.

These and other aspects of the invention are apparent from and will be elucidated with reference to the embodiments described hereinafter.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic diagram illustrating an imaging effect of a terminal display image after passing through a multi-view display device according to a conventional technique;

fig. 2 is a schematic perspective view of a multi-view display device according to an embodiment of the disclosure;

FIG. 3 is a flowchart illustrating a method for controlling a multi-view image according to an embodiment of the present invention;

fig. 4 is a flowchart illustrating another multi-view image control method according to an embodiment of the present invention;

FIG. 5 is a flowchart illustrating a method for controlling a multi-view image according to another embodiment of the present invention;

fig. 6 is a schematic top view illustrating a corresponding position relationship between a display area and a detection area of a multi-view display device according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a multi-view display device according to an embodiment of the present invention;

fig. 8 is a schematic diagram of a unit composition of a terminal according to an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a multi-view display device according to an embodiment of the disclosure;

fig. 10 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

Detailed Description

In order to make the technical solutions of the present invention better understood by those skilled in the art, the technical solutions in the embodiments of the present invention will be clearly described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terms "first," "second," "third," and "fourth," etc. in the description and claims of the invention and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.

The embodiment of the invention discloses a control method and a related device of multi-view images, which can realize intelligent interaction with a user, thereby improving the user experience. In order to better understand the embodiment of the present invention, an application scenario of the embodiment of the present invention is described below.

Referring to fig. 2, fig. 2 is a schematic perspective view of a multi-view display device according to an embodiment of the present invention. As shown in fig. 2, the multi-view display device may include a base, a stand, and a top. The terminal can be placed on the top seat of the multi-view display device, and the display screen of the terminal faces the base, so that the multi-view display device can conveniently display the display picture on the display screen of the terminal in a multi-view mode. In the embodiment of the present invention, for example, the multi-view display device is capable of displaying four views, as shown in fig. 2, the multi-view display device corresponds to four display areas through four front, rear, left and right views, each display area can correspondingly display a part of a display image on a display screen of the terminal, when the display image of the terminal includes four front, rear, left and right view images (as shown in fig. 1-a) of the same image, the multi-view display device can display an effect similar to a stereoscopic image, and a user can observe the multi-view image from different views to observe the view display images corresponding to different views (as shown in fig. 1-b). If the display picture on the display screen of the terminal is a view angle display image in other forms, the multi-view display device can display part of the corresponding display picture in different display areas. It should be noted that, when the multi-view display device can support four display areas, it may perform image display only in one to three display areas or perform display in all four display areas according to specific requirements, and the embodiment of the present invention is not limited thereto. Of course, the multi-view display device in the embodiment of the present invention is only taken as an example, and the multi-view display device in the embodiment of the present invention can support n display regions for multi-view display, and is not limited to support display regions corresponding to 4 viewing angles.

In the conventional technology, a multi-view display device can convert a display picture on a display screen of a terminal into a multi-view image only through optical principles such as refraction and reflection, and when a user needs to adjust the multi-view image or control image elements in the multi-view image, the multi-view image needs to be controlled through touch operation and the like on the terminal. The embodiment of the invention can directly detect the control operation of the user on the multi-view image after the multi-view image is displayed by the multi-view display device and transmit the control operation to the terminal to further control and adjust the multi-view image, thereby realizing intelligent interaction with the user and improving the user experience.

Of course, the embodiment of the invention may also include a multi-view display device with other structures, and is not limited to the stereoscopic structure of the multi-view display device shown in fig. 2.

The following describes in detail an embodiment of the method according to the present invention with reference to the application scenarios described above. The terminal in the embodiment of the present invention may be, for example, a mobile phone, a tablet computer, a notebook computer, a UMPC (ultra-mobile PC), a netbook (netbook), a PDA (personal digital assistant), a POS (point of sale) and the like, but is not limited thereto. The display screen in the terminal can be a capacitive touch screen or a resistive touch screen, or other types of display screens.

Referring to fig. 3, fig. 3 is a flowchart illustrating a method for controlling a multi-view image according to an embodiment of the present invention. As shown in fig. 3, the method may include the following steps.

Step S301, the multi-view display device is connected with the terminal.

In some possible embodiments, the multi-view display device may first establish a connection with the terminal. The connection mode may include a wired connection or a wireless connection. If the multi-view display device is connected to the terminal through a cable, the multi-view display device can be connected to the terminal through a connector, such as a connecting cable configured with a USB interface or other universal or commonly configured connecting interfaces. If the multi-view display device is wirelessly connected with the terminal, magnetic field coupling can be performed through the configured antenna, or wireless connection can be performed through a wireless protocol technology. The Wireless protocol technology may be a general Wireless protocol technology, such as a WIFI (Wireless Fidelity ) technology, a Zigbee (Zigbee protocol) technology, a Bluetooth (Bluetooth) technology, or an NFC (Near field communication) technology, or may be a proprietary protocol technology between the multi-view display device and the terminal, where the proprietary protocol technology is established by the multi-view display device and the terminal together.

Step S302, the terminal divides a display picture on a display screen of the terminal into n visual angle display images.

In some possible embodiments, after the terminal establishes the connection with the multi-view display device, the terminal may divide a display screen on a display screen of the terminal into n view display images, where n is a positive integer.

Specifically, after the terminal is connected with the multi-view display device, wired or wireless information interaction can be performed. For example, the terminal sends a control instruction to the multi-view display device to control the multi-view display device to execute the control instruction, and for example, the terminal controls the multi-view display device to send information and the like required by the terminal; alternatively, the terminal transmits an acquisition request to the multiview display device to request current state information and the like of the multiview display device. Similarly, the multi-view display device can also control the terminal to execute the operation instruction or request to acquire the current state information of the terminal and the like in the manner. The terminal can obtain the display area supported by the multi-view display device or the currently opened display area of the multi-view display device through information interaction, and if the number of the display areas supported by the current multi-view display device or the currently opened display areas is n, the terminal can determine that the division number of the view display images required to be divided in the display picture is n. After the terminal determines the number of divisions, a display screen on the display screen may be subjected to image recognition by a processing Unit or an image processing Unit (GPU) configured in the terminal, for example, the processing Unit or the image processing Unit may call an image recognition model pre-stored in the terminal to perform image recognition on the display screen, so as to recognize an image included in the current display screen and a position of the image in the display screen. Wherein, the identified image may include image elements, such as application icons, application windows, and the like; or comprise multiple perspective images. Furthermore, the terminal may divide the display into n viewing angle display images according to the identified image and the position thereof in the display, and each viewing angle display image may include at least one image identified above.

Or, the terminal may further determine that the number of divisions of the view angle display image required to be divided in the display screen is n according to n display views of the image presented by the display screen on the display screen of the terminal. For example, the terminal may turn on the multi-view display mode after connecting with the multi-view display device or according to an operation of the terminal by a user. In the multi-view display mode, the display screen displays a plurality of display views of the same image. Or, after the terminal is connected to the multi-view display device, or according to the operation of the terminal by the user, the multi-view file pre-stored in the terminal is called, where the multi-view file may include a multi-view image file or a multi-view video file, that is, when the terminal displays a frame of multi-view image on the display screen, the display screen displays multiple display views of the same image. When the terminal is displaying multi-view images, the terminal may perform image recognition on a display screen on the display screen through a processing Unit or an image processing Unit (GPU) configured in the terminal, for example, the processing Unit or the image processing Unit may call an image recognition model pre-stored in the terminal to perform image recognition on the display screen, so as to recognize n view images included in a current display screen and positions of the n view images in the display screen. Further, the terminal may divide the display screen into n view angle display images, each view angle display image including one view angle image.

Optionally, after the terminal is connected to the multi-view display device, the terminal may detect a current screen display state, and if the current display screen of the terminal is in a dark screen state, the display screen of the terminal is switched to a bright screen state after the terminal is connected to the multi-view display device.

Step S303, the multi-view display apparatus determines n display regions corresponding to n view display images according to the n view display images divided from the display screen on the display screen of the terminal.

In some possible embodiments, after the terminal divides the display screen on the display screen into n viewing angle display images, the multi-viewing angle display device may determine n display areas corresponding to the n viewing angle display images according to the n viewing angle display images divided by the terminal, that is, the multi-viewing angle display device needs to determine one display area for each viewing angle display image according to the n viewing angle display images divided by the terminal, and further control the optical device disposed in the display area to display the viewing angle display image corresponding to the display area. Specifically, after the multi-view display device acquires n view display images divided by the terminal, n display areas can be correspondingly determined. Optionally, the terminal may transmit the number n of the divided viewing angle display images to the multi-viewing angle display apparatus through information interaction after dividing the n viewing angle display images, for example, when the terminal is in wired connection with the multi-viewing angle display apparatus, the terminal may transmit the number n of the divided viewing angle display images to the multi-viewing angle display apparatus through a connection bus or the like; for another example, when the terminal is wirelessly connected to the multiview display device, the terminal transmits the information carrying the number n to the multiview display device in an information format and a transmission channel specified in a wireless connection protocol. The terminal may also transmit information of the view display image to the multi-view display device, such as image elements included in the view display image, a size of the view display image, or a view corresponding to the view display image. If the currently opened display area or the supported display area of the multi-view display device is n, determining that one display area corresponds to one view display imageFor example, when the currently-turned-on display area or the supported display area of the multi-view display device is the display area x₁～x_nThen, the multi-view display device knows that the terminal divides n view display images into view display images y₁～y_nThen, the display area x can be determined according to a preset rule or other manners₁～x_nDisplaying an image y with a viewing angle₁～y_nE.g. the multi-view display device determines the display area x_iDisplaying image y corresponding to viewing angle_j(ii) a The multi-view display device can further control the display area x_iThe optical device in (1) displays an image y for its corresponding viewing angle_jDisplaying; if the currently opened display area or the supported display area of the multi-view display device is larger than n, n display areas can be selected, and the corresponding relation between the n display areas and the n view display images is respectively determined. Optionally, the multi-view display device may detect the position of the current observer by detecting the position of the current observer, for example, the multi-view display device may detect the position of the current observer by using a configured camera or a sensor such as infrared or ultrasonic to determine the corresponding relationship between the n display areas and the n view display images. If the multi-view display device detects that the observer observes in the display area a, or the number of the observers in the display area a is large and the n view display images include the front view display image, it is determined that the front view display image is displayed in the display area a. Optionally, the corresponding relationship between the viewing angle display image and the display area may also be determined by the terminal. After the terminal acquires the display areas currently opened or supported by the multi-view display device, the view display image corresponding to each display area is determined, and the corresponding relation is transmitted to the multi-view display device in the modes of instructions or information and the like.

Step S304, the multi-view display apparatus displays the n view display images in the n display regions, respectively.

In some possible embodiments, after the multi-view display apparatus determines n display regions corresponding to the n view display images, the multi-view display apparatus may display the n view display images in the n display regions, respectively. Specifically, the multi-view display device may adjust the optical device disposed in the display area according to the position of the display area in the multi-view display device and the determined position of the view display image corresponding to the display area in the terminal, so as to display the view display image corresponding to the display area in the display area. Optionally, the n viewing angle display images may be correspondingly adjusted according to the size of the n display areas, so as to obtain a better display effect.

Step S305, after the multi-view display device detects the control operation signal in n detection areas corresponding to the n display areas, the multi-view display device transmits the control operation signal to the terminal.

In some possible embodiments, after the multi-view display apparatus displays n view display images in n display areas, the multi-view display apparatus may detect a control operation signal in n detection areas corresponding to the n display areas, and when the control operation signal is detected, the multi-view display apparatus may transmit the control operation signal to the terminal, so that the terminal performs a control operation according to the view display image to which the control operation signal is directed. Specifically, when the multi-view display device detects a control operation signal in one or more display regions, the multi-view display device may determine a view angle display image to which the control operation signal is directed by determining the display region in which the control operation signal is located. For example, when the multi-view display device detects the control operation signal in the display area a, it may be determined that the view angle display image to which the control operation signal is directed is the view angle display image corresponding to the display area a. Furthermore, the multi-view display device can send the control operation signal and the image information of the view display image corresponding to the control signal to the terminal, so that the terminal can control and operate the view display image corresponding to the control operation signal. Or, the control operation signal includes information of the viewing angle display image to which the control operation signal is directed, for example, when the control operation signal is a gesture operation signal, the viewing angle display image to which the gesture operation signal is directed may be determined according to a gesture shape or a gesture operation trajectory of the gesture operation signal, and for example, when the gesture shape formed by the gesture operation signal is determined to be "X", the viewing angle display image to which the gesture operation signal is directed is determined to be a viewing angle display image a; when the gesture shape formed by the gesture operation signal is determined to be V, the view angle display image to be aimed at is determined to be a view angle display image B and the like, and the view angle display image to be aimed at by the control operation signal can be determined after the terminal receives the control operation signal.

In some possible embodiments, each display area of the multi-view display device may correspond to one detection area, as shown in fig. 6, and fig. 6 is a schematic top view of the corresponding position relationship between the display area and the detection area of the multi-view display device. The correspondence relationship shown in fig. 6 takes 4 display areas as an example. As shown in fig. 6, each display area corresponds to one detection area. Alternatively, if the stereoscopic structure of the multi-view display device is as shown in fig. 1, a detection sensor may be mounted on a base of the multi-view display device to detect the control operation signal. The detection sensors mounted on the base corresponding to each display area can be the same or different. The range size of the detection area corresponding to each display area and the control operation signal detected in the detection area may be the same or different. For example, the control operation signal may include at least one of a gesture operation signal and a voice operation signal. The detection area A corresponding to the display area A can detect gesture operation of a user, and the detection area B corresponding to the display area B can detect voice operation of the user. The multi-view display device can detect gesture operation signals through an ultrasonic sensor, an infrared sensor, a camera and the like arranged on the base, and can also detect voice operation signals through a microphone, a voice sensor and the like arranged on the base. Of course, in order to accurately detect the control operation signal, the multi-view display device may be provided with at least one detection sensor on a surface of the base corresponding to each display area. Optionally, the multi-view display device may set different detection sensors on different base surfaces corresponding to each display area, for example, set at least one ultrasonic sensor on the base surface corresponding to the display area a, set at least one microphone on the base surface corresponding to the display area B, and the like. Alternatively, the multi-view display device may be configured to provide the same detection sensor on different base surfaces corresponding to each display area, that is, each surface can detect gesture control operation and voice control operation in the corresponding detection area, and the multi-view display device may determine the detection function in each detection area, for example, the multi-view display device determines the detection area a corresponding to the display area a for detecting gesture control operation, and determines the detection area B corresponding to the display area B for detecting voice control operation, and the like.

Step S306, the terminal receives the control operation signal transmitted by the multi-view display device and performs control operation on the display picture according to the control operation signal.

In some possible embodiments, after receiving the control operation signal transmitted by the multi-view display device, the terminal may perform a control operation on a display screen on the terminal according to the control operation. Specifically, the control operation can be performed on the entire display screen according to the control operation signal, and the terminal can analyze the control operation signal after receiving the control operation signal, so as to analyze the operation instruction of the control operation signal. For example, when the control operation signal is a gesture operation signal, an operation trajectory of the gesture operation signal, such as a pattern formed by the trajectory, a trajectory direction, and the like, may be analyzed, and an operation instruction corresponding to the operation trajectory may be determined according to a preset correspondence between the operation trajectory and the operation instruction, such as when the operation trajectory is a circle, the corresponding operation instruction is to adjust a display screen format, and the like. For another example, when the control operation signal is a voice operation signal, a keyword in the voice operation signal can be analyzed, and an operation instruction is formed according to the keyword; if the keywords in the analyzed voice operation signal contain the adjustment format and the display picture, the operation instruction can be formed to adjust the display picture format. The embodiments of the present invention are not limited herein. By the method, control operations such as adjustment of display screen colors, switching of display formats of the display screens, or enlargement, reduction, rotation and the like of the display screens can be realized. Alternatively, at least one of the n divided viewing angle display images in the display screen may be controlled according to the control operation signal, such as performing color adjustment on the at least one viewing angle display image, or performing display format switching on the at least one viewing angle display image, or performing control operations such as zooming in, zooming out, and rotating on the at least one viewing angle display image. Or, the image elements included in at least one of the n divided viewing angle display images may be controlled according to the control operation signal, where the image elements included in the viewing angle display image may include application icons, application windows (widgets), and the like, and the multi-viewing angle display device may start the application icons or application programs corresponding to the application windows according to the control operation signal, or perform control operation on the application elements in the application windows, and the like.

Optionally, the multi-view display device may receive different control operation signals in different detection regions at the same time, and then the multi-view display device may transmit the different control operation signals to the terminal, so that the terminal independently performs control operation on the display frame or a part of the display frame corresponding to each control operation signal according to the different control operation signals; the multi-view display device may also receive a control operation signal through a plurality of detection regions, and the multi-view display device may transmit the common control operation signal received in the plurality of detection regions to the terminal, so that the terminal performs a control operation on the corresponding display screen or a portion of the display screen according to the control operation signal, for example, the multi-view display device continuously detects the control operation signal in the detection region a and the detection region B, and when the control operation signal is a gesture operation signal, the multi-view display device continuously detects an operation track of the gesture operation signal in the detection region a and the detection region B, or when the control operation signal is a voice operation signal, the multi-view display device continuously detects an audio frequency of the voice operation signal in the detection region a and the detection region B, the terminal performs a rotation operation on the entire display screen or performs a visual operation on the display region a visual frequency corresponding to the display region a and the display region B according to the control operation signal And carrying out corresponding control operation on the angle display image.

Therefore, in the embodiment of the invention, the connection is established between the terminal and the multi-view display device, the terminal divides the display picture on the display screen into n view angle display images, the multi-view display device can determine the display areas corresponding to the n view angle display images according to the divided n view angle display images and correspondingly display the n view angle display images in the n display areas, the multi-view image can be intelligently provided for a user, the multi-view display device can detect the control operation signal and transmit the control operation signal to the terminal, so that the terminal can control and operate the display picture on the display screen according to the control operation signal, the intelligent interaction with the user is realized, and the user experience is improved.

Referring to fig. 4, fig. 4 is a flowchart illustrating another multi-view image control method according to an embodiment of the present invention. As shown in fig. 4, the method may include the following steps.

Step S401, the terminal establishes a connection with the multi-view display device.

Step S402, the terminal starts a multi-view image display mode.

In some possible embodiments, the terminal may turn on the multi-view image display mode after the terminal establishes a connection with the multi-view display device. Specifically, after detecting that the connection with the multi-view display device is established, the terminal can be triggered to start the multi-view image display mode, and then the current common display mode is switched to the multi-view image display mode. The multi-view image display mode may include invoking a preset multi-view display image, or correspondingly adjusting a view display image or an image element in a current display image according to the current display image. For example, after the terminal starts the multi-view image display mode, the display position of the view display image in the current display picture can be adjusted to adapt to the situation that an observer can conveniently observe the view displayed in the multi-view display device; or, the current display screen displays a desktop interface of the terminal, where the desktop interface has image elements arranged in sequence, such as application icons or application windows, and the arrangement sequence of the image elements, or the display positions of the image elements, or the display styles of the image elements, may be adjusted to adapt to the display in the multi-view display device for convenient observation by the observer. The multi-view image display mode further includes that the terminal can analyze the control operation signal transmitted by the multi-view display device, for example, can analyze a control operation object corresponding to the control operation signal and a control operation instruction corresponding to the control operation signal.

In step S403, the terminal divides a display screen on a display screen of the terminal into n viewing angle display images.

Step S404, the multi-view display apparatus determines n display regions corresponding to n view display images according to the n view display images divided from the display screen on the display screen of the terminal.

In some possible embodiments, the specific implementation manner of the multi-view display apparatus determining the n display regions corresponding to the n view display images may be any one of the following manners:

the multi-view display device receives first division information of the terminal, wherein the first division information comprises n display views which are respectively corresponding to the n display views and the number of the terminal division view display images, and the multi-view display device determines n display areas which correspond to the n display views according to the received first division information.

Specifically, the multi-view display apparatus may receive first division information sent by the terminal, where the first division information indicates that the terminal divides a display screen on a display screen into n view display images, and display views corresponding to the n view display images. Namely, the terminal instructs the multi-view display apparatus to determine the correspondence between the n view display images and the n display regions through the first division information. For example, a display area in the multi-view display device may correspond to a display view, and after the multi-view display device obtains n display views corresponding to n view display images indicated by the terminal through the first division information, the display area corresponding to the n display views may be determined. Or after receiving the first division information, the multi-view display device may determine the number of the display areas according to the number of divisions of the view display image, and may acquire n display views corresponding to the n view display images, and the multi-view display device may determine the view to be displayed in the display area by detecting the position of the current observer or determining the number of the observers in a certain display area, thereby determining the corresponding relationship between the display area and the view display image. Therefore, after the multi-view display device receives the first division information, n display areas corresponding to the n view display images can be determined according to the first division information.

And (II) the multi-view display device receives second division information sent by the terminal, wherein the second division information comprises n divided view display images of the terminal, and the multi-view display device determines n display areas corresponding to the n divided view display images according to the received second division information.

Specifically, the multi-view display apparatus receives second division information sent by the terminal, where the second division information is used to instruct the terminal to divide the display screen of the display screen into n view display images. The multi-view display device can only determine n display areas required to correspond to the multi-view display device through the second division information, and the multi-view display device is required to determine the corresponding relation between the n display areas and the n view display images. The corresponding relationship may be determined by the optical device configured in the current multi-view display apparatus, or the multi-view display apparatus determines the corresponding relationship according to the image information in the view display image.

Optionally, no matter after the multi-view display apparatus determines n display areas corresponding to the n view display images according to the first division information or the second division information, the corresponding relationship may be implemented by adjusting the optical device configured in the multi-view display apparatus.

In step S405, the multi-view display apparatus displays the n view display images in the n display regions, respectively.

Step S406, after the multi-view display device detects the control operation signal in the n detection areas corresponding to the n view display images, the multi-view display device transmits the control operation signal to the terminal.

Step S407, the terminal determines, according to the control operation signal, a control operation object corresponding to the control operation signal, where the control operation object includes the display screen, at least one view display image in the n view display images, or an image element in the view display image, and the image element includes at least one of an application icon and an application window.

Step S408, the terminal analyzes a control operation instruction corresponding to the control operation signal;

and step S409, the terminal performs control operation on the control operation object according to the control operation instruction.

In some possible embodiments, after receiving the control operation signal transmitted by the multi-view display device, the terminal may perform corresponding control operation on the display screen according to a corresponding relationship between a control operation signal preset in the multi-view display mode of the terminal and the control operation instruction, or a corresponding relationship between a preset control operation signal and a control operation object. Of course, the corresponding relationship between the control operation signal and the control operation object and the control operation command can be embodied in a mapping relationship table preset in the multi-view display mode. For example, when the control operation signal received by the terminal is a gesture operation signal, the control operation object and the control operation command may be determined according to a trajectory direction or a trajectory forming pattern of an operation trajectory of the gesture operation signal, or a gesture shape of the gesture operation, or the like. If the operation track of the gesture operation signal analyzed by the terminal is in one display area and the track forming pattern of the operation track is circular, the terminal can analyze that the control operation object corresponding to the gesture operation signal is a visual angle display image corresponding to the display area and the corresponding control operation instruction is to rotate the visual angle display image; for another example, if the operation trajectory of the gesture operation signal is in the display area where at least one image element in the view-angle display image is displayed, and the direction of the operation trajectory of the gesture operation signal is from far to near, the terminal can resolve that the control operation object corresponding to the gesture operation signal is at least one image element, and the corresponding control operation instruction is to click to open the application program corresponding to the at least one image element; for another example, when the operation trajectory of the gesture operation signal analyzed by the terminal passes through two or more display areas and the trajectory forming pattern of the operation trajectory is a circle, the terminal may analyze that the control operation object corresponding to the gesture operation signal is the whole display screen and the corresponding control operation instruction is to rotate the display screen; for another example, when the operation trajectory of the gesture operation analyzed by the terminal passes through two or more display areas, and the trajectory forming pattern of the operation trajectory is a square or "X" shape, etc., the terminal may analyze that the control operation object corresponding to the gesture operation signal is a viewing angle display image corresponding to the two or more display areas, and the corresponding control operation instruction is to switch the display format of the viewing angle display image, etc. Or, when the control operation signal is a voice operation signal, the terminal may extract a keyword of a control operation object and a keyword corresponding to the control operation instruction in the voice operation signal, so as to determine the control operation object and the control operation instruction corresponding to the voice operation signal, and if the parsed voice operation signal includes two keywords of "open" and "music application", the control operation object corresponding to the voice operation signal is a music application display icon in the view angle display image, and the corresponding control operation instruction is an open instruction. The above examples are merely illustrative and not exhaustive, and of course, the embodiments of the present invention may also include other corresponding relationships between the control operation signal and the control operation object and the control operation command.

When the terminal performs a control operation on the control operation object according to the control operation instruction, the terminal may display a result after the control operation on the display screen, for example, the terminal may display the result after the control operation on the entire display screen on the display screen, or the terminal may display the result after the control operation on one or more viewing angle display images on the display screen, or the terminal may display the result after the control operation on image elements in one or more viewing angle display images on the display screen. When the terminal displays the result after the control operation on the display screen, because the multi-view display device determines the corresponding relation between the display area and the view display images divided by the terminal, when the terminal controls the display of one or more view display images to change, the multi-view display images can display the changed one or more view display images in the display area corresponding to the changed one or more view display images according to the corresponding relation, thereby enabling the user to intuitively feel the control operation result.

It should be noted that, for specific implementation manners of steps S401, S403, S405, and S406, reference may be made to description manners of related steps in the embodiment shown in fig. 3.

Therefore, through the embodiment, the terminal and the multi-view display device can trigger and open the multi-view display mode of the terminal after connection is established, the display area of the multi-view display image can be determined more intelligently through the mutually transmitted information, the multi-view display image can be controlled more intelligently, intelligent interaction with a user is further simplified, and user experience is further enhanced.

In the embodiment shown in fig. 4, after detecting the control operation signal, the multi-view display device may transmit the control operation signal to the terminal, and the terminal may analyze the control operation signal. The other mode is that after the multi-view display device detects the control operation signal, the multi-view display device can analyze the control operation signal and transmit an analysis result to the terminal, and after the terminal receives the analysis result, the terminal can directly perform control operation on the control operation object corresponding to the control operation signal according to the analysis result.

Referring to fig. 5, fig. 5 is a flowchart illustrating a method for controlling a multi-view image according to another embodiment of the present invention. The embodiment shown in fig. 5 focuses on the process of analyzing the control operation signal after the multi-view display device detects the control operation signal. As shown in fig. 5, the method may include the following steps.

Step S501, after the multi-view display device detects the control operation signal in the n detection areas corresponding to the n view display images, the multi-view display device determines a control operation object and a control operation instruction corresponding to the control operation signal, where the control operation object includes at least one of a display image and a view display image.

In some possible embodiments, the multi-view display apparatus may analyze the control operation signal after detecting the control operation signal to determine whether the control operation signal is used for controlling the display screen or the view angle to display the image. Specifically, the determination may be made according to an operation trajectory of the control operation signal or an operation range of the control operation signal. If the multi-view display device analyzes that the operation track or the operation range of the control operation signal comprises the detection areas corresponding to the plurality of display areas, determining that the control operation signal is used for controlling the display picture; when the multi-view display device analyzes that the operation track or the operation range of the control operation signal is only in the detection area corresponding to one display area, the control operation signal is determined to be used for controlling the view display image. . When the multi-view display device determines that the control operation signal is used for controlling the display frame, step S502 may be executed; when the multi-view display apparatus determines that the control operation signal is used to control at least one view to display an image, step S503 may be performed.

Step S502, after the multi-view display device determines that the control operation object corresponding to the control operation signal is the display image, the multi-view display device transmits first control information to the terminal, where the first control information includes that the control operation object corresponding to the control operation signal is the display image and a control operation instruction corresponding to the control operation signal.

In some possible embodiments, after determining that the control operation signal is used to control the display screen by the multi-view display device in the above manner, the multi-view display device may transmit first control information to the terminal, where the first control information is used to instruct the terminal to perform a control operation on the display screen, and further, the first control information may also carry a control operation instruction parsed by the multi-view display device, such as rotating or scaling the display screen, or adjusting a display format of the display screen. Therefore, the processing operation of the terminal on the image can be shared by the multi-view display device. Optionally, after determining the control operation object corresponding to the control operation signal, the multi-view display device may invoke a pre-stored correspondence between the control operation signal and the control operation instruction in the control operation object, and, after determining that the control operation object is a display image, analyze, according to the correspondence, a trajectory direction, a trajectory forming shape, and the like in the control operation signal to determine the control operation instruction corresponding thereto.

In step S503, after the multi-view display device determines that the control operation object corresponding to the control operation signal is a view display image, if the view display image includes an image element, the multi-view display device determines whether the control operation object corresponding to the control operation signal is the image element, where the image element includes at least one of an application icon and an application window.

In some possible embodiments, after the multi-view display device determines that the control operation object corresponding to the control operation signal is the view display image, the multi-view display device may further determine whether the view display image includes an image element, and if the view display image includes an image element, the multi-view display device further needs to further determine whether the control operation object corresponding to the control operation signal is the view display image as a whole or the image element in the view display image. Specifically, when the control operation signal is a gesture operation signal, the operation trajectory shape or the gesture shape of the control operation signal may be detected, and if the operation trajectory shape or the gesture shape of the control operation signal is detected to be "X", it is determined that the operation object of the control operation signal is an image element in the view angle display image. The aimed image element can be determined by further detecting the operation track shape of the control operation signal. If the operation object is determined to be an image element, the operation track shape can be acquired, and when the operation track shape is a number such as "1" or "2", the track shape can be analyzed into a corresponding number, so as to indicate the label of the image element corresponding to the control operation object. If the operation object is in other shapes, the operation object can be determined to be a view angle display image. The image element may include at least one of an application icon, an application window, or other image elements, and by performing a control operation on the image element, an application program corresponding to the image element may be started, or a display format or a display position of the image element may be adjusted, or by performing a control operation on the image element, an image displayed at another viewing angle may be called, and the like. If the multi-view display device determines that the control operation object corresponding to the control operation signal is not an image element in the view display image or does not include an image element in the view display image, the multi-view display device determines that the control operation object corresponding to the control operation signal is an entire view display image, and may perform step S504; if the multi-view display device determines that the control operation object corresponding to the control operation signal is an image element, step S505 can be executed.

Step S504, the multi-view display device determines that the control operation object corresponding to the control operation signal is not the image element, and transmits second control information to the terminal, where the second control information includes that the control operation object corresponding to the control operation signal is a view display image and a control operation instruction corresponding to the control operation signal.

In some possible embodiments, when the multi-view display apparatus determines that the control operation object corresponding to the control operation signal is a view display image of the whole, the second control information may be transmitted to the terminal. The view angle display image can be determined as one or more view angle display images according to the control operation signal, such as determining the number of view angle display images according to the operation track or the operation range of the control operation signal. Correspondingly, after the control operation object is determined, the multi-view display device can further determine the control operation instruction corresponding to the control operation signal and transmit the control operation instruction to the terminal through the second control information, so that the terminal can directly perform corresponding control operation on the corresponding view display image after receiving the second control information. The control operation instruction can be a general operation instruction or a control operation instruction in a private format which is set by the terminal and the multi-view display device together.

Step S505, after the multi-view display device determines that the control operation object corresponding to the control operation signal is the image element, the multi-view display device transmits third control information to the terminal, where the third control information includes that the control operation object corresponding to the control operation signal is the image element and a control operation instruction corresponding to the control operation signal.

In some possible embodiments, after the multi-view display device determines that the control operation object corresponding to the control operation signal is an image element, the multi-view display device may further analyze a control operation instruction of the control operation signal on the image element, and may transmit third control information carrying information of the analyzed image element and the control operation instruction for the image element to the terminal. Therefore, the terminal can directly perform control operation on the corresponding image element according to the received third control information.

Optionally, if the control operation objects corresponding to the same control operation signal detected by the multi-view display device are different, the corresponding control operation instructions may be the same or different, and the embodiment of the present invention is not limited thereto.

Therefore, by the above mode, the multi-view display device can further analyze the control operation signal after detecting the control operation signal so as to analyze the control operation object and the control operation instruction corresponding to the control operation signal, thereby forming different control information and sending the different control information to the terminal, and after receiving the different control information, the terminal can determine the control operation object to be controlled and operated and the specific control operation instruction, thereby being capable of adjusting the multi-view display image. Besides the function of displaying multi-view images, the multi-view display device can further realize the detection and analysis of control operation signals, so that the intelligent interaction mode with a user is further improved, and the user experience is improved.

In the following, an embodiment of the apparatus in the embodiment of the present invention is described in detail with reference to the above application scenarios and the above method embodiments.

Referring to fig. 7, fig. 7 is a schematic diagram of a unit composition of a multi-view display device according to an embodiment of the present invention. The multi-view display device 700 may include a first determining unit 701, a display unit 702, and a transmission unit 703.

The first determining unit 701 is configured to determine, after establishing connection with a terminal, n display areas corresponding to n view display images according to the n view display images divided from a display screen of the terminal, where n is a positive integer;

a display unit 702 configured to display the n viewing angle display images in the n display regions, respectively;

a transmission unit 703, configured to transmit the control operation signal to the terminal by the multi-view display device after detecting the control operation signal in n detection areas corresponding to the n display areas.

Optionally, the first determining unit 701 includes:

a second determining unit, configured to receive first division information of the terminal, where the first division information includes n display views that the terminal divides and the n view display images respectively correspond to, and determine n display regions corresponding to the n view display images according to the received first division information; or,

a third determining unit, configured to receive second division information sent by the terminal, where the second division information includes n display images of the view divided by the terminal, and determine n display regions corresponding to the n display images of the view according to the received second division information.

Optionally, the multi-view display device 700 further includes:

a fourth determining unit 704, configured to determine a control operation object and a control operation instruction corresponding to a control operation signal after the control operation signal is detected in n detection areas corresponding to the n display areas, where the control operation object is the display image or the viewing angle display image;

wherein the transmission unit 703 is further configured to:

after determining that the control operation object corresponding to the control operation signal is the display screen, the fourth determining unit 704 transmits first control information to the terminal, where the first control information includes that the control operation object corresponding to the control operation signal is the display screen and a control operation instruction corresponding to the control operation signal;

after determining that the control operation object corresponding to the control operation signal is an angle display image, the fourth determining unit 704 transmits second control information to the terminal, where the second control information includes that the control operation object corresponding to the control operation signal is an angle display image and a control operation instruction corresponding to the control operation signal.

Optionally, after the fourth determining unit 704 determines that the control operation object corresponding to the control operation signal is a view display image, the multi-view display apparatus 700 further includes:

a fifth determining unit 705, configured to determine, if the view display image includes an image element, whether a control operation object corresponding to the control operation signal is the image element, where the image element includes at least one of an application icon and an application window;

wherein the transmission unit 703 is further configured to:

after determining that the control operation object corresponding to the control operation signal is the image element, the fifth determining unit 705 transmits third control information to the terminal, where the third control information includes that the control operation object corresponding to the control operation signal is the image element and a control operation instruction corresponding to the control operation signal.

Optionally, the control operation signal includes at least one of a gesture operation signal and a voice operation signal.

In this embodiment of the present invention, the first determining unit 701 is configured to execute the methods of steps S301 and S303 in the embodiment illustrated in fig. 3; the display unit 702 is used for executing the method of step S304 in the embodiment described in fig. 3; the transmission unit 703 is configured to execute the method of step S305 in the embodiment described in fig. 3.

In this embodiment of the present invention, the first determining unit 701 is further configured to execute the methods of steps S401 and S404 in the embodiment described in fig. 4; the display unit 702 is further configured to perform the method of step S405 in the embodiment illustrated in fig. 4; the transmission unit 703 is further configured to execute the method of step S406 in the embodiment described in fig. 4.

In this embodiment of the present invention, the fourth determining unit 704 is configured to execute the method of step S501 in the embodiment illustrated in fig. 5; the fifth determining unit 705 is configured to perform the method of step S503 in the embodiment illustrated in fig. 5; the transmission unit 703 is further configured to execute the methods of steps S502, S504, and S505 in the embodiment described in fig. 5.

In this embodiment of the present invention, the transmission unit 703 may send signals, messages, information, and the like to the terminal through a communication interface configured in the multi-view display device 700. The communication interface is a wired interface or a wireless interface.

Referring to fig. 8, fig. 8 is a schematic diagram of a unit composition of a terminal according to an embodiment of the present invention. The terminal 800 may include a dividing unit 801 and a first control unit 802.

The dividing unit 801 is configured to divide a display screen on a display screen of the terminal into n viewing angle display images after establishing connection with a multi-viewing angle display device;

the control unit 802 is configured to receive a control operation signal transmitted by the multi-view display device, and perform a control operation on the display screen according to the control operation signal.

Optionally, the dividing unit 801 includes:

a first determination unit configured to determine to divide a display screen on a display screen of the terminal into n view display images according to n display regions supported by the multi-view display apparatus; or,

a second determining unit, configured to determine that a display screen on a display screen of the terminal is divided into n viewing angle display images according to n display areas currently turned on by the multi-viewing angle display apparatus; or,

and the third determining unit is used for determining that the display picture on the display screen of the terminal is divided into n view angle display images according to n display view angles of the images presented by the display picture on the display screen of the terminal.

Optionally, the terminal further includes:

an opening unit 803, configured to open a multi-view image display mode after the dividing unit establishes connection with the multi-view display device and before a display screen on the terminal is divided into n view display images.

Optionally, the first control unit 802 includes:

a fourth determining unit, configured to determine, according to the control operation signal, a control operation object corresponding to the control operation signal, where the control operation object includes the display screen, at least one view display image of the n view display images, or an image element in the view display image, and the image element includes at least one of an application icon and an application window;

the analysis unit is used for analyzing the control operation instruction corresponding to the control operation signal;

and the second control unit is used for carrying out control operation on the control operation object according to the control operation instruction.

In the embodiment of the present invention, the dividing unit 801 is configured to execute the methods in steps S301 to S302 in the embodiment described in fig. 3; the first control unit 802 is configured to perform the method of step S306 in the embodiment illustrated in fig. 3.

In this embodiment of the present invention, the dividing unit 801 is further configured to execute the methods in steps S401 and S403 in the embodiment described in fig. 4; the starting unit 803 is used for executing the method of step S402 in the embodiment described in fig. 4; the first control unit is configured to execute the method of step S407 in the embodiment illustrated in fig. 4.

Referring to the above embodiments, the multi-view display device 700 in the embodiment shown in fig. 7 or the terminal 800 in the embodiment shown in fig. 8 is presented in the form of a unit. An "element" may refer to an application-specific integrated circuit (ASIC), a processor and memory that execute one or more software or firmware programs, an integrated logic circuit, and/or other devices that may provide the described functionality. In one embodiment, it will be appreciated by those skilled in the art that the multi-view display device 700 shown in FIG. 7 may take the form shown in FIG. 9 below.

As shown in fig. 9, the multi-view display device 700 may be implemented in the structure of fig. 9, and the multi-view display device 900 may include at least one processor 901, at least one memory 902, and at least one communication interface 903. In addition, the multi-view display device 900 may further include an antenna, a camera, various sensors such as an ultrasonic sensor, an infrared sensor, and the like, which are not described in detail herein. The communication interface 903 includes a wired communication interface or a wireless communication interface, and the wired communication interface may be a general wired interface or a special wired interface established together with the terminal.

Wherein the memory 901 is used for storing program codes, and the processor 902 can call the program codes stored in the memory to execute the following steps:

after the processor 901 is connected with a terminal, determining n display areas corresponding to n view display images according to the n view display images divided from a display picture on a display screen of the terminal, wherein n is a positive integer;

the processor 901 displays the n viewing angle display images in the n display regions, respectively;

after the processor 901 detects a control operation signal in n detection areas corresponding to the n display areas, the multi-view display device transmits the control operation signal to the terminal.

Processor 901 may also be referred to as a Central Processing Unit (CPU). The storage unit 902 may include a read-only memory and a random access memory, and provides instructions, data, and the like to the processor 901. A portion of the memory unit 902 may also include non-volatile random access memory. The components of the multi-view display device 900 are coupled together, for example, by a bus system, for a particular application. The bus system may include a power bus, a control bus, a status signal bus, and the like, in addition to the data bus. For clarity of illustration, however, the various buses are labeled as a bus system in the figures. The method disclosed in the above embodiments of the present invention may be applied to the processor 901, or implemented by the processor 901. The processor 901 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be implemented by integrated logic circuits of hardware or instructions in the form of software in the processor 901. The processor 901 may be a general-purpose processor, a digital signal processor, an application specific integrated circuit, an off-the-shelf programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. Processor 901 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the storage unit 902, and for example, the processor 901 may read information in the storage unit 902, and complete the steps of the above method in combination with hardware thereof.

In one embodiment, those skilled in the art will appreciate that the terminal 800 shown in FIG. 7 may take the form shown in FIG. 10 below.

As shown in fig. 10, terminal 800 can be implemented in the architecture of fig. 10, and terminal 1000 can include at least one processor 1001, at least one memory 1002, and at least one communication interface 1003. In addition, the terminal 1000 can also include common elements such as an antenna, which will not be described in detail herein. The communication interface 1003 includes a wired communication interface or a wireless communication interface, and the wired communication interface may be a general wired interface or a special wired interface configured together with the terminal. The memory 1002 is used for storing program codes, and the processor 1001 can call the program codes stored in the memory to execute the following steps:

after the processor 1001 establishes connection with a multi-view display device, dividing a display picture on a display screen of the terminal into n view display images;

the processor 1001 receives a control operation signal transmitted by the multi-view display device, and performs a control operation on the display screen according to the control operation signal.

Processor 1001 may also be referred to as a Central Processing Unit (CPU). The storage unit 1002 may include a read-only memory and a random access memory, and provides instructions, data, and the like to the processor 1001. A portion of the memory unit 1002 may also include non-volatile random access memory. The various components of terminal 1000 in a particular application are coupled together via a bus system, for example. The bus system may include a power bus, a control bus, a status signal bus, and the like, in addition to the data bus. For clarity of illustration, however, the various buses are labeled as a bus system in the figures. The method disclosed by the embodiment of the invention can be applied to the processor 1001 or implemented by the processor 1001. The processor 1001 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be implemented by integrated logic circuits of hardware or instructions in the form of software in the processor 1001. The processor 1001 may be a general-purpose processor, a digital signal processor, an application specific integrated circuit, an off-the-shelf programmable gate array or other programmable logic device, discrete gate or transistor logic, or discrete hardware components. The processor 1001 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the storage unit 1002, and for example, the processor 1001 may read information in the storage unit 1002 and complete the steps of the method in combination with hardware thereof.

Embodiments of the present invention further provide a computer storage medium for storing computer software instructions for the aforementioned multi-view display device, which includes a computer program for executing the aforementioned method embodiments.

The embodiment of the present invention further provides a computer storage medium, configured to store computer software instructions for the terminal, which includes a computer program for executing the method according to the embodiment of the present invention.

While the invention has been described in connection with various embodiments, other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a review of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the word "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus (device), or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. A computer program stored/distributed on a suitable medium supplied together with or as part of other hardware, may also take other distributed forms, such as via the Internet or other wired or wireless telecommunication systems.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While the invention has been described in conjunction with specific features and embodiments thereof, it will be evident that various modifications and combinations can be made thereto without departing from the spirit and scope of the invention. Accordingly, the specification and figures are merely exemplary of the invention as defined in the appended claims and are intended to cover any and all modifications, variations, combinations, or equivalents within the scope of the invention. It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. The multi-view display device is characterized by comprising a processor, a memory, a communication interface and a bus system, wherein the processor, the memory and the communication interface are connected through the bus system and complete mutual communication; the multi-view display device comprises a base, a bracket and a top seat;

the memory stores executable program code, the communication interface is for wired or wireless communication;

the processor is configured to call the executable program code in the memory to:

after establishing connection with a terminal, determining n display areas corresponding to n visual angle display images according to the n visual angle display images divided by a display picture on a display screen of the terminal, wherein n is a positive integer; the terminal is placed on a top seat of the multi-view display device, and a display screen of the terminal faces the base seat; an optical device is arranged in a display area of the multi-view display device, and the optical device obtains a display picture on the display screen;

displaying the n viewing angle display images within the n display areas, respectively, by the optical device;

after detecting control operation signals in n detection areas corresponding to the n display areas, transmitting the control operation signals to the terminal; and enabling the terminal to control and operate the display picture according to the control and operation signal.

2. The multiview display device of claim 1, wherein the processor determines the n display regions corresponding to the n viewing angle display images according to the n viewing angle display images divided from the display screen on the display screen of the terminal by:

receiving first division information of the terminal, wherein the first division information comprises n display views which are respectively corresponding to the n view display images and the number of the view display images divided by the terminal, and determining n display areas corresponding to the n view display images according to the received first division information; or,

receiving second division information sent by the terminal, wherein the second division information comprises n display images with the view angles divided by the terminal, and determining n display areas corresponding to the n display images with the view angles according to the received second division information.

3. The multi-view display device of claim 1 or 2, wherein the processor is further configured to invoke the executable program code in the memory to perform the following operations after detecting a control operation signal in n detection regions corresponding to the n display regions:

determining a control operation object and a control operation instruction corresponding to the control operation signal, wherein the control operation object is the display picture or the view angle display image;

the specific way for the processor to transmit the control operation signal to the terminal is as follows:

after determining that the control operation object corresponding to the control operation signal is the display picture, transmitting first control information to the terminal, wherein the first control information comprises the control operation object corresponding to the control operation signal which is the display picture and a control operation instruction corresponding to the control operation signal;

and after determining that the control operation object corresponding to the control operation signal is a view angle display image, transmitting second control information to the terminal, wherein the second control information comprises the control operation object corresponding to the control operation signal which is a view angle display image and a control operation instruction corresponding to the control operation signal.

4. The multi-view display device of claim 3, wherein after the processor determines that the control operation object corresponding to the control operation signal is a view display image, the processor is further configured to call the executable program code in the memory to perform the following operations:

if the view display image comprises an image element, determining whether a control operation object corresponding to the control operation signal is the image element, wherein the image element comprises at least one of an application icon and an application window;

and after determining that the control operation object corresponding to the control operation signal is the image element, transmitting third control information to the terminal, wherein the third control information comprises the control operation object corresponding to the control operation signal as the image element and a control operation instruction corresponding to the control operation signal.

5. The multi-view display device as claimed in claim 1 or 2, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.

6. The multi-view display device as claimed in claim 3, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.

7. The multi-view display device as claimed in claim 4, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.

8. A terminal is characterized by comprising a processor, a memory, a communication interface and a bus system, wherein the processor, the memory and the communication interface are connected through the bus system and complete mutual communication;

after the connection with a multi-view display device is established, dividing a display picture on a display screen of the terminal into n view display images; the multi-view display device comprises a base, a support and a top seat; the terminal is placed on a top seat of the multi-view display device, and a display screen of the terminal faces the base; an optical device is arranged in a display area of the multi-view display device, and the optical device obtains a display picture on the display screen;

and receiving a control operation signal transmitted by the multi-view display device, and performing control operation on the display picture according to the control operation signal.

9. The terminal of claim 8, wherein the processor divides the display on the display screen of the terminal into n view-angle display images by:

determining to divide a display picture on a display screen of the terminal into n view display images according to n display areas supported by the multi-view display device; or,

determining that a display picture on a display screen of the terminal is divided into n visual angle display images according to n display areas currently opened by the multi-visual angle display device; or,

and determining to divide the display picture on the display screen of the terminal into n view angle display images according to n display views of images presented by the display picture on the display screen of the terminal.

10. The terminal of claim 8 or 9, wherein after the processor establishes the connection with the multi-view display device and before the processor divides a display on a display screen of the terminal into n view display images, the processor is further configured to invoke the executable program code in the memory to:

and starting a multi-view image display mode.

11. The terminal according to claim 8 or 9, wherein the processor performs control operation on the display screen according to the control operation signal in a specific manner:

determining a control operation object corresponding to the control operation signal according to the control operation signal, where the control operation object includes the display picture, at least one view display image in the n view display images, or an image element in the view display image, and the image element includes at least one of an application icon and an application window;

analyzing a control operation instruction corresponding to the control operation signal;

and performing control operation on the control operation object according to the control operation instruction.

12. The terminal of claim 10, wherein the processor controls the display according to the control operation signal by:

13. A multi-view display device, comprising:

the terminal comprises a first determining unit, a second determining unit and a display unit, wherein the first determining unit is used for determining n display areas corresponding to n visual angle display images according to the n visual angle display images divided by a display picture on a display screen of the terminal after establishing connection with the terminal, and n is a positive integer; the multi-view display device comprises a base, a bracket and a top seat; the terminal is placed on a top seat of the multi-view display device, and a display screen of the terminal faces the base; an optical device is arranged in a display area of the multi-view display device, and the optical device obtains a display picture on the display screen;

a display unit for displaying the n viewing angle display images within the n display areas, respectively, by the optical device;

the transmission unit is used for transmitting the control operation signal to the terminal after detecting the control operation signal in n detection areas corresponding to the n display areas; and enabling the terminal to control and operate the display picture according to the control and operation signal.

14. The multiview display device of claim 13, wherein the first determination unit comprises:

15. The multiview display device of claim 13 or 14, further comprising:

a fourth determining unit, configured to determine a control operation object and a control operation instruction corresponding to a control operation signal after the control operation signal is detected in n detection areas corresponding to the n display areas, where the control operation object is the display image or the viewing angle display image;

wherein the transmission unit is further configured to:

after determining that the control operation object corresponding to the control operation signal is the display picture, the fourth determining unit transmits first control information to the terminal, wherein the first control information comprises the control operation object corresponding to the control operation signal which is the display picture and a control operation instruction corresponding to the control operation signal;

and after determining that the control operation object corresponding to the control operation signal is a view angle display image, the fourth determining unit transmits second control information to the terminal, wherein the second control information comprises the control operation object corresponding to the control operation signal is a view angle display image and a control operation instruction corresponding to the control operation signal.

16. The multi-view display apparatus according to claim 15, wherein after the fourth determining unit determines that the control operation object corresponding to the control operation signal is a view display image, the multi-view display apparatus further comprises:

a fifth determining unit, configured to determine whether a control operation object corresponding to the control operation signal is an image element if the view display image includes the image element, where the image element includes at least one of an application icon and an application window;

wherein the transmission unit is further configured to:

and after determining that the control operation object corresponding to the control operation signal is the image element, the fifth determining unit transmits third control information to the terminal, wherein the third control information comprises the control operation object corresponding to the control operation signal as the image element and a control operation instruction corresponding to the control operation signal.

17. The multi-view display device as claimed in claim 13 or 14, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.

18. The multi-view display device as claimed in claim 15, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.

19. The multi-view display device as claimed in claim 16, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.

20. A terminal, comprising:

the terminal comprises a dividing unit, a display unit and a display unit, wherein the dividing unit is used for dividing a display picture on a display screen of the terminal into n visual angle display images after the connection with the multi-visual angle display device is established; the multi-view display device comprises a base, a support and a top seat; the terminal is placed on a top seat of the multi-view display device, and a display screen of the terminal faces the base; an optical device is arranged in a display area of the multi-view display device, and the optical device obtains a display picture on the display screen;

and the first control unit is used for receiving the control operation signal transmitted by the multi-view display device and carrying out control operation on the display picture according to the control operation signal.

21. The terminal of claim 20, wherein the dividing unit comprises:

22. The terminal according to claim 20 or 21, characterized in that the terminal further comprises:

and the starting unit is used for starting a multi-view image display mode after the dividing unit is connected with the multi-view display device and before a display picture on a display screen of the terminal is divided into n view display images.

23. The terminal according to claim 20 or 21, wherein the first control unit comprises:

24. The terminal of claim 22, wherein the first control unit comprises:

25. A method for controlling a multi-view image, comprising:

after the multi-view display device is connected with a terminal, determining n display areas corresponding to n view display images according to the n view display images divided from a display picture on a display screen of the terminal, wherein n is a positive integer; the multi-view display device comprises a base, a bracket and a top seat; the terminal is placed on a top seat of the multi-view display device, and a display screen of the terminal faces the base; an optical device is arranged in a display area of the multi-view display device, and the optical device obtains a display picture on the display screen;

the multi-view display device displays the n view display images in the n display areas respectively through the optical equipment;

after the multi-view display device detects control operation signals in n detection areas corresponding to the n display areas, the multi-view display device transmits the control operation signals to the terminal; and enabling the terminal to control and operate the display picture according to the control and operation signal.

26. The method of claim 25, wherein the determining, by the multi-view display apparatus, n display regions corresponding to n view display images, based on the n view display images divided from the display screen on the display screen of the terminal, comprises:

the multi-view display device receives first division information of the terminal, wherein the first division information comprises n display views which are respectively corresponding to the n display views and the number of the terminal division view display images, and the multi-view display device determines n display areas which correspond to the n display views according to the received first division information; or,

the multi-view display device receives second division information sent by the terminal, the second division information comprises n division view display images of the terminal, and the multi-view display device determines n display areas corresponding to the n division view display images according to the received second division information.

27. The method according to claim 25 or 26, wherein after the multi-view display device detects the control operation signal in n detection areas corresponding to the n display areas, the method further comprises:

the multi-view display device determines a control operation object and a control operation instruction corresponding to the control operation signal, wherein the control operation object is the display picture or the view display image;

wherein the multi-view display device transmits the control operation signal to the terminal, including:

after the multi-view display device determines that the control operation object corresponding to the control operation signal is the display picture, the multi-view display device transmits first control information to the terminal, wherein the first control information comprises the control operation object corresponding to the control operation signal which is the display picture and a control operation instruction corresponding to the control operation signal;

and after the multi-view display device determines that the control operation object corresponding to the control operation signal is a view display image, the multi-view display device transmits second control information to the terminal, wherein the second control information comprises the control operation object corresponding to the control operation signal is a view display image and a control operation instruction corresponding to the control operation signal.

28. The method as claimed in claim 27, wherein after the multi-view display apparatus determines that the control operation object corresponding to the control operation signal is a view display image, the method further comprises:

if the view display image comprises an image element, the multi-view display device determines whether a control operation object corresponding to the control operation signal is the image element, wherein the image element comprises at least one of an application icon and an application window;

after the multi-view display device determines that the control operation object corresponding to the control operation signal is the image element, the multi-view display device transmits third control information to the terminal, wherein the third control information includes that the control operation object corresponding to the control operation signal is the image element and a control operation instruction corresponding to the control operation signal.

29. The method as claimed in claim 25 or 26, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.

30. The method of claim 27, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.

31. The method of claim 28, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.

32. A method for controlling a multi-view image, comprising:

after a terminal is connected with a multi-view display device, dividing a display picture on a display screen of the terminal into n view display images by the terminal; the multi-view display device comprises a base, a support and a top seat; the terminal is placed on a top seat of the multi-view display device, and a display screen of the terminal faces the base; an optical device is arranged in a display area of the multi-view display device, and the optical device obtains a display picture on the display screen;

and the terminal receives the control operation signal transmitted by the multi-view display device and controls and operates the display picture according to the control operation signal.

33. The method of claim 32, wherein the terminal divides a display screen on a display screen of the terminal into n view-angle display images, comprising:

the terminal determines that a display picture on a display screen of the terminal is divided into n visual angle display images according to n display areas supported by the multi-visual angle display device; or,

the terminal determines that a display picture on a display screen of the terminal is divided into n visual angle display images according to n display areas currently opened by the multi-visual angle display device; or,

the terminal determines to divide the display picture on the display screen of the terminal into n view angle display images according to n display views of the images presented by the display picture on the display screen of the terminal.

34. The method according to claim 32 or 33, wherein after the terminal establishes the connection with the multi-view display device and before the terminal divides a display screen on a display screen of the terminal into n view display images, the method further comprises:

and the terminal starts a multi-view image display mode.

35. The method according to claim 32 or 33, wherein the terminal performs a control operation on the display screen according to the control operation signal, and the method comprises the following steps:

the terminal determines a control operation object corresponding to the control operation signal according to the control operation signal, wherein the control operation object comprises the display picture, at least one view display image in the n view display images, or an image element in the view display image, and the image element comprises at least one of an application icon and an application window;

the terminal analyzes a control operation instruction corresponding to the control operation signal;

and the terminal performs control operation on the control operation object according to the control operation instruction.

36. The method as claimed in claim 34, wherein the terminal performs a control operation on the display screen according to the control operation signal, and the method comprises: