CN111913635A - Three-dimensional panoramic picture display method and device, mobile terminal and storage medium - Google Patents

Three-dimensional panoramic picture display method and device, mobile terminal and storage medium Download PDF

Info

Publication number
CN111913635A
CN111913635A CN202010818530.2A CN202010818530A CN111913635A CN 111913635 A CN111913635 A CN 111913635A CN 202010818530 A CN202010818530 A CN 202010818530A CN 111913635 A CN111913635 A CN 111913635A
Authority
CN
China
Prior art keywords
panoramic picture
dimensional panoramic
dimensional
touch
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010818530.2A
Other languages
Chinese (zh)
Other versions
CN111913635B (en
Inventor
黄仲华
周成富
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Schen Industrial Investment Co ltd
Original Assignee
Guangdong Schen Industrial Investment Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Schen Industrial Investment Co ltd filed Critical Guangdong Schen Industrial Investment Co ltd
Priority to CN202010818530.2A priority Critical patent/CN111913635B/en
Publication of CN111913635A publication Critical patent/CN111913635A/en
Application granted granted Critical
Publication of CN111913635B publication Critical patent/CN111913635B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a three-dimensional panoramic picture display method, a device, a mobile terminal and a readable storage medium, wherein the method comprises the following steps: at a mobile terminal having a touch-sensitive display surface: requesting a server to acquire a resource of a required three-dimensional panoramic picture; displaying a portion of the three-dimensional panoramic picture on a touch-sensitive display surface in accordance with the resources of the three-dimensional panoramic picture; detecting the movement operation of a user on the touch-sensitive display surface to the three-dimensional panoramic picture, and moving the three-dimensional panoramic picture at a corresponding movement speed according to the movement operation so as to dynamically update the display part of the three-dimensional panoramic picture displayed on the touch-sensitive display surface; and when the updated display part contains the marked interesting region, reducing the moving speed of the three-dimensional panoramic picture so that the user has more time to observe the current display part. The method and the device can improve the speed and efficiency of finding the region of interest on the three-dimensional panoramic picture by the user.

Description

Three-dimensional panoramic picture display method and device, mobile terminal and storage medium
Technical Field
The invention relates to the field of panoramic pictures, in particular to a three-dimensional panoramic picture display method and device, a mobile terminal and a storage medium.
Background
The panoramic image is an image obtained by splicing a group of pictures obtained by circularly shooting 360-degree or 720-degree shooting units through professional software in a seamless mode. The panoramic image provides unprecedented browsing experience for people, and people can feel the scene environment personally on the scene without going out. The image can be dragged and viewed up and down, left and right and back and forth by a mouse, and a scene can be enlarged and reduced by a mouse wheel. Hotspots can be arranged in the image, and the scene can be switched back and forth by clicking. Besides, voice explanation, pictures and text explanation can be inserted.
Besides being displayed on a computer, the panoramic image can also be displayed on the mobile terminal. When the panoramic image is displayed on the mobile terminal, the panoramic image is relatively large, and the screen of the mobile terminal is relatively small, so that a user may need to drag or move the panoramic image to see the whole content of the panoramic image or find a region of interest on the panoramic image.
Among other things, if a user thinks to find a region of interest on a panoramic image, the user is generally required to move while viewing the image. If the user moves the image too fast, it may result in missing the region of interest and requiring a reverse movement to re-seek, and if the movement is too slow, it may result in a large amount of time and effort, especially for panoramic images of relatively large size, it may take a relatively long time to find the region of interest on the image when the movement is slow.
Disclosure of Invention
In view of the above, the present invention provides a method, an apparatus, a mobile terminal and a storage medium for displaying a three-dimensional panoramic picture, which can improve the speed and efficiency of finding an interested area on the three-dimensional panoramic picture by a user.
The embodiment of the invention provides a three-dimensional panoramic picture display method, which comprises the following steps that at a mobile terminal with a touch-sensitive display surface:
requesting a server to acquire a resource of a required three-dimensional panoramic picture;
displaying a portion of the three-dimensional panoramic picture on a touch-sensitive display surface in accordance with the resources of the three-dimensional panoramic picture;
detecting the movement operation of a user on the touch-sensitive display surface to the three-dimensional panoramic picture, and moving or rotating the three-dimensional panoramic picture at a corresponding movement speed according to the movement operation so as to dynamically update the display part of the three-dimensional panoramic picture displayed on the touch-sensitive display surface;
and when the updated display part contains the marked interesting region, reducing the moving speed of the three-dimensional panoramic picture so that the user has more time to observe the current display part.
Preferably, the moving speed is generated according to the operation intensity of the moving operation; the operation strength is operation strength or operation speed.
Preferably, when it is determined that the updated display portion includes a preset region of interest, the speed of moving the three-dimensional panoramic picture is reduced, specifically including:
acquiring a first coordinate of a first central point of an interest area on a touch-sensitive display surface and a second coordinate of a second central point of the touch-sensitive display surface;
obtaining the distance between a first central point and a second central point along the moving direction according to the first coordinate and the second coordinate;
generating a hysteresis coefficient according to the distance, and correcting the moving speed of the three-dimensional global picture according to the hysteresis coefficient so as to reduce the moving speed; the hysteresis coefficient is proportional to the distance, and is less than or equal to 1.
Preferably, the corrected moving speed is set to V1Initial moving speed is V0The distance between the first center point and the second center point along the moving direction is d, the distance between the touch-sensitive display surface and the second center point along the moving direction is L, and the hysteresis coefficient is t; then:
Figure BDA0002633621460000021
t=d/L (2)
wherein N is a positive integer greater than or equal to 2.
Preferably, within a predetermined range, V0The larger N.
Preferably, the method further comprises the following steps:
and when the distance between the first central point and the second central point along the moving direction is smaller than a preset threshold value, displaying a visual identifier at the first central point.
Preferably, the region of interest has a predetermined label, which is previously provided on the three-dimensional panoramic picture and is invisible when displayed; then also include:
and counting the attention degree of each area of the three-dimensional panoramic picture of the user, and sending the attention degree of each area of the three-dimensional panoramic picture to the server, so that the server adds the label in the corresponding area of the three-dimensional panoramic picture according to the attention degree.
An embodiment of the present invention further provides a three-dimensional panoramic picture display apparatus, including:
the resource request unit is used for requesting a server to acquire the required resources of the three-dimensional panoramic picture;
a display unit for displaying a portion of the three-dimensional panoramic picture on a touch-sensitive display surface in accordance with the resources of the three-dimensional panoramic picture;
the moving unit is used for detecting the moving operation of a user on the touch-sensitive display surface on the three-dimensional panoramic picture, moving or rotating the three-dimensional panoramic picture at a corresponding moving speed according to the moving operation, and dynamically updating the display part of the three-dimensional panoramic picture displayed on the touch-sensitive display surface;
and the moving speed adjusting unit is used for reducing the moving speed of the three-dimensional panoramic picture when the updated display part contains the marked interesting region, so that the user has more time to observe the current display part.
The embodiment of the invention also provides a mobile terminal which is provided with a touch-sensitive display surface, a memory and a processor, wherein the memory is electrically connected with the touch-sensitive display surface and the memory, a computer program is stored in the memory, and the computer program can be executed by the processor to realize the three-dimensional panoramic picture display method.
An embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, where the computer program can be executed by a processor of a device where the computer-readable storage medium is located, so as to implement the three-dimensional panoramic image display method described above.
In the above one embodiment, in the process of moving the three-dimensional panoramic picture by the user, if it is determined that the current display part includes the region of interest with the label, the moving speed of the three-dimensional panoramic picture is reduced, so that the user has more time to view the current display part, and further, whether the region of interest is the target region that the user wants to find is determined, thereby avoiding the occurrence of a situation that the user misses some regions of interest due to fast movement, and improving the efficiency of browsing the whole three-dimensional panoramic picture by the user.
Drawings
Fig. 1 is a schematic flow chart of a three-dimensional panoramic picture display method according to a first embodiment of the present invention.
Fig. 2 is a schematic diagram of displaying a three-dimensional panoramic picture on a mobile terminal.
Fig. 3 is a schematic illustration of a region of interest of a three-dimensional panoramic picture entering a display area of a touch-sensitive display surface.
Fig. 4 is a schematic diagram of a region of interest of a three-dimensional panoramic picture near a second center point.
Fig. 5 is a schematic structural diagram of a three-dimensional panoramic picture display apparatus according to a second embodiment of the present invention.
Fig. 6 is a schematic structural view of the moving speed adjusting unit of fig. 5.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
For better understanding of the technical solutions of the present invention, the following detailed descriptions of the embodiments of the present invention are provided with reference to the accompanying drawings.
It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
In the embodiments, the references to "first \ second" are merely to distinguish similar objects and do not represent a specific ordering for the objects, and it is to be understood that "first \ second" may be interchanged with a specific order or sequence, where permitted. It should be understood that "first \ second" distinct objects may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced in sequences other than those illustrated or described herein.
Referring to fig. 1, a first embodiment of the present invention provides a three-dimensional panorama picture displaying method, which may be executed by a mobile terminal having a touch-sensitive display surface, and in particular, executed by one or more processors within the mobile terminal, to implement the following steps:
and S101, requesting a server to acquire the required resources of the three-dimensional panoramic picture.
In this embodiment, the mobile terminal may be a smart phone, which is installed with an operating system. The operating system may be an IOS system, an android system, or another operating system suitable for the mobile terminal, which is not limited in the present invention.
In this embodiment, the mobile terminal is further installed with an APP to implement the three-dimensional panoramic picture display method of this embodiment, where the APP may be a specific APP or a browser, and the present invention is not limited specifically.
In this embodiment, resources of a plurality of three-dimensional panoramic pictures are stored in the server, and through the APP, the mobile terminal can initiate access to the server, so that a user can browse the three-dimensional panoramic pictures in the server, which are interesting to the user.
S102, displaying a part of the three-dimensional panoramic picture on a touch-sensitive display surface according to the resource of the three-dimensional panoramic picture.
S103, detecting the moving operation of the user on the touch-sensitive display surface to the three-dimensional panoramic picture, and moving the three-dimensional panoramic picture at a corresponding moving speed according to the moving operation to dynamically update the display part of the three-dimensional panoramic picture displayed on the touch-sensitive display surface.
In this embodiment, if a user is interested in a three-dimensional panoramic picture, the user can click on the thumbnail of the three-dimensional panoramic picture to view the panoramic picture. Since the three-dimensional panoramic picture is usually relatively large, and the touch-sensitive display surface of the mobile terminal is relatively small, the apparent touch-sensitive display surface can only display a part of the three-dimensional panoramic picture. The user can update the display part of the three-dimensional panoramic picture displayed on the touch-sensitive display surface by dragging or moving the three-dimensional panoramic picture, thereby realizing dynamic picture browsing. Wherein the moving speed of the three-dimensional panoramic picture is adjusted according to the intensity of the dragging or moving of the user. For example, if the user performs a sliding operation on the touch-sensitive display surface, the three-dimensional panoramic picture will move correspondingly, and particularly, the moving speed is related to the speed or amplitude of the sliding operation, so that the user can adjust the speed of browsing the three-dimensional panoramic picture according to the needs of the user.
In addition, the embodiment also provides a way for the three-dimensional panoramic picture to automatically move, and the user can input the desired moving speed, so that the three-dimensional panoramic picture automatically moves or rotates according to the moving speed to update the display area.
As shown in fig. 2 and 3, fig. 2 is a schematic diagram showing a part of a three-dimensional panoramic picture displayed on a touch-sensitive display surface (it should be understood that fig. 2 is only an example for easy understanding, and in fact no real picture exists outside the touch-sensitive display surface), and fig. 3 is a schematic diagram showing the three-dimensional panoramic picture of fig. 2 on a mobile terminal after moving the three-dimensional panoramic picture from right to left by a certain distance.
And S104, when the updated display part contains the marked interesting region, reducing the moving speed of the three-dimensional panoramic picture so that the user has more time to observe the current display part.
In the present embodiment, for each three-dimensional panoramic picture, one or more regions of interest may be labeled, and these regions of interest are typically important regions, detail regions or regions that are easily noticeable to people. For example, for a three-dimensional panoramic picture inside a house, the interested region may be an indoor ceiling lamp region, and for a three-dimensional panoramic picture in a scenic spot or outdoor environment, the interested region may be some scenic spots, leisure points, etc. in the whole environment. The region of interest can be initially marked by a drafter when uploading the three-dimensional panoramic picture and stored in the server together with the three-dimensional panoramic picture.
In this embodiment, some regions of interest are sometimes not so apparent in the entire three-dimensional panoramic picture, i.e., not very visually observable and need to be magnified or scrutinized to be found. Therefore, if the user moves the picture at a relatively fast moving speed, the user may miss the regions of interest, such as the region of interest a in fig. 2 or fig. 3, because the user does not have enough time to observe the picture.
Therefore, in this embodiment, when the user moves the three-dimensional panoramic picture, if the current display portion of the touch-sensitive display surface includes the marked region of interest, the mobile terminal will reduce the moving speed of the three-dimensional panoramic picture, so that the user has more time to observe the current display portion. If the user finds that the current region of interest is the region that the user wants to search for, the user can click the region of interest, at this time, the three-dimensional panoramic picture stops moving, and the user can zoom in on the region of interest or perform other operations and the like.
In summary, in the three-dimensional panoramic picture display method provided in this embodiment, in the process that the user moves the three-dimensional panoramic picture, if it is determined that the current display portion includes the region of interest with the label, the moving speed of the three-dimensional panoramic picture is reduced, so that the user has more time to view the current display portion, and further determines whether the region of interest is the target region that the user wants to find, thereby avoiding the occurrence of a situation that the user misses some regions of interest due to fast movement, and improving the efficiency of the user browsing the whole three-dimensional panoramic picture.
In order to facilitate an understanding of the invention, some preferred embodiments of the invention are described further below.
In one embodiment, step S104 specifically includes:
acquiring a first coordinate of a first central point of an interest area on a touch-sensitive display surface and a second coordinate of a second central point of the touch-sensitive display surface;
obtaining the distance between a first central point and a second central point along the moving direction according to the first coordinate and the second coordinate;
generating a hysteresis coefficient according to the distance, and correcting the moving speed of the three-dimensional global picture according to the hysteresis coefficient so as to reduce the moving speed; the hysteresis coefficient is proportional to the distance, and is less than or equal to 1.
In this embodiment, since the user may put more attention into the display center position of the touch-sensitive display area, in order to improve the browsing efficiency of the three-dimensional panoramic display picture, the moving speed may be set to be smaller closer to the second center point and larger when relatively far from the second center point.
Specifically, the method comprises the following steps:
first, a first coordinate of a first center point of a region of interest on a touch-sensitive display surface and a second coordinate of a second center point of the touch-sensitive display surface are obtained.
And then, acquiring the distance between the first central point and the second central point along the moving direction according to the first coordinate and the second coordinate.
For example, as shown in fig. 3, assuming that the first coordinate of the first center point of the region of interest a is (X1, Y1), the second coordinate of the second center point B is (X2, Y2), the distance is an absolute value of (X1-X2) if the moving direction is left-right movement, and the distance is an absolute value of (Y1-Y2) if the moving direction is up-down movement.
Finally, generating a hysteresis coefficient according to the distance, and correcting the moving speed of the three-dimensional global picture according to the hysteresis coefficient so as to reduce the moving speed
Specifically, in one implementation, the corrected moving speed is set to V1Initial moving speed is V0The distance between the first center point and the second center point along the moving direction is d, the distance between the touch-sensitive display surface and the second center point along the moving direction is L, and the hysteresis coefficient is t; then:
Figure BDA0002633621460000081
t=d/L (2)
wherein N is a positive integer greater than or equal to 2.
In this embodiment, although it is defined that the closer the first central point and the second central point is, the smaller the hysteresis coefficient is, that is, the moving speed thereof is, if the process is a linear change, the moving speed may be very slow when the two central points are close (as shown in fig. 4), so that the moving speed of the three-dimensional panoramic picture is very slow, and a user may mistakenly think that a jam or a fault occurs in the mobile terminal, which brings a bad user experience.
Therefore, in this embodiment, a piecewise function is used to control the moving speed, when the distance is greater than a certain value, the hysteresis coefficient or the moving speed gradually decreases with the decrease of the distance, and when the distance is less than the certain value, the moving speed is kept unchanged, so as to ensure that the moving speed of the three-dimensional panoramic picture is not too slow when the first central point and the second central point are close to each other.
In this embodiment, N may be a value according to actual needs, for example, N may be a value of 2, 3, or the like. Taking N as an example, when the distance d between the first central point and the second central point is greater than or equal to L/2, the moving speed decreases with the decrease of the distance, and when the distance d between the first central point and the second central point is less than L/2, the moving speed is kept at V0/2, i.e. the speed of movement is at least equal to or greater than V0And/2, therefore, the efficiency of browsing pictures and searching the interested region can be considered.
In this embodiment, N may be a fixed value or a variable value, and particularly, in this embodiment, V is within a predetermined range0The larger N.
Wherein V is taken into account0The larger the moving speed of the picture is, the larger the initial moving speed of the picture is, so that the value of N can be properly increased to reduce the moving speed of the picture to a greater extent, and the picture is prevented from being too fast moved to be seen clearly. But the value of N can not be too large, otherwise the phenomenon of blocking caused by too slow movement can be caused。
In this embodiment, the corresponding relationship between the speed range and N may be predefined, so that N may be adjusted according to the actual moving speed.
On the basis of the above embodiment, in a preferred embodiment of the present invention, the method further includes:
and when the distance between the first central point and the second central point along the moving direction is smaller than a preset threshold value, displaying a visual identifier at the first central point.
In this embodiment, when the region of interest is close to the second center point, a visual identifier, such as a luminous icon or a circle, a cross, or the like, may be set at the first center point of the region of interest to remind the user that the currently displayed portion has the region of interest, where the identifier automatically disappears after the region of interest is far from the second center point.
Preferably, the region of interest has a predetermined label, which is previously provided on the three-dimensional panoramic picture and is invisible when displayed; then also include:
and counting the attention degree of each area of the three-dimensional panoramic picture of the user, and sending the attention degree of each area of the three-dimensional panoramic picture to the server, so that the server adds the label in the corresponding area of the three-dimensional panoramic picture according to the attention degree.
In this embodiment, in addition to the initially set region of interest, the mobile terminal may also count the attention degree of each region when each user browses the three-dimensional panoramic picture, where the attention degree may be obtained by, for example, determining the frequency or the number of times that the user zooms in and clicks on the viewed region. If a certain area is zoomed in or clicked to view by more users, the area is shown to get more attention, so that the area can be set as the area of interest.
In the embodiment, the region of interest is generated according to the common behaviors of most users, so that the richness and the reasonableness of the region of interest can be ensured.
Referring to fig. 5, a second embodiment of the present invention further provides a three-dimensional panorama picture displaying apparatus, including:
a resource requesting unit 210, configured to request a server to obtain a resource of the required three-dimensional panoramic picture.
In this embodiment, resources of a plurality of three-dimensional panoramic pictures are stored in the server, and a user can view the three-dimensional panoramic picture interested in the user by accessing the server.
A display unit 220, configured to display a portion of the three-dimensional panoramic picture on a touch-sensitive display surface according to the resource of the three-dimensional panoramic picture.
And the moving unit 230 is configured to detect a moving operation of the three-dimensional panoramic picture on the touch-sensitive display surface by the user, and move or rotate the three-dimensional panoramic picture at a corresponding moving speed according to the moving operation, so as to dynamically update the display portion of the three-dimensional panoramic picture displayed on the touch-sensitive display surface.
In this embodiment, if a user is interested in a three-dimensional panoramic picture, the user can click on the thumbnail of the three-dimensional panoramic picture to view the panoramic picture. Since the three-dimensional panoramic picture is usually relatively large, and the touch-sensitive display surface of the mobile terminal is relatively small, the apparent touch-sensitive display surface can only display a part of the three-dimensional panoramic picture. The user can update the display part of the three-dimensional panoramic picture displayed on the touch-sensitive display surface by dragging or moving the three-dimensional panoramic picture, thereby realizing dynamic picture browsing. Wherein the moving speed of the three-dimensional panoramic picture is adjusted according to the intensity of the dragging or moving of the user. For example, if the user performs a sliding operation on the touch-sensitive display surface, the three-dimensional panoramic picture will move correspondingly, and particularly, the moving speed is related to the speed or amplitude of the sliding operation, so that the user can adjust the speed of browsing the three-dimensional panoramic picture according to the needs of the user.
In addition, the embodiment also provides a way for the three-dimensional panoramic picture to automatically move, and the user can input the desired moving speed, so that the three-dimensional panoramic picture automatically moves or rotates according to the moving speed to update the display area.
A moving speed adjusting unit 240, configured to reduce the moving speed of the three-dimensional panoramic picture when it is determined that the updated display portion includes the marked region of interest, so that the user has more time to observe the current display portion.
In the present embodiment, for each three-dimensional panoramic picture, one or more regions of interest may be labeled, and these regions of interest are typically important regions, detail regions or regions that are easily noticeable to people. For example, for a three-dimensional panoramic picture inside a house, the interested region may be an indoor ceiling lamp region, and for a three-dimensional panoramic picture in a scenic spot or outdoor environment, the interested region may be some scenic spots, leisure points, etc. in the whole environment. The region of interest can be initially marked by a drafter when uploading the three-dimensional panoramic picture and stored in the server together with the three-dimensional panoramic picture.
In this embodiment, some regions of interest are sometimes not so apparent in the entire three-dimensional panoramic picture, i.e., not very visually observable and need to be magnified or scrutinized to be found. Therefore, if the user moves the picture at a relatively fast moving speed, the user may miss the regions of interest because the user does not have enough time to observe the picture.
Therefore, in this embodiment, when the user moves the three-dimensional panoramic picture, if the current display portion of the touch-sensitive display surface includes the marked region of interest, the mobile terminal will reduce the moving speed of the three-dimensional panoramic picture, so that the user has more time to observe the current display portion. If the user finds that the current region of interest is the region that the user wants to search for, the user can click the region of interest, at this time, the three-dimensional panoramic picture stops moving, and the user can zoom in on the region of interest or perform other operations and the like.
In summary, in the process of moving the three-dimensional panoramic picture by the user, if it is determined that the current display portion includes the region of interest with the label, the three-dimensional panoramic picture display device provided in this embodiment reduces the moving speed of the three-dimensional panoramic picture, so that the user has more time to view the current display portion, and further determines whether the region of interest is the target region that the user wants to find, thereby avoiding the occurrence of a situation that the user misses some regions of interest due to fast movement, and improving the efficiency of browsing the whole three-dimensional panoramic picture by the user.
Preferably, the moving speed is generated according to the operation intensity of the moving operation; the operation strength is operation strength or operation speed.
As shown in fig. 6, preferably, the moving speed adjusting unit 240 specifically includes:
the coordinate acquisition module 241 is configured to acquire a first coordinate of a first center point of the region of interest on the touch-sensitive display surface and a second coordinate of a second center point of the touch-sensitive display surface;
a distance obtaining module 242, configured to obtain, according to the first coordinate and the second coordinate, a distance between a first center point and the second center point along a moving direction;
a speed correction module 243, configured to generate a hysteresis coefficient according to the distance, and correct the moving speed of the three-dimensional global picture according to the hysteresis coefficient, so as to reduce the moving speed; the hysteresis coefficient is proportional to the distance, and is less than or equal to 1.
Preferably, the corrected moving speed is set to V1Initial moving speed is V0The distance between the first center point and the second center point along the moving direction is d, the distance between the touch-sensitive display surface and the second center point along the moving direction is L, and the hysteresis coefficient is t; then:
Figure BDA0002633621460000111
t=d/L (2)
wherein N is a positive integer greater than or equal to 2.
Preferably, in a predetermined rangeInner, V0The larger N.
Preferably, the method further comprises the following steps:
and the identification unit is used for displaying a visual identification on the first central point when the distance between the first central point and the second central point along the moving direction is less than a preset threshold value.
Preferably, the region of interest has a predetermined label, which is previously provided on the three-dimensional panoramic picture and is invisible when displayed; then also include:
and the counting unit is used for counting the attention degree of each area of the three-dimensional panoramic picture of the user and sending the attention degree of each area of the three-dimensional panoramic picture to the server so that the server adds the label in the corresponding area of the three-dimensional panoramic picture according to the attention degree.
The third embodiment of the present invention further provides a mobile terminal, which has a touch-sensitive display surface, a memory and a processor, wherein the memory is electrically connected to the touch-sensitive display surface and the memory, and a computer program is stored in the memory and can be executed by the processor to implement the three-dimensional panoramic image display method.
The fourth embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, where the computer program can be executed by a processor of a device where the computer-readable storage medium is located, so as to implement the three-dimensional panoramic image display method as described above.
Illustratively, the computer programs described in the above embodiments may be divided into one or more units, which are stored in the memory and executed by the processor, to implement the present invention. The one or more units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program in the mobile terminal.
The mobile terminal may include, but is not limited to, a processor, a memory. Those skilled in the art will appreciate that the diagram is merely an example of a mobile terminal and is not intended to be limiting and that the mobile terminal may include more or fewer components than those shown, or some components may be combined, or different components, for example the mobile terminal may also include input output devices, network access devices, buses, etc.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, the control center of the mobile terminal connecting the various parts of the overall mobile terminal using various interfaces and lines.
The memory may be used to store the computer programs and/or modules, and the processor may implement various functions of the mobile terminal by executing or executing the computer programs and/or modules stored in the memory and calling data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
Wherein the mobile terminal integrated unit, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement it without inventive effort.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.

Claims (10)

1. A three-dimensional panorama picture display method, characterized by, at a mobile terminal having a touch-sensitive display surface:
requesting a server to acquire a resource of a required three-dimensional panoramic picture;
displaying a portion of the three-dimensional panoramic picture on a touch-sensitive display surface in accordance with the resources of the three-dimensional panoramic picture;
detecting the movement operation of a user on the touch-sensitive display surface to the three-dimensional panoramic picture, and moving or rotating the three-dimensional panoramic picture at a corresponding movement speed according to the movement operation so as to dynamically update the display part of the three-dimensional panoramic picture displayed on the touch-sensitive display surface;
and when the updated display part contains the marked interesting region, reducing the moving speed of the three-dimensional panoramic picture so that the user has more time to observe the current display part.
2. The three-dimensional panorama picture displaying method according to claim 1, wherein the moving speed is generated in accordance with an operation intensity of the moving operation; the operation strength is operation strength or operation speed; or the movement speed is generated by a user setting.
3. The method of claim 1, wherein when it is determined that the updated display portion includes a preset region of interest, the speed of moving the three-dimensional panoramic image is reduced, specifically comprising:
acquiring a first coordinate of a first central point of an interest area on a touch-sensitive display surface and a second coordinate of a second central point of the touch-sensitive display surface;
obtaining the distance between a first central point and a second central point along the moving direction according to the first coordinate and the second coordinate;
generating a hysteresis coefficient according to the distance, and correcting the moving speed of the three-dimensional global picture according to the hysteresis coefficient so as to reduce the moving speed; the hysteresis coefficient is proportional to the distance, and is less than or equal to 1.
4. The method of claim 3, wherein the modified moving speed is set as V1Initial moving speed is V0The distance between the first center point and the second center point along the moving direction is d, the distance between the touch-sensitive display surface and the second center point along the moving direction is L, and the hysteresis coefficient is t; then:
Figure FDA0002633621450000021
t=d/L (2)
wherein, N is a preset positive integer greater than or equal to 2.
5. The three-dimensional panorama picture displaying method of claim 3, wherein within a predetermined range, V0The larger N.
6. The three-dimensional panorama picture display method of claim 3, further comprising:
and when the distance between the first central point and the second central point along the moving direction is smaller than a preset threshold value, displaying a visual identifier at the first central point.
7. The three-dimensional panorama picture displaying method of claim 1, wherein said region of interest has a predetermined label which is previously set on said three-dimensional panorama picture and is invisible when displayed; then also include:
and counting the attention degree of each area of the three-dimensional panoramic picture of the user, and sending the attention degree of each area of the three-dimensional panoramic picture to the server, so that the server adds the label in the corresponding area of the three-dimensional panoramic picture according to the attention degree.
8. A three-dimensional panorama picture display apparatus characterized by comprising:
the resource request unit is used for requesting a server to acquire the required resources of the three-dimensional panoramic picture;
a display unit for displaying a portion of the three-dimensional panoramic picture on a touch-sensitive display surface in accordance with the resources of the three-dimensional panoramic picture;
the moving unit is used for detecting the moving operation of a user on the touch-sensitive display surface on the three-dimensional panoramic picture, moving or rotating the three-dimensional panoramic picture at a corresponding moving speed according to the moving operation, and dynamically updating the display part of the three-dimensional panoramic picture displayed on the touch-sensitive display surface;
and the moving speed adjusting unit is used for reducing the moving speed of the three-dimensional panoramic picture when the updated display part contains the marked interesting region, so that the user has more time to observe the current display part.
9. A mobile terminal having a touch-sensitive display surface, a memory and a processor, the memory being electrically connected to both the touch-sensitive display surface and the memory, characterized in that a computer program is stored in the memory, the computer program being executable by the processor to implement the three-dimensional panorama picture display method according to any of claims 1 to 7.
10. A computer-readable storage medium, characterized in that a computer program is stored, which is executable by a processor of a device in which the computer-readable storage medium is located, to implement the three-dimensional panorama picture displaying method of any one of claims 1-7.
CN202010818530.2A 2020-08-14 2020-08-14 Three-dimensional panoramic picture display method and device, mobile terminal and storage medium Active CN111913635B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010818530.2A CN111913635B (en) 2020-08-14 2020-08-14 Three-dimensional panoramic picture display method and device, mobile terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010818530.2A CN111913635B (en) 2020-08-14 2020-08-14 Three-dimensional panoramic picture display method and device, mobile terminal and storage medium

Publications (2)

Publication Number Publication Date
CN111913635A true CN111913635A (en) 2020-11-10
CN111913635B CN111913635B (en) 2022-12-13

Family

ID=73283104

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010818530.2A Active CN111913635B (en) 2020-08-14 2020-08-14 Three-dimensional panoramic picture display method and device, mobile terminal and storage medium

Country Status (1)

Country Link
CN (1) CN111913635B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113096008A (en) * 2021-03-09 2021-07-09 惠州Tcl移动通信有限公司 Panoramic picture display method, display device and storage medium

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101995258A (en) * 2009-08-17 2011-03-30 宏达国际电子股份有限公司 Adjacent interest point browsing method and system and computer program product used thereby
JP5511682B2 (en) * 2008-12-04 2014-06-04 三菱電機株式会社 Display input device and navigation system
US20140194164A1 (en) * 2013-01-04 2014-07-10 Lg Electronics Inc. Mobile terminal and controlling method thereof
CN104166464A (en) * 2013-05-17 2014-11-26 北京百度网讯科技有限公司 Method, device and portable terminal for controlling panorama display
CN107172361A (en) * 2017-07-12 2017-09-15 维沃移动通信有限公司 The method and mobile terminal of a kind of pan-shot
CN107635130A (en) * 2016-07-18 2018-01-26 中兴通讯股份有限公司 A kind of method and device realized 3D rendering and shown
US20180063430A1 (en) * 2012-11-27 2018-03-01 Fotonation Limited Digital image capture device having a panorama mode
WO2019153750A1 (en) * 2018-02-09 2019-08-15 腾讯科技(深圳)有限公司 Method, apparatus and device for view switching of virtual environment, and storage medium
CN110650241A (en) * 2014-06-16 2020-01-03 华为技术有限公司 Method and device for presenting panoramic photo in mobile terminal and mobile terminal
US20200097760A1 (en) * 2018-09-25 2020-03-26 Fuji Xerox Co., Ltd. Non-transitory computer readable medium storing image processing program, image processing apparatus, and non-transitory computer readable medium storing program
CN111060024A (en) * 2018-09-05 2020-04-24 天目爱视(北京)科技有限公司 3D measuring and acquiring device with rotation center shaft intersected with image acquisition device

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5511682B2 (en) * 2008-12-04 2014-06-04 三菱電機株式会社 Display input device and navigation system
CN101995258A (en) * 2009-08-17 2011-03-30 宏达国际电子股份有限公司 Adjacent interest point browsing method and system and computer program product used thereby
US20180063430A1 (en) * 2012-11-27 2018-03-01 Fotonation Limited Digital image capture device having a panorama mode
US20140194164A1 (en) * 2013-01-04 2014-07-10 Lg Electronics Inc. Mobile terminal and controlling method thereof
CN104166464A (en) * 2013-05-17 2014-11-26 北京百度网讯科技有限公司 Method, device and portable terminal for controlling panorama display
CN110650241A (en) * 2014-06-16 2020-01-03 华为技术有限公司 Method and device for presenting panoramic photo in mobile terminal and mobile terminal
CN107635130A (en) * 2016-07-18 2018-01-26 中兴通讯股份有限公司 A kind of method and device realized 3D rendering and shown
CN107172361A (en) * 2017-07-12 2017-09-15 维沃移动通信有限公司 The method and mobile terminal of a kind of pan-shot
WO2019153750A1 (en) * 2018-02-09 2019-08-15 腾讯科技(深圳)有限公司 Method, apparatus and device for view switching of virtual environment, and storage medium
CN111060024A (en) * 2018-09-05 2020-04-24 天目爱视(北京)科技有限公司 3D measuring and acquiring device with rotation center shaft intersected with image acquisition device
US20200097760A1 (en) * 2018-09-25 2020-03-26 Fuji Xerox Co., Ltd. Non-transitory computer readable medium storing image processing program, image processing apparatus, and non-transitory computer readable medium storing program

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
XINDING SUN .ETC: ""Region of Interest Extraction and Virtual Camera Control Based on Panoramic Video Capturing"", 《IEEE TRANSACTIONS ON MULTIMEDIA》 *
肖飞 等: "《3DPanoGo2三维全景采集子系统研究》", 《电子世界》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113096008A (en) * 2021-03-09 2021-07-09 惠州Tcl移动通信有限公司 Panoramic picture display method, display device and storage medium

Also Published As

Publication number Publication date
CN111913635B (en) 2022-12-13

Similar Documents

Publication Publication Date Title
US11393017B2 (en) Two-dimensional code identification method and device, and mobile terminal
US7889212B2 (en) Magnifying visual information using a center-based loupe
US9423951B2 (en) Content-based snap point
US20170300597A1 (en) Data feeds with peripherally presented interesting content
US9146655B2 (en) Method and device for executing object on display
CN107172346B (en) Virtualization method and mobile terminal
JP7453471B2 (en) Picture processing method, apparatus, device and storage medium
JP2011529223A (en) Dynamic grid display
CA3218926A1 (en) Method, apparatus and electronic device of page display for application
US8972901B2 (en) Fast cursor location
CN112954441B (en) Video editing and playing method, device, equipment and medium
US20230326110A1 (en) Method, apparatus, device and media for publishing video
CN108228278B (en) Method and device for loading video desktop
CN115097975A (en) Method, apparatus, device and storage medium for controlling view angle conversion
CN111913635B (en) Three-dimensional panoramic picture display method and device, mobile terminal and storage medium
CN110858154B (en) Switching display method and device of carousel graphs, electronic equipment and storage medium
US11665119B2 (en) Information replying method, apparatus, electronic device, computer storage medium, and product
CN116271836A (en) Scene visual angle adjusting method, device, terminal and storage medium
CN114693893A (en) Data processing method and device, electronic equipment and storage medium
CN107707812B (en) Image processing method, mobile terminal and computer readable storage medium
US20140157146A1 (en) Method for retrieving file and electronic device thereof
CN116546232A (en) Interface interaction method, device, equipment and storage medium
CN117785360A (en) Interaction method, device, equipment and storage medium
CN117827068A (en) Interactive control method, device, equipment and storage medium
CN112569601A (en) Splicing method and device of model components in game and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant