CN113934495B - Mobile terminal image looking-around method, system and mobile device - Google Patents
Mobile terminal image looking-around method, system and mobile device Download PDFInfo
- Publication number
- CN113934495B CN113934495B CN202111197641.7A CN202111197641A CN113934495B CN 113934495 B CN113934495 B CN 113934495B CN 202111197641 A CN202111197641 A CN 202111197641A CN 113934495 B CN113934495 B CN 113934495B
- Authority
- CN
- China
- Prior art keywords
- image
- offset
- images
- looking
- around
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000015654 memory Effects 0.000 claims description 62
- 229920006395 saturated elastomer Polymers 0.000 claims description 10
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 15
- 230000000694 effects Effects 0.000 description 7
- 239000000284 extract Substances 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Controls And Circuits For Display Device (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a mobile terminal image looking-around method and a system, wherein the method comprises the following steps: acquiring a looking-around image library, wherein the looking-around image library comprises reference images and other images, and the other images are obtained based on offset information of other positions relative to the reference positions of the reference images; acquiring current offset information of a current position relative to a reference position; extracting target images from the looking-around image library based on the current offset information for display, extracting a plurality of alternative images and loading the plurality of alternative images and the target images together into a cache image, wherein the difference value between the offset information corresponding to the alternative images and the current offset information is within a preset range; acquiring second offset information of the next position relative to the reference position; a second target image is determined in the cached image for display based on the second offset information. The technical scheme provided by the invention solves the problem that the resources of the mobile terminal are occupied too much when the traditional VR technology looks around the observation target.
Description
Technical Field
The invention relates to the field of image display, in particular to a mobile terminal image looking-around method, a system and mobile equipment.
Background
With the development of mobile internet platforms, in order to better transfer product appearance information to users on mobile internet pages, a single picture cannot be used for interactive information display from the perspective of users, so that Virtual Reality (VR) technology is developed, and a basic implementation manner of the Virtual Reality technology is that a computer simulates a Virtual environment so as to bring environmental immersion to people. With the continuous development of social productivity and scientific technology, VR technology is increasingly required by various industries. VR technology has also made tremendous progress and has gradually become a new scientific and technological area. And the VR technology is realized by rotating a sphere model based on OpenGl that a panoramic picture is needed to be loaded on a memory, so that the cost of the memory during the running of software is increased. And the VR mode can obviously increase the volume of the software installation package and occupy the storage space of a more mobile terminal. How to reduce the resource occupation of software is a problem to be solved under the premise of ensuring the looking-around visual effect as much as possible.
Disclosure of Invention
In view of this, the embodiment of the invention provides a mobile terminal image looking-around method, a system and mobile equipment, which solve the problem that the traditional VR technology occupies too much mobile terminal resources when looking around an observation target.
According to a first aspect, an embodiment of the present invention provides a mobile-end image looking-around method, where the method includes: acquiring a looking-around image library, wherein the looking-around image library comprises reference images and other images, and the other images are obtained based on offset information of other positions relative to the reference positions of the reference images; acquiring current offset information of a current position relative to the reference position; extracting a target image from the looking-around image library based on the current offset information for display, extracting a plurality of alternative images and loading the alternative images and the target image together into a cache image, wherein the difference value between the offset information corresponding to the alternative images and the current offset information is within a preset range; acquiring second offset information of the next position relative to the reference position; and determining a second target image in the cached image based on the second offset information for display.
Optionally, before the step of acquiring the looking-around image library, the step of generating the looking-around image library includes: extracting images of all the looking-around angles of the target to form a looking-around image library; selecting any one image in the looking-around image library as a reference image; calculating an offset value of each image by using the offset angle of each image in the looking-around image library and the reference image, wherein the offset value is the offset of the spatial picture distance of each image compared with the reference image; and adjusting the offset value corresponding to each image in the looking-around image library into an offset range with a preset size which can be connected according to the connection relation of each image in space, and marking the corresponding image by utilizing the offset range.
Optionally, the acquiring the current offset information of the current position relative to the reference position includes: acquiring an offset angle of the current position compared with a reference position; and calculating a current offset value of the current visual angle compared with the reference image by utilizing the offset angle, and taking the current offset value as the current offset information.
Optionally, the extracting, based on the current offset information, the target image from the looking-around image library for display includes: comparing the current offset value with the offset ranges of all images in the looking-around image library, and finding out a target offset range containing the current offset value; and extracting a target image corresponding to the target offset range.
Optionally, the extracting multiple candidate images and loading the candidate images together with the target image into a cache image, where a difference value between offset information corresponding to the candidate images and the current offset information is within a preset range, includes: extracting a first alternative image, wherein the difference value between the offset information corresponding to the first alternative image and the current offset information is within a preset range; extracting a preset number of candidate images from the first candidate images according to the distance sequence from the first candidate images to the target image; and loading the candidate images and the target images into cache images according to the arrangement sequence of actual space display.
Optionally, the acquiring second offset information of the next position relative to the reference position; determining a second target image in the cached image for display based on the second offset information, including: acquiring a second offset angle of the next position compared with the reference position, and calculating a second offset value of the next view compared with the reference image by using the second offset angle as second offset information; comparing the second offset value with the offset ranges of the images in the cache image, and determining a second offset range, wherein the second offset range comprises a second offset value; and sending and displaying the image corresponding to the second offset range in the cached image as a second target image.
Optionally, before the extracting the plurality of candidate images and the target image are loaded as a cached image, the method further includes: judging whether the current memory or CPU buffer capacity is saturated or not; if the memory or CPU buffer capacity is saturated, searching out a buffer space in the memory or CPU buffer, wherein no read-write operation occurs in a preset number of read-write cycles, and discarding the content in the buffer space so that the buffer image can be loaded into the memory or CPU buffer.
According to a second aspect, a mobile-side image look-around system, the system comprising: the resource acquisition module is used for acquiring a looking-around image library, wherein the looking-around image library comprises reference images and other images, and the other images are obtained based on offset information of other positions relative to the reference positions of the reference images; the first offset calculation module is used for acquiring current offset information of the current position relative to the reference position; the first image extraction module is used for extracting a target image from the looking-around image library based on the current offset information for display, extracting a plurality of alternative images and loading the target image together into a cache image, wherein the difference value between the offset information corresponding to the alternative images and the current offset information is within a preset range; the second offset calculation module is used for acquiring second offset information of the next position relative to the reference position; and the second image extraction module is used for determining a second target image in the cache image based on the second offset information for display.
According to a third aspect, a mobile device comprises:
The system comprises a memory and a processor, wherein the memory and the processor are in communication connection, the memory stores computer instructions, and the processor executes the computer instructions, thereby executing the method in the first aspect or any optional implementation manner of the first aspect.
And the position sensor is connected with the processor and used for detecting offset information of the mobile terminal compared with the reference position.
According to a fourth aspect, embodiments of the present invention provide a computer readable storage medium storing computer instructions for causing the computer to perform the method of the first aspect, or any one of the alternative embodiments of the first aspect.
The technical scheme of the invention has the following advantages:
the embodiment of the invention provides a mobile terminal image looking-around method. When a target is observed for the first time, firstly downloading a looking-around image library from a network into a local image resource pool of a mobile terminal, then obtaining current offset information of a current position relative to a reference position when observing a certain looking-around angle of the target, then extracting a target image from the looking-around image library based on the current offset information for display, and extracting a plurality of candidate images together with the target image as a cache image to be loaded into a cache. Second offset information of the next position with respect to the reference position is acquired while observing the next angle of the target. A second target image is then determined in the cached image for display based on the second offset information. According to the method, the target looking-around image library is downloaded to the mobile terminal for local storage, the problem that image loading is unsuccessful due to network delay and other phenomena is avoided, and compared with the traditional VR technology, the image display effect is improved. And a caching mechanism is adopted to store the display control, and some images adjacent to the target image are loaded into the memory or the display control in the CPU cache in advance, so that when the mobile terminal next time goes on looking around the angle offset, the adjacent second target image is directly extracted from the cache pool to display, the consistency of the image display is ensured, and the memory occupancy rate is reduced. And VR technology is not used, so that the volume of a mobile terminal program is greatly reduced, and more space is released for the mobile device.
In addition, the labels in the image storage in the looking-around image library are the offset ranges of the offset distance values corresponding to all looking-around angles, so that the image storage quantity is reduced, the situation that one picture is required to be stored when all angles are slightly changed is avoided, and the occupation of the local space of the mobile terminal is reduced. Therefore, when the image is extracted, as long as the offset value of the image falls into a certain offset range, the corresponding image can be found for display, and the consistency of the image display is maintained. In the embodiment of the invention, aiming at the condition that the memory or the buffer memory is saturated when the buffer memory image is loaded into the memory or the CPU buffer memory, a method for discarding the least frequently used buffer memory content is used to free up corresponding space so as to ensure the reliability of image loading.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram illustrating steps of a mobile terminal image looking-around method according to an embodiment of the present invention;
Fig. 2 is a schematic view of a view-around structure of a view-around method for a mobile terminal image according to an embodiment of the present invention;
FIG. 3 is a schematic diagram showing the effect of loading image display from a buffer pool by a mobile terminal image looking-around method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a mobile terminal image looking-around system according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a mobile device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.
The technical features of the different embodiments of the invention described below may be combined with one another as long as they do not conflict with one another.
Referring to fig. 1 and fig. 2, a mobile terminal image looking-around method provided by an embodiment of the present invention specifically includes the following steps:
Step S101: a looking-around image library is acquired, the looking-around image library comprising reference images and other images, the other images being derived based on offset information of other positions relative to a reference position of the reference images. Specifically, the function realized by the embodiment of the invention is to look around any target to be observed at any angle in space. And storing the images shot at all angles of the circumference of the object to be observed. Before the mobile terminal observes, firstly downloading a looking-around image library storing images of all angles of the object to be observed from a server to a local image resource pool of the mobile terminal. In the embodiment of the invention, the images are compressed and stored in webp format, so that not only is the definition of the images ensured, but also the problem that the local storage space is excessively occupied if the number of the images is excessive is avoided. In the subsequent observation process, the image resource pool is adopted, the image is directly loaded from the local instead of being loaded from the network in real time, and compared with the VR technology, the image loading speed is greatly improved, and the memory occupancy rate is reduced. One reference image and a plurality of other images are included in the look-around image library. The reference image is an initial angle image that the screen starts to display when the program starts to start, and the other images are images of other angles of the observed object in the space.
Step S102: current offset information of the current position relative to the reference position is acquired. Specifically, when starting to observe, the mobile terminal firstly acquires the offset between the current screen position and the reference position through a position sensor in the equipment, so that the acquired offset information is utilized to search an image of the position corresponding to the offset information in the image resource pool. The position sensor may be a gyroscope, a gravity sensor, a displacement sensor, or the like. The embodiment of the invention realizes the detection of the position change based on the gyroscope.
Step S103: and extracting target images from the looking-around image library based on the current offset information for display, extracting a plurality of candidate images and loading the candidate images and the target images together into a cache image, wherein the difference value between the offset information corresponding to the candidate images and the current offset information is within a preset range. Specifically, after the target image is acquired, a difference value is calculated according to the offset information of the other images and the offset information of the target image, and a plurality of images representing the difference values in a preset range and adjacent to the viewing angles on both sides of the viewing angle of the target image, for example: the preset range of the offset difference value is the distance length of +/-50, the images of other visual angles, of which the visual angles at the two sides of the target image are always extended to 50 distances, are contained, the images and the target image are loaded into the display control together, and then the display control is loaded into the cache pool, so that when the mobile terminal is offset again, the images are directly extracted from the cache pool and displayed, and the image display speed is greatly increased. The buffer pool can be selected from a memory or a CPU buffer space, and in the embodiment of the invention, the buffer pool occupies a memory of the CPU and is used for storing the picture resources loaded to the mobile terminal system, and the buffer pool is realized by adopting the existing buffer pool LruCache principle of the android system Api.
Step S104: acquiring second offset information of the next position relative to the reference position;
Step S105: a second target image is determined in the cached image for display based on the second offset information.
Specifically, after the second offset information of the next offset position is obtained, the corresponding second target image is directly found from the buffer pool to be displayed, so that the speed and the continuity of image display are improved. Whether the second offset information can be successfully matched with the images in the buffer pool is related to the sensitivity of the gyroscope, the response accuracy of the existing gyroscope can ensure the displacement change under most conditions, and the offset can find out the corresponding images in the buffer pool.
Specifically, in an embodiment, in the step S101, the step of generating the looking-around image library includes:
s1011: and extracting images of all the looking-around angles of the target to form a looking-around image library.
S1012: and selecting any image in the looking-around image library as a reference image.
S1013: and calculating an offset value of each image by utilizing the offset angle of each image in the looking-around image library and the reference image, wherein the offset value is the offset of the spatial picture distance of each image compared with the reference image.
S1014: and adjusting the offset value corresponding to each image in the looking-around image library into an offset range with a preset size which can be connected according to the connection relation of each image in space, and marking the corresponding image by utilizing the offset range.
Specifically, firstly, the images of all angles of a shot target are saved, and the more uniform the shot angles and the more the number of images, the better the continuity of the subsequent image observation effect. And then selecting any one image in the looking-around images as a reference image, calculating the angle offset of other images relative to the reference image in the circumference, and calculating the distance offset of the viewing angle of each image compared with the reference image based on the angle offset to be used as an offset value, wherein the offset value of the reference image is 0. For example: the images of all angles of the circumference are arranged in a row on a plane in sequence, and each image is compared with the reference image and has a length distance which is an offset value. If the space circumference is calculated according to 360 degrees, 360 pictures are provided, if the circumference division precision is higher, the number of pictures is more, but all the pictures with micro angles are stored, the number and the storage amount are huge and cannot be realized, so that the offset values of the pictures with all the angles are adjusted to be the mutually connected offset ranges according to the space sequence. The number and the magnitude of the pictures are not excessively large, and the occupation of the storage space is reduced while the observation requirement is met. For example: and when the offset value of the image A is 10mm compared with the reference image, the offset value of the image B is 15mm compared with the reference image, and the image A and the image B are adjacent during acquisition, the offset range of the image A is adjusted to 8-12 mm, the offset range of the image B is adjusted to 13-17 mm, and the corresponding image is marked by taking the offset range as a label. When the offset occurs, whether the offset value falls into a certain offset range or not is judged, and a corresponding target image can be found, for example: the offset value is 9mm, and the corresponding target image is the image A.
Specifically, in an embodiment, the step S102 specifically includes the following steps:
step S1021: and acquiring an offset angle of the current position compared with the reference position.
Step S1022: and calculating a current offset value of the current visual angle compared with the reference image by using the offset angle, and taking the current offset value as current offset information.
Specifically, based on the storage mode of the images in steps S1011 to S1014, the current offset value is calculated from the offset angle fed back by the current gyroscope. The specific principle is described with reference to steps S1011 to S1014, and will not be described in detail herein.
Specifically, in one embodiment, the step S103 specifically includes the following steps:
Step S1031: comparing the current offset value with the offset ranges of all images in the looking-around image library, and finding out a target offset range containing the current offset value;
step S1032: and extracting a target image corresponding to the target offset range.
Specifically, the explanation of the principle refers to the descriptions of steps S1011 to S1014, and will not be repeated here.
Specifically, in an embodiment, the step S103 further includes the following steps:
Step S1033: and extracting a first alternative image, wherein the difference value between the offset information corresponding to the first alternative image and the current offset information is within a preset range.
Step S1034: and extracting a preset number of candidate images from the first candidate images according to the distance sequence from the first candidate images to the target image.
Step S1035: and loading the candidate images and the target images into cache images according to the arrangement sequence of the actual space display.
Specifically, considering that the memory or the CPU has limited cache capacity, too many images cannot be stored in the cache pool, and if the number of the alternative images meeting the conditions within the preset range is too large, the cache pool occupies a large amount of CPU cache space. On the basis, if the offset values of other images on two sides of the target image and the offset value difference value of the target image are prevented from being in a preset range, and the corresponding other images are too many, selecting the adjacent preset number of images of the target image to be loaded into the cache, in the embodiment of the invention, as shown in fig. 3, two adjacent images on two sides of the target image are adopted, namely 4 adjacent images are taken as second alternative images to be loaded onto 5 display controls in the cache in a queue mode together with the target image according to the arrangement sequence in space.
Specifically, in one embodiment, the steps S104 to S105 specifically include the following steps:
step S1051: and acquiring a second offset angle of the next position compared with the reference position, and calculating a second offset value of the next view compared with the reference image by using the second offset angle as second offset information.
Step S1052: and comparing the second offset value with the offset ranges of the images in the cached images, and determining a second offset range, wherein the second offset range comprises the second offset value.
Step S1053: and sending and displaying the image corresponding to the second offset range in the cached image as a second target image.
Specifically, when the mobile terminal shifts for the second time, a checking mechanism in the display control starts to check whether the new shift value hits the shift range of each image in the cache pool, if yes, the second shift range including the second shift value in the cache pool is found, a second target image corresponding to the second shift range is extracted for display, if the situation that the shift change degree of the mobile terminal is too fast and the angle is too large and the sensitivity of the gyroscope is not kept over, the display control detects that the second shift value does not hit any image in the cache pool, the display control extracts the corresponding second target image from the image resource pool for display, and extracts images adjacent to the second target image to be added into the cache pool.
Specifically, in an embodiment, before the step S103, the method further includes:
step S201: judging whether the current memory or CPU buffer capacity is saturated or not.
Step S202: if the memory or CPU buffer capacity is saturated, searching out a buffer space in which no read-write operation occurs in a preset number of read-write cycles in the memory or CPU buffer, and discarding the content in the buffer space so as to enable the buffer image to be loaded into the memory or CPU buffer.
Specifically, before loading an image into a CPU cache, it needs to determine whether the capacity of the CPU cache is saturated, if so, discarding contents in a memory space in which no read-write operation occurs in a latest preset number period in the CPU cache according to a least recently applicable principle, and writing new contents into a corresponding space, so that the loading speed is ensured as much as possible under the condition of lowest negative effects affecting other processes.
By executing the steps, the mobile terminal image looking-around method provided by the embodiment of the invention. When a target is observed for the first time, firstly downloading a looking-around image library from a network into a local image resource pool of a mobile terminal, then obtaining current offset information of a current position relative to a reference position when observing a certain looking-around angle of the target, then extracting a target image from the looking-around image library based on the current offset information for display, and extracting a plurality of candidate images together with the target image as a cache image to be loaded into a cache. Second offset information of the next position with respect to the reference position is acquired while observing the next angle of the target. A second target image is then determined in the cached image for display based on the second offset information. According to the method, the target looking-around image library is downloaded to the mobile terminal for local storage, the problem that image loading is unsuccessful due to network delay and other phenomena is avoided, and compared with the traditional VR technology, the image display effect is improved. And a caching mechanism is adopted to store the display control, and some images adjacent to the target image are loaded into the memory or the display control in the CPU cache in advance, so that when the mobile terminal next time goes on looking around the angle offset, the adjacent second target image is directly extracted from the cache pool to display, the consistency of the image display is ensured, and the memory occupancy rate is reduced. And VR technology is not used, so that the volume of a mobile terminal program is greatly reduced, and more space is released for the mobile device.
In addition, the labels in the image storage in the looking-around image library are the offset ranges of the offset distance values corresponding to all looking-around angles, so that the image storage quantity is reduced, the situation that one picture is required to be stored when all angles are slightly changed is avoided, and the occupation of the local space of the mobile terminal is reduced. Therefore, when the image is extracted, as long as the offset value of the image falls into a certain offset range, the corresponding image can be found for display, and the consistency of the image display is maintained. In the embodiment of the invention, aiming at the condition that the memory or the buffer memory is saturated when the buffer memory image is loaded into the memory or the CPU buffer memory, a method for discarding the least frequently used buffer memory content is used to free up corresponding space so as to ensure the reliability of image loading.
As shown in fig. 4, this embodiment further provides a mobile-end image looking-around system, which includes:
the resource obtaining module 101 is configured to obtain a looking-around image library, where the looking-around image library includes reference images and other images, and the other images are obtained based on offset information of other positions relative to a reference position of the reference images. For details, refer to the related description of step S101 in the above method embodiment, and no further description is given here.
A first offset calculation module 102, configured to obtain current offset information of the current position relative to the reference position. For details, refer to the related description of step S102 in the above method embodiment, and no further description is given here.
The first image extraction module 103 is configured to extract, based on the current offset information, a target image from the looking-around image library for display, and extract a plurality of candidate images to be loaded as a cache image together with the target image, where a difference value between the offset information corresponding to the candidate images and the current offset information is within a preset range. For details, see the description of step S103 in the above method embodiment, and the details are not repeated here.
The second offset calculation module 104 is configured to obtain second offset information of the next position relative to the reference position. For details, refer to the related description of step S104 in the above method embodiment, and no further description is given here.
The second image extraction module 105 is configured to determine a second target image in the cached image for display based on the second offset information. For details, see the description of step S105 in the above method embodiment, and the details are not repeated here.
The embodiment of the invention provides a mobile terminal image looking-around system, which is used for executing the mobile terminal image looking-around method provided by the embodiment, the implementation mode and the principle are the same, and details are referred to the related description of the embodiment of the method and are not repeated.
Through the cooperation of the components, the mobile terminal image looking-around system provided by the embodiment of the invention. When a target is observed for the first time, the system downloads a looking-around image library from a network to a local image resource pool of a mobile terminal, acquires current offset information of a current position relative to a reference position when observing a certain looking-around angle of the target, extracts a target image from the looking-around image library based on the current offset information for display, and extracts a plurality of candidate images together with the target image as cache images to be loaded into a cache. Second offset information of the next position with respect to the reference position is acquired while observing the next angle of the target. A second target image is then determined in the cached image for display based on the second offset information. According to the method, the target looking-around image library is downloaded to the mobile terminal for local storage, the problem that image loading is unsuccessful due to network delay and other phenomena is avoided, and compared with the traditional VR technology, the image display effect is improved. And a caching mechanism is adopted to store the display control, and some images adjacent to the target image are loaded into the memory or the display control in the CPU cache in advance, so that when the mobile terminal next time goes on looking around the angle offset, the adjacent second target image is directly extracted from the cache pool to display, the consistency of the image display is ensured, and the memory occupancy rate is reduced. And VR technology is not used, so that the volume of a mobile terminal program is greatly reduced, and more space is released for the mobile device.
In addition, the labels in the image storage in the looking-around image library are the offset ranges of the offset distance values corresponding to all looking-around angles, so that the image storage quantity is reduced, the situation that one picture is required to be stored when all angles are slightly changed is avoided, and the occupation of the local space of the mobile terminal is reduced. Therefore, when the image is extracted, as long as the offset value of the image falls into a certain offset range, the corresponding image can be found for display, and the consistency of the image display is maintained. In the embodiment of the invention, aiming at the condition that the memory or the buffer memory is saturated when the buffer memory image is loaded into the memory or the CPU buffer memory, a method for discarding the least frequently used buffer memory content is used to free up corresponding space so as to ensure the reliability of image loading.
Fig. 5 shows a mobile device according to an embodiment of the invention, the device comprising: a processor 901, a memory 902 and a position sensor 903. The position sensor 903 and the memory 902 are communicatively connected to the processor 901, respectively, and in fig. 5, bus connection is taken as an example.
The position sensor 903 is used for detecting offset information of the mobile terminal compared with a reference position, and a gyroscope is used in the embodiment of the present invention.
The processor 901 may be a central processing unit (Central Processing Unit, CPU). The Processor 901 may also be other general purpose processors, digital signal processors (DIGITAL SIGNAL processors, DSPs), application SPECIFIC INTEGRATED Circuits (ASICs), field-Programmable gate arrays (Field-Programmable GATE ARRAY, FPGA) or other Programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or combinations thereof.
The memory 902 is used as a non-transitory computer readable storage medium for storing non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the methods in the method embodiments described above. The processor 901 executes various functional applications of the processor and data processing, i.e., implements the methods in the above-described method embodiments, by running non-transitory software programs, instructions, and modules stored in the memory 902.
The memory 902 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for a function; the storage data area may store data created by the processor 901, and the like. In addition, the memory 902 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 902 optionally includes memory remotely located relative to processor 901, which may be connected to processor 901 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
One or more modules are stored in the memory 902 that, when executed by the processor 901, perform the methods of the method embodiments described above.
The specific details of the mobile device may be correspondingly understood by referring to the corresponding related descriptions and effects in the above method embodiments, which are not repeated herein.
It will be appreciated by those skilled in the art that implementing all or part of the above-described methods in the embodiments may be implemented by a computer program for instructing relevant hardware, and the implemented program may be stored in a computer readable storage medium, and the program may include the steps of the embodiments of the above-described methods when executed. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a Flash Memory (Flash Memory), a hard disk (HARD DISK DRIVE, abbreviated as HDD), a Solid state disk (Solid-STATE DRIVE, SSD), or the like; the storage medium may also comprise a combination of memories of the kind described above.
Although embodiments of the present invention have been described in connection with the accompanying drawings, various modifications and variations may be made by those skilled in the art without departing from the spirit and scope of the invention, and such modifications and variations are within the scope of the invention as defined by the appended claims.
Claims (9)
1. A method for looking around a mobile terminal image, the method comprising:
Extracting images of all the looking-around angles of the target to form a looking-around image library; selecting any one image in the looking-around image library as a reference image; calculating an offset value of each image by using the offset angle of each image in the looking-around image library and the reference image, wherein the offset value is the offset of the spatial picture distance of each image compared with the reference image; adjusting the offset value corresponding to each image in the looking-around image library into an offset range with a preset size which can be connected according to the connection relation of each image in space, and marking the corresponding image by utilizing the offset range;
Acquiring a looking-around image library, wherein the looking-around image library comprises reference images and other images, and the other images are obtained based on offset information of other positions relative to the reference positions of the reference images;
acquiring current offset information of a current position relative to the reference position;
extracting a target image from the looking-around image library based on the current offset information for display, extracting a plurality of alternative images and loading the alternative images and the target image together into a cache image, wherein the difference value between the offset information corresponding to the alternative images and the current offset information is within a preset range;
Acquiring second offset information of the next position relative to the reference position;
and determining a second target image in the cached image based on the second offset information for display.
2. The method of claim 1, wherein the obtaining current offset information for the current location relative to the reference location comprises:
Acquiring an offset angle of the current position compared with a reference position;
And calculating a current offset value of the current visual angle compared with the reference image by utilizing the offset angle, and taking the current offset value as the current offset information.
3. The method of claim 2, wherein extracting the target image from the look-around image library for display based on the current offset information comprises:
Comparing the current offset value with the offset ranges of all images in the looking-around image library, and finding out a target offset range containing the current offset value;
and extracting a target image corresponding to the target offset range.
4. A method according to claim 1 or 3, wherein the extracting a plurality of candidate images and loading the candidate images together with the target image into a buffer image, wherein the difference between the offset information corresponding to the candidate images and the current offset information is within a preset range, comprises:
Extracting a first alternative image, wherein the difference value between the offset information corresponding to the first alternative image and the current offset information is within a preset range;
Extracting a preset number of candidate images from the first candidate images according to the distance sequence from the first candidate images to the target image;
and loading the candidate images and the target images into cache images according to the arrangement sequence of actual space display.
5. The method of claim 4, wherein the obtaining second offset information for the next location relative to the reference location; determining a second target image in the cached image for display based on the second offset information, including:
Acquiring a second offset angle of the next position compared with the reference position, and calculating a second offset value of the next view compared with the reference image by using the second offset angle as second offset information;
Comparing the second offset value with the offset ranges of the images in the cache image, and determining a second offset range, wherein the second offset range comprises a second offset value;
And sending and displaying the image corresponding to the second offset range in the cached image as a second target image.
6. The method of claim 1, wherein prior to the extracting the plurality of candidate images to be loaded as cached images with the target image, the method further comprises:
judging whether the current memory or CPU buffer capacity is saturated or not;
If the memory or CPU buffer capacity is saturated, searching out a buffer space in the memory or CPU buffer, wherein no read-write operation occurs in a preset number of read-write cycles, and discarding the content in the buffer space so that the buffer image can be loaded into the memory or CPU buffer.
7. A mobile-side image look-around system, the system comprising:
The resource acquisition module is used for extracting images of all the looking-around angles of the target to form a looking-around image library; selecting any one image in the looking-around image library as a reference image; calculating an offset value of each image by using the offset angle of each image in the looking-around image library and the reference image, wherein the offset value is the offset of the spatial picture distance of each image compared with the reference image; adjusting the offset value corresponding to each image in the looking-around image library into an offset range with a preset size which can be connected according to the connection relation of each image in space, and marking the corresponding image by utilizing the offset range; acquiring a looking-around image library, wherein the looking-around image library comprises reference images and other images, and the other images are obtained based on offset information of other positions relative to the reference positions of the reference images;
the first offset calculation module is used for acquiring current offset information of the current position relative to the reference position;
The first image extraction module is used for extracting a target image from the looking-around image library based on the current offset information for display, extracting a plurality of alternative images and loading the target image together into a cache image, wherein the difference value between the offset information corresponding to the alternative images and the current offset information is within a preset range;
The second offset calculation module is used for acquiring second offset information of the next position relative to the reference position;
And the second image extraction module is used for determining a second target image in the cache image based on the second offset information for display.
8. A mobile device, comprising:
A memory and a processor in communication with each other, the memory having stored therein computer instructions that, upon execution, perform the method of any of claims 1-6;
and the position sensor is connected with the processor and used for detecting offset information of the mobile terminal compared with the reference position.
9. A computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111197641.7A CN113934495B (en) | 2021-10-14 | 2021-10-14 | Mobile terminal image looking-around method, system and mobile device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111197641.7A CN113934495B (en) | 2021-10-14 | 2021-10-14 | Mobile terminal image looking-around method, system and mobile device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113934495A CN113934495A (en) | 2022-01-14 |
| CN113934495B true CN113934495B (en) | 2024-05-24 |
Family
ID=79279233
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111197641.7A Active CN113934495B (en) | 2021-10-14 | 2021-10-14 | Mobile terminal image looking-around method, system and mobile device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113934495B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014103501A1 (en) * | 2012-12-28 | 2014-07-03 | 興和株式会社 | Image processing device, image processing method, image processing program, and recording medium storing said program |
| CN105313779A (en) * | 2014-06-10 | 2016-02-10 | Lg电子株式会社 | Around view provision apparatus and vehicle including the same |
| CN105611169A (en) * | 2015-12-31 | 2016-05-25 | 联想(北京)有限公司 | Image obtaining method and electronic device |
| CN108846889A (en) * | 2018-06-29 | 2018-11-20 | 苏州大学张家港工业技术研究院 | 3-dimensional image information acquisition method, mobile terminal and system |
| CN110505398A (en) * | 2019-07-16 | 2019-11-26 | 北京三快在线科技有限公司 | A kind of image processing method, device, electronic equipment and storage medium |
-
2021
- 2021-10-14 CN CN202111197641.7A patent/CN113934495B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014103501A1 (en) * | 2012-12-28 | 2014-07-03 | 興和株式会社 | Image processing device, image processing method, image processing program, and recording medium storing said program |
| CN105313779A (en) * | 2014-06-10 | 2016-02-10 | Lg电子株式会社 | Around view provision apparatus and vehicle including the same |
| CN105611169A (en) * | 2015-12-31 | 2016-05-25 | 联想(北京)有限公司 | Image obtaining method and electronic device |
| CN108846889A (en) * | 2018-06-29 | 2018-11-20 | 苏州大学张家港工业技术研究院 | 3-dimensional image information acquisition method, mobile terminal and system |
| CN110505398A (en) * | 2019-07-16 | 2019-11-26 | 北京三快在线科技有限公司 | A kind of image processing method, device, electronic equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 嵌入多级空间量化差值信息的局部特征匹配策略;白丰;张明路;张小俊;张建华;高涵;;小型微型计算机系统;20171015(10);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113934495A (en) | 2022-01-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102750664B (en) | Based on the queuing to texture requests of register | |
| TWI671647B (en) | Method, device and electronic device for calculating the duration of the first screen of a page | |
| EP2804096A2 (en) | Efficient Fetching of a Map Data During Animation | |
| KR102421701B1 (en) | Systems and Methods for Accelerating Content Delivery of Virtual Reality and Augmented Reality Web Pages | |
| US20210021817A1 (en) | Hologram streaming machine | |
| US20150007108A1 (en) | Infinite scrolling a very large dataset | |
| WO2018058811A1 (en) | Virtual reality scene loading method and device | |
| CN109388317B (en) | Picture loading method, terminal device and storage medium | |
| JP2002533837A (en) | System and method for maintaining synchronization between emulation time and real time | |
| CN110020300B (en) | Browser page synthesis method and terminal | |
| CN104321762A (en) | Page phase time | |
| CN112487871B (en) | Handwriting data processing method and device and electronic equipment | |
| CN113989442A (en) | Building information model construction method and related device | |
| CN112449230B (en) | Character string display processing method, device, terminal and storage medium | |
| CN107783886A (en) | A kind of method and terminal for obtaining operation frame per second | |
| US20170287187A1 (en) | Method of generating a synthetic image | |
| CN113934495B (en) | Mobile terminal image looking-around method, system and mobile device | |
| US9135749B2 (en) | Method and apparatus for processing three-dimensional model data | |
| CN116208623B (en) | Information synchronization method, device, engine server and storage medium | |
| CN109493404A (en) | Three-dimensional rendering method and device | |
| CN114170365A (en) | System and method for accelerated ray tracing using asynchronous operations and ray transformation | |
| US20200110528A1 (en) | Rendering on a mobile device | |
| CN114913277A (en) | Method, device, equipment and medium for three-dimensional interactive display of object | |
| CN110825652B (en) | Method, device and equipment for eliminating cache data on disk block | |
| WO2009114107A1 (en) | Method and system for rendering a three-dimensional scene using a dynamic graphics platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |