CN113934495A - Mobile terminal image all-round viewing method, system and mobile equipment - Google Patents
Mobile terminal image all-round viewing method, system and mobile equipment Download PDFInfo
- Publication number
- CN113934495A CN113934495A CN202111197641.7A CN202111197641A CN113934495A CN 113934495 A CN113934495 A CN 113934495A CN 202111197641 A CN202111197641 A CN 202111197641A CN 113934495 A CN113934495 A CN 113934495A
- Authority
- CN
- China
- Prior art keywords
- image
- offset
- offset information
- images
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000015654 memory Effects 0.000 claims description 51
- 229920006395 saturated elastomer Polymers 0.000 claims description 10
- 239000000284 extract Substances 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 6
- 238000004364 calculation method Methods 0.000 claims description 5
- 238000005516 engineering process Methods 0.000 abstract description 15
- 230000000694 effects Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Controls And Circuits For Display Device (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a mobile terminal image all-round viewing method and a system, wherein the method comprises the following steps: acquiring a panoramic image library, wherein the panoramic image library comprises a reference image and other images, and the other images are obtained based on offset information of other positions relative to the reference position of the reference image; acquiring current offset information of a current position relative to a reference position; extracting a target image from a look-around image library based on the current offset information for displaying, extracting a plurality of alternative images and loading the alternative images and the target image together into a cache image, wherein the difference value between the offset information corresponding to the alternative images and the current offset information is within a preset range; acquiring second offset information of the next position relative to the reference position; a second target image is determined in the buffered image for display based on the second offset information. The technical scheme provided by the invention solves the problem that the traditional VR technology occupies too much mobile terminal resources when looking around the observation target.
Description
Technical Field
The invention relates to the field of image display, in particular to a mobile terminal image all-around viewing method, a system and mobile equipment.
Background
With the development of mobile internet platforms, in order to better transmit appearance information of products to users on a mobile terminal internet page, a simple picture cannot be interactively displayed from the perspective of the users, so that a Virtual Reality technology (VR) arises, and a basic implementation manner of the Virtual Reality technology is that a computer simulates a Virtual environment, so that people have environmental immersion. With the continuous development of social productivity and scientific technology, VR technology is increasingly in great demand in various industries. The VR technology has made great progress and gradually becomes a new scientific and technical field. The VR technology needs a panoramic picture to be loaded on a memory based on OpenGl, and is realized by rotating a sphere model, so that the memory overhead during software operation is increased. And the VR mode can obviously increase the volume of the software installation package and occupy more storage space of the mobile terminal. How to reduce the resource occupation of software is an urgent problem to be solved on the premise of ensuring the look-around visual effect as much as possible.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method, a system, and a mobile device for mobile-side image lookaround, which solve the problem of excessive mobile-side resources occupied when looking around an observation target in the conventional VR technology.
According to a first aspect, an embodiment of the present invention provides a mobile terminal image looking-around method, where the method includes: acquiring a panoramic image library, wherein the panoramic image library comprises a reference image and other images, and the other images are obtained based on offset information of other positions relative to the reference position of the reference image; acquiring current offset information of a current position relative to the reference position; extracting a target image from the all-around image library based on the current offset information for displaying, and extracting a plurality of candidate images and the target image to be loaded together as a cache image, wherein the difference value between the offset information corresponding to the candidate images and the current offset information is within a preset range; acquiring second offset information of a next position relative to the reference position; determining a second target image in the cached image for display based on the second offset information.
Optionally, before the acquiring the all-around image library, the step of generating the all-around image library includes: extracting images of all the perspective angles of the target to form a perspective image library; selecting any one image in the all-round-view image library as a reference image; calculating the offset value of each image by using the offset angle between each image in the all-around view image library and the reference image, wherein the offset value is the offset of the space picture distance between each image and the reference image; and adjusting the offset value corresponding to each image in the all-around image library into an offset range with a preset size capable of being connected according to the connection relation of each image in the space, and marking the corresponding image by using the offset range.
Optionally, the acquiring current offset information of the current position relative to the reference position includes: acquiring a deviation angle of the current position compared with the reference position; and calculating a current offset value of the current view angle compared with the reference image by using the offset angle, and taking the current offset value as the current offset information.
Optionally, the extracting, for display, a target image from the all-around image library based on the current offset information includes: comparing the current offset value with the offset range of each image in the all-around image library, and finding out a target offset range containing the current offset value; and extracting a target image corresponding to the target offset range.
Optionally, the extracting a plurality of candidate images and the target image are loaded together as a cache image, and a difference value between offset information corresponding to the candidate images and the current offset information is within a preset range includes: extracting a first candidate image, wherein the difference value between the offset information corresponding to the first candidate image and the current offset information is within a preset range; extracting a preset number of the alternative images from the first alternative images according to the distance sequence of the first alternative images from the target image from near to far; and loading the alternative images and the target images into cache images according to the arrangement sequence displayed in the actual space.
Optionally, the obtaining second offset information of the next position relative to the reference position; determining a second target image in the cached image for display based on the second offset information, comprising: acquiring a second offset angle of the next position compared with the reference position, and calculating a second offset value of the next view compared with the reference image by using the second offset angle as second offset information; comparing the second offset value with the offset range of each image in the cache image, and determining a second offset range, wherein the second offset range comprises the second offset value; and sending and displaying an image corresponding to the second offset range in the cache image as a second target image.
Optionally, before the extracting the plurality of candidate images and the target image are loaded as a cache image together, the method further includes: judging whether the current memory or CPU cache capacity is saturated; and if the memory or the CPU cache capacity is saturated, searching out a cache space in the memory or the CPU cache, in which no read-write operation occurs within a preset number of read-write cycles, and discarding the content in the cache space so as to load the cache image into the memory or the CPU cache.
According to a second aspect, a mobile-side image looking around system, the system comprising: the system comprises a resource acquisition module, a data processing module and a data processing module, wherein the resource acquisition module is used for acquiring a panoramic image library, the panoramic image library comprises a reference image and other images, and the other images are obtained based on offset information of other positions relative to the reference position of the reference image; the first offset calculation module is used for acquiring current offset information of the current position relative to the reference position; a first image extraction module, configured to extract a target image from the all-around-view image library based on the current offset information for display, and extract a plurality of candidate images to be loaded with the target image as a cache image, where a difference between offset information corresponding to the candidate images and the current offset information is within a preset range; the second offset calculation module is used for acquiring second offset information of the next position relative to the reference position; a second image extraction module to determine a second target image in the cached image for display based on the second offset information.
According to a third aspect, a mobile device comprises:
a memory and a processor, the memory and the processor being communicatively coupled to each other, the memory having stored therein computer instructions, and the processor performing the method of the first aspect, or any one of the optional embodiments of the first aspect, by executing the computer instructions.
And the position sensor is connected with the processor and used for detecting the deviation information of the mobile terminal compared with the reference position.
According to a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, which stores computer instructions for causing a computer to thereby perform the method of the first aspect, or any one of the optional implementation manners of the first aspect.
The technical scheme of the invention has the following advantages:
the embodiment of the invention provides a mobile terminal image all-round viewing method. When a target is observed for the first time, a look-around image library is downloaded from a network to a local image resource pool of a mobile terminal, then current offset information of a current position relative to a reference position is obtained when a certain look-around angle of the target is observed, then a target image is extracted from the look-around image library based on the current offset information for displaying, and a plurality of alternative images and the target image are extracted and loaded into a cache as a cache image. Second offset information of a next position with respect to the reference position is acquired at a next angle of the observation target. A second target image is then determined in the buffered image for display based on the second offset information. The method downloads the target all-around image library to the mobile terminal for local storage, avoids the problem of unsuccessful image loading caused by network delay and the like, and improves the image display effect compared with the traditional VR technology. And a cache mechanism is adopted to store the display control, and some images adjacent to the target image are loaded into the memory or the display control in the CPU cache in advance, so that when the mobile terminal generates the next round-looking angle deviation, the adjacent second target image is directly extracted from the cache pool to be displayed, the continuity of picture display is ensured, and the memory occupancy rate is reduced. And the volume of a mobile terminal program is greatly reduced without using VR technology, and more space is released for the mobile equipment.
In addition, the label when the images in the all-round view image library are stored is the offset range of the offset distance value corresponding to each all-round view angle, the image storage quantity is reduced, the situation that one image is required to be stored when each angle is slightly changed is avoided, and the occupation of the local space of the mobile terminal is reduced. Therefore, when the image is extracted, as long as the offset value of the image falls into a certain offset range, the corresponding image can be found for displaying, and the continuity of image display is kept. In the embodiment of the invention, when the cache image is loaded into the memory or the CPU cache, the memory or the cache is saturated, and a method for discarding the least common cache content is used to vacate the corresponding space so as to ensure the reliability of image loading.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic step diagram of a mobile terminal image looking-around method according to an embodiment of the present invention;
fig. 2 is a schematic view illustrating a mobile terminal image looking around method according to an embodiment of the present invention;
fig. 3 is a schematic diagram illustrating an effect of loading an image from a cache pool and displaying the image according to the mobile terminal image look-around method in the embodiment of the present invention;
fig. 4 is a schematic structural diagram of a mobile-side image looking-around system according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a mobile device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The technical features mentioned in the different embodiments of the invention described below can be combined with each other as long as they do not conflict with each other.
Referring to fig. 1 and fig. 2, a mobile terminal image looking around method according to an embodiment of the present invention includes the following steps:
step S101: and acquiring a around-looking image library, wherein the around-looking image library comprises the reference image and other images, and the other images are obtained based on the offset information of the other positions relative to the reference position of the reference image. Specifically, the function realized by the embodiment of the invention is to look around any target to be observed at any angle in space. And storing the images shot at all angles around the target to be observed. Before the mobile terminal observes, a panoramic image library storing images of various angles of the target to be observed is downloaded from the server to a local image resource pool of the mobile terminal. In the embodiment of the invention, the images are compressed and stored in the webp format, so that the definition of the images is ensured, and the problem of overlarge local storage space occupied by too many images is solved. In the subsequent observation process of the image resource pool, the images are not loaded from the network in real time, but are directly loaded from the local, so that compared with the VR technology, the image loading speed is greatly increased, and the memory occupancy rate is reduced. The around-view image library includes a reference image and a plurality of other images. The reference image is an initial angle image which is displayed on the screen when the program starts to be started, and other images are images of other angles of the observed target in the space.
Step S102: current offset information of the current position relative to the reference position is acquired. Specifically, when the mobile terminal starts to observe, the mobile terminal firstly obtains the offset between the current screen position and the reference position through a position sensor inside the device, and then searches for an image at a position corresponding to the offset information in an image resource pool by using the obtained offset information. The position sensor can adopt a gyroscope, a gravity sensor, a displacement sensor and the like. The embodiment of the invention realizes the position change detection based on the gyroscope.
Step S103: and extracting a target image from the all-around image library based on the current offset information for displaying, extracting a plurality of candidate images and loading the candidate images and the target image together into a cache image, wherein the difference value between the offset information corresponding to the candidate images and the current offset information is within a preset range. Specifically, after the target image is acquired, a difference value calculation is performed according to the offset information of the other images and the offset information of the target image, and the difference value represents a plurality of images of adjacent viewing angles at two sides of the viewing angle of the target image within a preset range, for example: the preset range of the offset difference is the distance length of +/-50, images of other visual angles of which the visual angles at two sides of the target image extend to the distance of 50 are contained, the images and the target image are loaded into the display control together, and then the display control is loaded into the cache pool, so that when the mobile terminal is offset again, the images are directly extracted from the cache pool and displayed, and the image display speed is greatly increased. The cache pool can be selected from a memory or a CPU cache space, in the embodiment of the invention, the cache pool occupies a memory of the CPU and is used for storing the picture resource loaded to the mobile terminal system, and the cache pool is realized by adopting the existing cache pool LrucCache principle of the android system Api.
Step S104: acquiring second offset information of the next position relative to the reference position;
step S105: a second target image is determined in the buffered image for display based on the second offset information.
Specifically, after second offset information of the next offset position is obtained, the corresponding second target image is directly found from the cache pool to be displayed, and the speed and the continuity of image display are improved. Whether the second offset information can be successfully matched with the image in the cache pool or not is related to the sensitivity of the adopted gyroscope, the response precision of the traditional gyroscope can ensure displacement change under most conditions, and the offset can find the corresponding image in the cache pool.
Specifically, in an embodiment, in the step S101, the step of generating the around-view image library includes:
s1011: and extracting images of all the perspective angles of the target to form a perspective image library.
S1012: and selecting any one image in the all-round-view image library as a reference image.
S1013: and calculating the offset value of each image by using the offset angle between each image in the all-around view image library and the reference image, wherein the offset value is the spatial picture distance offset of each image compared with the reference image.
S1014: and adjusting the offset value corresponding to each image in the all-around image library into an offset range with a preset size capable of being connected according to the connection relation of each image in the space, and marking the corresponding image by using the offset range.
Specifically, images of the photographed target at various angles are firstly stored, and the more uniform the photographed angles are, the greater the number of images is, the better the effect continuity of the subsequent image observation is. And then selecting any one of the all-around images as a reference image, calculating the angle offset of other images relative to the reference image in the circumference, and calculating the distance offset of each image relative to the view angle of the reference image as an offset value based on the angle offset, wherein the offset value of the reference image is 0. For example: the images at all angles of the circumference are arranged in a row on the plane, and each image has a length distance compared with the reference image, and the length distance is an offset value. If the space circumference is calculated according to 360 degrees, 360 pictures exist, if the circumference dividing precision is higher, the number of the pictures is more, but all the pictures with the small angles are stored, the number and the storage amount are huge, and the offset value of each angle picture can not be realized, so that the offset ranges of the pictures with the angles are adjusted to be mutually connected according to the space sequence. The quantity and magnitude of the pictures are not too large, the observation requirement is met, and the occupation of the storage space is reduced. For example: and the deviation value of the graph A compared with the reference image is 10mm, the deviation value of the graph B compared with the reference image is 15mm, when the graph A and the graph B are adjacent during acquisition, the deviation range of the graph A is adjusted to be 8-12 mm, the deviation range of the graph B is adjusted to be 13-17 mm, and the deviation range is used as an image corresponding to label labeling. Therefore, when the offset occurs, the corresponding target image can be found by judging whether the offset value falls into a certain offset range, for example: and the offset value is 9mm, the corresponding target image is the A picture.
Specifically, in an embodiment, the step S102 specifically includes the following steps:
step S1021: and acquiring the offset angle of the current position compared with the reference position.
Step S1022: and calculating a current offset value of the current view angle compared with the reference image by using the offset angle, and taking the current offset value as current offset information.
Specifically, based on the storage method of the images in steps S1011 to S1014, the current offset value is calculated from the offset angle fed back by the current gyroscope. For the specific principle, reference is made to the description of steps S1011 to S1014, which is not described herein again.
Specifically, in an embodiment, the step S103 specifically includes the following steps:
step S1031: comparing the current offset value with the offset range of each image in the all-around image library, and finding out a target offset range containing the current offset value;
step S1032: and extracting a target image corresponding to the target offset range.
Specifically, the description of the principle explanation referring to steps S1011 to S1014 is omitted here for brevity.
Specifically, in an embodiment, the step S103 further includes the following steps:
step S1033: and extracting a first candidate image, wherein the difference value between the offset information corresponding to the first candidate image and the current offset information is in a preset range.
Step S1034: and extracting a preset number of candidate images from the first candidate images according to the distance sequence of the first candidate images from the target image from near to far.
Step S1035: and loading the alternative images and the target images into cache images according to the arrangement sequence displayed in the actual space.
Specifically, considering that the memory or the CPU buffer capacity is limited, too many images cannot be stored in the buffer pool, and if the number of candidate images satisfying the condition within the preset range is too large, the CPU buffer pool occupies too much CPU cache space. On the basis, the situation that the difference value between the offset value of other images on the two sides of the target image and the offset value of the target image is within the preset range and the corresponding other images are too many is prevented, and the images with the adjacent preset number of the target image are selected and loaded into the cache.
Specifically, in an embodiment, the steps S104 to S105 specifically include the following steps:
step S1051: and acquiring a second offset angle of the next position compared with the reference position, and calculating a second offset value of the next view compared with the reference image by using the second offset angle as second offset information.
Step S1052: and comparing the second offset value with the offset range of each image in the cached images, and determining a second offset range, wherein the second offset range comprises the second offset value.
Step S1053: and sending and displaying an image corresponding to the second offset range in the cache image as a second target image.
Specifically, when the mobile terminal generates a second offset, an inspection mechanism in the display control starts to inspect whether a new offset value hits an offset range of each image in the cache pool, if so, finds out a second offset range including the second offset value in the cache pool, and extracts a second target image corresponding to the second offset range for display, and if the gyroscope sensitivity is not followed due to the fact that the mobile terminal has too fast displacement change and too large angle, the display control detects that the second offset value does not hit any one of the pictures in the cache pool, and then the display control extracts the corresponding second target image from the image resource pool for display, and extracts an image adjacent to the second target image and adds the image into the cache pool.
Specifically, in an embodiment, before the step S103, the method further includes:
step S201: and judging whether the current memory or the CPU cache capacity is saturated or not.
Step S202: if the memory or the CPU cache capacity is saturated, searching out a cache space in the memory or the CPU cache, in which no read-write operation occurs within a preset number of read-write cycles, and discarding the content in the cache space, so that the cache image can be loaded to the memory or the CPU cache.
Specifically, before loading an image into a CPU cache, it is necessary to determine whether the capacity of the CPU cache is saturated, and if so, discard the content in the memory space in which no read-write operation has occurred within the latest preset number of cycles in the CPU cache according to the least recently applicable principle, and write the new content into the corresponding space, thereby ensuring the loading speed as far as possible under the condition of the lowest negative effect on other processes.
By executing the above steps, the embodiment of the invention provides a mobile terminal image all-around viewing method. When a target is observed for the first time, a look-around image library is downloaded from a network to a local image resource pool of a mobile terminal, then current offset information of a current position relative to a reference position is obtained when a certain look-around angle of the target is observed, then a target image is extracted from the look-around image library based on the current offset information for displaying, and a plurality of alternative images and the target image are extracted and loaded into a cache as a cache image. Second offset information of a next position with respect to the reference position is acquired at a next angle of the observation target. A second target image is then determined in the buffered image for display based on the second offset information. The method downloads the target all-around image library to the mobile terminal for local storage, avoids the problem of unsuccessful image loading caused by network delay and the like, and improves the image display effect compared with the traditional VR technology. And a cache mechanism is adopted to store the display control, and some images adjacent to the target image are loaded into the memory or the display control in the CPU cache in advance, so that when the mobile terminal generates the next round-looking angle deviation, the adjacent second target image is directly extracted from the cache pool to be displayed, the continuity of picture display is ensured, and the memory occupancy rate is reduced. And the volume of a mobile terminal program is greatly reduced without using VR technology, and more space is released for the mobile equipment.
In addition, the label when the images in the all-round view image library are stored is the offset range of the offset distance value corresponding to each all-round view angle, the image storage quantity is reduced, the situation that one image is required to be stored when each angle is slightly changed is avoided, and the occupation of the local space of the mobile terminal is reduced. Therefore, when the image is extracted, as long as the offset value of the image falls into a certain offset range, the corresponding image can be found for displaying, and the continuity of image display is kept. In the embodiment of the invention, when the cache image is loaded into the memory or the CPU cache, the memory or the cache is saturated, and a method for discarding the least common cache content is used to vacate the corresponding space so as to ensure the reliability of image loading.
As shown in fig. 4, the present embodiment further provides a mobile terminal image looking around system, which includes:
the resource obtaining module 101 is configured to obtain a around-view image library, where the around-view image library includes a reference image and other images, and the other images are obtained based on offset information of other positions relative to a reference position of the reference image. For details, refer to the related description of step S101 in the above method embodiment, and no further description is provided here.
The first offset calculating module 102 is configured to obtain current offset information of the current position relative to the reference position. For details, refer to the related description of step S102 in the above method embodiment, and no further description is provided here.
The first image extraction module 103 is configured to extract a target image from the all-around-view image library based on the current offset information for display, and extract a plurality of candidate images to be loaded as a cache image together with the target image, where a difference value between offset information corresponding to the candidate images and the current offset information is within a preset range. For details, refer to the related description of step S103 in the above method embodiment, and no further description is provided here.
And a second offset calculating module 104, configured to obtain second offset information of the next position relative to the reference position. For details, refer to the related description of step S104 in the above method embodiment, and no further description is provided here.
And a second image extraction module 105, configured to determine a second target image in the buffered image for display based on the second offset information. For details, refer to the related description of step S105 in the above method embodiment, and no further description is provided here.
The mobile terminal image looking-around system provided by the embodiment of the present invention is configured to execute the mobile terminal image looking-around method provided by the above embodiment, and the implementation manner and the principle thereof are the same, and the details refer to the related description of the above method embodiment and are not described again.
Through the cooperation of the above components, the embodiment of the invention provides a mobile terminal image all-around viewing system. When a target is observed for the first time, a look-around image library is downloaded from a network to a local image resource pool of a mobile terminal, then current offset information of a current position relative to a reference position is obtained when a certain look-around angle of the target is observed, then a target image is extracted from the look-around image library based on the current offset information for displaying, and a plurality of alternative images and the target image are extracted and loaded into a cache as a cache image. Second offset information of a next position with respect to the reference position is acquired at a next angle of the observation target. A second target image is then determined in the buffered image for display based on the second offset information. The method downloads the target all-around image library to the mobile terminal for local storage, avoids the problem of unsuccessful image loading caused by network delay and the like, and improves the image display effect compared with the traditional VR technology. And a cache mechanism is adopted to store the display control, and some images adjacent to the target image are loaded into the memory or the display control in the CPU cache in advance, so that when the mobile terminal generates the next round-looking angle deviation, the adjacent second target image is directly extracted from the cache pool to be displayed, the continuity of picture display is ensured, and the memory occupancy rate is reduced. And the volume of a mobile terminal program is greatly reduced without using VR technology, and more space is released for the mobile equipment.
In addition, the label when the images in the all-round view image library are stored is the offset range of the offset distance value corresponding to each all-round view angle, the image storage quantity is reduced, the situation that one image is required to be stored when each angle is slightly changed is avoided, and the occupation of the local space of the mobile terminal is reduced. Therefore, when the image is extracted, as long as the offset value of the image falls into a certain offset range, the corresponding image can be found for displaying, and the continuity of image display is kept. In the embodiment of the invention, when the cache image is loaded into the memory or the CPU cache, the memory or the cache is saturated, and a method for discarding the least common cache content is used to vacate the corresponding space so as to ensure the reliability of image loading.
Fig. 5 shows a mobile device of an embodiment of the present invention, the device including: a processor 901, a memory 902, and a position sensor 903. The position sensor 903 and the memory 902 are respectively connected to the processor 901 in a communication manner, and fig. 5 illustrates a bus connection as an example.
The position sensor 903 is used to detect the offset information of the mobile terminal from the reference position, and in the embodiment of the present invention, a gyroscope is used.
The memory 902, which is a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the methods in the above-described method embodiments. The processor 901 executes various functional applications and data processing of the processor by executing non-transitory software programs, instructions and modules stored in the memory 902, that is, implements the methods in the above-described method embodiments.
The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created by the processor 901, and the like. Further, the memory 902 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 902 may optionally include memory located remotely from the processor 901, which may be connected to the processor 901 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
One or more modules are stored in the memory 902, which when executed by the processor 901 performs the methods in the above-described method embodiments.
The specific details of the mobile device may be understood by referring to the corresponding related descriptions and effects in the above method embodiments, and are not described herein again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, and the implemented program can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.
Claims (10)
1. A mobile terminal image looking-around method is characterized by comprising the following steps:
acquiring a panoramic image library, wherein the panoramic image library comprises a reference image and other images, and the other images are obtained based on offset information of other positions relative to the reference position of the reference image;
acquiring current offset information of a current position relative to the reference position;
extracting a target image from the all-around image library based on the current offset information for displaying, and extracting a plurality of candidate images and the target image to be loaded together as a cache image, wherein the difference value between the offset information corresponding to the candidate images and the current offset information is within a preset range;
acquiring second offset information of a next position relative to the reference position;
determining a second target image in the cached image for display based on the second offset information.
2. The method of claim 1, wherein prior to said obtaining the library of surround view images, the step of generating the library of surround view images comprises:
extracting images of all the perspective angles of the target to form a perspective image library;
selecting any one image in the all-round-view image library as a reference image;
calculating the offset value of each image by using the offset angle between each image in the all-around view image library and the reference image, wherein the offset value is the offset of the space picture distance between each image and the reference image;
and adjusting the offset value corresponding to each image in the all-around image library into an offset range with a preset size capable of being connected according to the connection relation of each image in the space, and marking the corresponding image by using the offset range.
3. The method of claim 2, wherein obtaining current offset information of the current position relative to the reference position comprises:
acquiring a deviation angle of the current position compared with the reference position;
and calculating a current offset value of the current view angle compared with the reference image by using the offset angle, and taking the current offset value as the current offset information.
4. The method of claim 3, wherein extracting the target image from the all-around image library for display based on the current offset information comprises:
comparing the current offset value with the offset range of each image in the all-around image library, and finding out a target offset range containing the current offset value;
and extracting a target image corresponding to the target offset range.
5. The method according to claim 1 or 4, wherein the extracting a plurality of candidate images and the target image are loaded together as a cache image, and a difference value between offset information corresponding to the candidate images and the current offset information is within a preset range, includes:
extracting a first candidate image, wherein the difference value between the offset information corresponding to the first candidate image and the current offset information is within a preset range;
extracting a preset number of the alternative images from the first alternative images according to the distance sequence of the first alternative images from the target image from near to far;
and loading the alternative images and the target images into cache images according to the arrangement sequence displayed in the actual space.
6. The method of claim 5, wherein the obtaining second offset information of the next position relative to the reference position; determining a second target image in the cached image for display based on the second offset information, comprising:
acquiring a second offset angle of the next position compared with the reference position, and calculating a second offset value of the next view compared with the reference image by using the second offset angle as second offset information;
comparing the second offset value with the offset range of each image in the cache image, and determining a second offset range, wherein the second offset range comprises the second offset value;
and sending and displaying an image corresponding to the second offset range in the cache image as a second target image.
7. The method of claim 1, wherein prior to the extracting the plurality of candidate images and loading the target image together as a cached image, the method further comprises:
judging whether the current memory or CPU cache capacity is saturated;
and if the memory or the CPU cache capacity is saturated, searching out a cache space in the memory or the CPU cache, in which no read-write operation occurs within a preset number of read-write cycles, and discarding the content in the cache space so as to load the cache image into the memory or the CPU cache.
8. A mobile-side image looking-around system, the system comprising:
the system comprises a resource acquisition module, a data processing module and a data processing module, wherein the resource acquisition module is used for acquiring a panoramic image library, the panoramic image library comprises a reference image and other images, and the other images are obtained based on offset information of other positions relative to the reference position of the reference image;
the first offset calculation module is used for acquiring current offset information of the current position relative to the reference position;
a first image extraction module, configured to extract a target image from the all-around-view image library based on the current offset information for display, and extract a plurality of candidate images to be loaded with the target image as a cache image, where a difference between offset information corresponding to the candidate images and the current offset information is within a preset range;
the second offset calculation module is used for acquiring second offset information of the next position relative to the reference position;
a second image extraction module to determine a second target image in the cached image for display based on the second offset information.
9. A mobile device, comprising:
a memory and a processor, the memory and the processor being communicatively coupled to each other, the memory having stored therein computer instructions, the processor performing the method of any of claims 1-7 by executing the computer instructions;
and the position sensor is connected with the processor and used for detecting the deviation information of the mobile terminal compared with the reference position.
10. A computer-readable storage medium having stored thereon computer instructions for causing a computer to thereby perform the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111197641.7A CN113934495B (en) | 2021-10-14 | 2021-10-14 | Mobile terminal image looking-around method, system and mobile device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111197641.7A CN113934495B (en) | 2021-10-14 | 2021-10-14 | Mobile terminal image looking-around method, system and mobile device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113934495A true CN113934495A (en) | 2022-01-14 |
| CN113934495B CN113934495B (en) | 2024-05-24 |
Family
ID=79279233
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111197641.7A Active CN113934495B (en) | 2021-10-14 | 2021-10-14 | Mobile terminal image looking-around method, system and mobile device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113934495B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014103501A1 (en) * | 2012-12-28 | 2014-07-03 | 興和株式会社 | Image processing device, image processing method, image processing program, and recording medium storing said program |
| CN105313779A (en) * | 2014-06-10 | 2016-02-10 | Lg电子株式会社 | Around view provision apparatus and vehicle including the same |
| CN105611169A (en) * | 2015-12-31 | 2016-05-25 | 联想(北京)有限公司 | Image obtaining method and electronic device |
| CN108846889A (en) * | 2018-06-29 | 2018-11-20 | 苏州大学张家港工业技术研究院 | 3-dimensional image information acquisition method, mobile terminal and system |
| CN110505398A (en) * | 2019-07-16 | 2019-11-26 | 北京三快在线科技有限公司 | A kind of image processing method, device, electronic equipment and storage medium |
-
2021
- 2021-10-14 CN CN202111197641.7A patent/CN113934495B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014103501A1 (en) * | 2012-12-28 | 2014-07-03 | 興和株式会社 | Image processing device, image processing method, image processing program, and recording medium storing said program |
| CN105313779A (en) * | 2014-06-10 | 2016-02-10 | Lg电子株式会社 | Around view provision apparatus and vehicle including the same |
| CN105611169A (en) * | 2015-12-31 | 2016-05-25 | 联想(北京)有限公司 | Image obtaining method and electronic device |
| CN108846889A (en) * | 2018-06-29 | 2018-11-20 | 苏州大学张家港工业技术研究院 | 3-dimensional image information acquisition method, mobile terminal and system |
| CN110505398A (en) * | 2019-07-16 | 2019-11-26 | 北京三快在线科技有限公司 | A kind of image processing method, device, electronic equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 白丰;张明路;张小俊;张建华;高涵;: "嵌入多级空间量化差值信息的局部特征匹配策略", 小型微型计算机系统, no. 10, 15 October 2017 (2017-10-15) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113934495B (en) | 2024-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020228511A1 (en) | Image occlusion processing method, device, apparatus and computer storage medium | |
| CN107945098B (en) | Image processing method, image processing device, computer equipment and storage medium | |
| TWI671647B (en) | Method, device and electronic device for calculating the duration of the first screen of a page | |
| CN109388317B (en) | Picture loading method, terminal device and storage medium | |
| WO2015143905A1 (en) | Picture loading device and method | |
| US20210021817A1 (en) | Hologram streaming machine | |
| CN108961183B (en) | Image processing method, terminal device and computer-readable storage medium | |
| KR20200126972A (en) | Systems and Methods for Accelerating Content Delivery of Virtual Reality and Augmented Reality Web Pages | |
| US11055927B2 (en) | Method for building scene, electronic device and storage medium | |
| CN112148221A (en) | Method, device, equipment and storage medium for routing inspection of redundant array of disks | |
| US20220156989A1 (en) | Method and system for outputting character, electronic device, and storage medium | |
| US20170287187A1 (en) | Method of generating a synthetic image | |
| CN111177079A (en) | Network file system data reading method, device, equipment and medium | |
| CN113934495B (en) | Mobile terminal image looking-around method, system and mobile device | |
| KR101499124B1 (en) | Method and apparratus of image processing using shared memory | |
| CN104978731A (en) | Information processing method and electronic equipment | |
| CN116738089A (en) | Rendering method, chip, electronic device and storage medium | |
| JP2015504193A5 (en) | ||
| CN112055258A (en) | Time delay testing method and device for loading live broadcast picture and electronic equipment | |
| CN109271538A (en) | A kind of picture storage method and relevant device | |
| US20210031108A1 (en) | Occlusion in mobile client rendered augmented reality environments | |
| CN115114302A (en) | Road sign data updating method and device, electronic equipment and storage medium | |
| CN109814703B (en) | Display method, device, equipment and medium | |
| CN112668474B (en) | Plane generation method and device, storage medium and electronic equipment | |
| CN111625192B (en) | Metadata object access method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |