WO2017173933A1 - 一种物品图像的展示方法、装置及系统 - Google Patents
一种物品图像的展示方法、装置及系统 Download PDFInfo
- Publication number
- WO2017173933A1 WO2017173933A1 PCT/CN2017/078057 CN2017078057W WO2017173933A1 WO 2017173933 A1 WO2017173933 A1 WO 2017173933A1 CN 2017078057 W CN2017078057 W CN 2017078057W WO 2017173933 A1 WO2017173933 A1 WO 2017173933A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- angle
- item
- video
- displayed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
Definitions
- the present application relates to the field of image processing technologies, and in particular, to a method and an apparatus for displaying an image of an item.
- the present application also relates to a video delivery method and apparatus, an item image display system, an electronic device, and a video data generation method, device and electronic device.
- e-commerce platforms mainly display products to consumers through a single display of flat images.
- the single display of flat images has been unable to meet the needs of users.
- e-commerce websites need to display products in multiple directions.
- the e-commerce website provides a multi-faceted display of products including: 1) selecting multiple images of multiple angles of the product, displaying the images in a carousel or puzzle form; 2) directly playing the video recorded for the product; 3) using a special The Global SDK (Software Development Kit) is used to show the panoramic effect.
- the Global SDK Software Development Kit
- the above method 1 requires splicing a plurality of pictures, so that there is a problem that the playback picture is distorted, thereby reducing the user experience.
- the above method 2 needs to request the entire video resource, so there is a problem of consuming high traffic and power.
- the network is not good, the product cannot be presented to the user very well.
- the viewing effect of the above method 1 or method 2 is passive viewing by the user, that is, the user cannot conveniently select the specific angle image of the product for viewing, and thus cannot give the user a stereoscopic and intuitive feeling, and has no sense of 3D space.
- the picture is not real enough.
- the above method 3 can bring a stereoscopic and intuitive feeling to the user through the SDK installation package, and has a 3D sense of space and a sense of reality, and enhances the display effect of the product.
- the SDK installation package applied in Method 3 is usually large, and thus there is a problem of consuming high flow and power.
- the prior art has the problem of not being able to balance both the low resource consumption and the high user experience.
- the present application provides a method and an apparatus for displaying an image of an item, so as to solve the problem that the advantages of both the lower resource consumption and the higher user experience cannot be considered in the prior art.
- the present application also provides a video delivery method and device, an item image display system, an electronic device, and a video data generation method, device and electronic device.
- the present application provides a method for displaying an image of an item, which is used for a mobile smart device, and the mobile smart device is configured with a motion detecting device, including:
- the extracted item image is displayed on a screen associated with the mobile smart device.
- the extracting, from the video of the item to be displayed, a frame of the item image corresponding to the current posture of the mobile smart device including:
- the determining the to-be-displayed angle of the item to be displayed includes:
- the method before the extracting the image of the item from the video, the method further includes:
- the video segment includes the image presented at an angle to be displayed, and an adjacent image and an adjacent image before the image presented at an angle to be displayed;
- Extracting the item image from the video clip Extracting the item image from the video clip.
- the identifier information includes the to-be-displayed angle or the frame number of the image presented at the angle to be displayed.
- the method before the sending the video request corresponding to the item to be displayed to the server, the method further includes:
- the correspondence between the image frame serial number and the image capturing angle is generated as follows:
- the method further includes:
- the noise signal in the tilt angle parameter is removed by a preset denoising algorithm.
- the displaying the extracted item image on a screen associated with the mobile smart device is as follows:
- Image rendering of the extracted item image is performed by OpenGL technology.
- the motion detecting device includes at least one of an angular velocity sensor and a gravity sensor.
- the present application further provides an apparatus for displaying an image of a moving smart device, wherein the mobile smart device is configured with a motion detecting device, including:
- a posture determining unit configured to determine a tilt angle and a tilt direction of the mobile smart device according to the tilt angle parameter of the mobile smart device detected by the motion detecting device;
- An image extracting unit configured to extract, according to the tilting angle and the tilting direction, a frame of an item image corresponding to a current posture of the mobile smart device from a video of an item to be displayed;
- an image display unit configured to display the extracted item image on a screen associated with the mobile smart device.
- the image extracting unit includes:
- a display angle determining subunit configured to determine an angle to be displayed of the item to be displayed according to the tilt angle and the tilt direction of the mobile smart device
- a frame number acquisition subunit configured to acquire, according to a correspondence between an image frame serial number of the video and an image capturing angle, a frame serial number of the image to be displayed at the to-be-displayed angle;
- an image extraction subunit configured to extract the item image from the video according to the obtained frame number.
- the display angle determining subunit includes:
- An initial angle acquisition subunit configured to acquire a display angle of the first display image preset for the item to be displayed
- the display angle calculation sub-unit is configured to calculate the to-be-displayed angle of the item to be displayed according to the preset display angle of the first display image, the tilt angle of the mobile smart device, and the tilt direction.
- the image extracting unit further includes:
- a video request sending subunit configured to send a video segment request corresponding to the item to be displayed to the server; the video segment requesting carrying the identification information of the image represented by the item to be displayed at an angle to be displayed;
- a video segment receiving subunit configured to receive a video segment included in the video sent back by the server; the video segment includes the image presented at an angle to be displayed, and the image adjacent to the image presented at an angle to be displayed Image and subsequent adjacent images;
- the image extraction subunit is specifically configured to: extract the item image from the video segment.
- the image extracting unit further includes:
- the determining subunit is configured to determine whether the downloaded video segment includes an image presented by the to-be-displayed item at an angle to be displayed; if not, proceed to the next step.
- it also includes:
- the noise clearing unit is configured to remove the noise signal in the tilt angle parameter by using a preset noise removing algorithm.
- the present application further provides a video delivery method, including:
- the extracted video clip is sent back to the client.
- the identifier information includes the specific display angle or a frame number of an image presented at the specific display angle.
- the present application further provides a video delivery device, including:
- a video request receiving unit configured to receive a video segment request sent by the client corresponding to a specific item at a specific display angle
- a video segment extracting unit configured to extract a video segment from a video of the specific item stored in advance according to the identification information of the image presented by the specific item carried by the video clip request at the specific display angle;
- the video segment includes an image presented at the particular presentation angle, and an adjacent image and a subsequent adjacent image prior to the image presented at the particular presentation angle;
- a video clip loopback unit configured to send back the extracted video clip to the client.
- the present application further provides an item image display system, comprising: the display device of the item image according to any one of the above, and the video sending device according to any one of the above.
- an electronic device including:
- a program for storing a method for displaying an image of an item after the device is powered on and running the program of the method for displaying the image of the item by the processor, performing the following steps: detecting the obtained according to the motion detecting device a tilt angle parameter of the electronic device, determining an inclination angle of the electronic device and an inclination direction; and extracting, according to the tilt angle and the tilt direction of the electronic device, a corresponding to a current posture of the electronic device from a video of the item to be displayed a frame item image; displaying the extracted item image on a screen associated with the electronic device.
- a display is also included;
- the extracted item image is displayed on a screen associated with the electronic device in the following manner:
- the extracted item image is displayed on the display.
- the present application further provides a video data generating method for a mobile smart device, where the mobile smart device is configured with an imaging device and a motion detecting device, including:
- Corresponding relationship between the obtained video of the item to be photographed, the image frame number of each image in the video, and the image capturing angle is taken as the video data of the item to be photographed.
- the present application further provides a video data generating apparatus for a mobile smart device, where the mobile smart device is configured with an imaging device and a motion detecting device, including:
- a posture determining unit configured to photograph the obtained current frame image of the item to be photographed by the camera device, according to
- the motion detecting device detects the obtained tilt angle parameter of the mobile smart device, and determines a tilt angle and a tilt direction of the mobile smart device when the current frame image is captured;
- An angle determining unit configured to determine a shooting angle of the current frame image according to the tilting angle and the tilting direction of the mobile smart device
- Corresponding relationship generating unit configured to form a correspondence between an image frame serial number of the current frame image and an image capturing angle according to a frame serial number of the current frame image and a shooting angle of the current frame image;
- a video data setting unit configured to use, as a video data of the to-be-photographed item, a video of the image to be photographed, a corresponding image frame number of each image in the video, and an image capturing angle .
- an electronic device including:
- a memory for storing a program for implementing a video data generating method, after the device is powered on and running the program of the video data generating method, performing the following steps: capturing, for the camera device, the obtained current frame image of the item to be photographed, according to the The motion detecting device detects the obtained tilt angle parameter of the electronic device, determines an inclination angle and an inclination direction of the electronic device when the current frame image is captured, and determines the angle according to the tilt angle and the tilt direction of the electronic device.
- a shooting angle of the current frame image forming a correspondence between the image frame number of the current frame image and the image capturing angle according to the frame number of the current frame image and the shooting angle of the current frame image; Corresponding relationship between the video of the item to be photographed, the image frame number of each image in the video, and the image capturing angle is used as the video data of the item to be photographed.
- the method for displaying an image of an article determines the tilt angle and the tilt direction of the mobile smart device according to the tilt angle parameter of the mobile smart device detected by the motion detecting device, and according to the tilt angle and In the oblique direction, a frame of the item image corresponding to the current posture of the mobile smart device is extracted from the video of the item to be displayed, and the extracted item image is displayed on a screen associated with the mobile smart device.
- an image of a frame corresponding to the current posture of the mobile smart device is extracted and displayed from the video of the item to be displayed; this processing method does not need to be downloaded and
- the SDK package is installed, and only according to the video of the item to be displayed, and by perceiving the user's gesture operation, the effect of displaying the item in a panoramic and multi-directional manner can be achieved, and the user can actively select the viewing angle of the item to be displayed through the gesture; therefore,
- the method provided by the present application can combine the advantages of resource consumption such as less network traffic and high user experience.
- the complete video of the item to be displayed stored in the server is not required to be downloaded to the client for viewing at one time, and only needs to be displayed according to the current posture of the mobile smart device.
- FIG. 1 is a flow chart of an embodiment of a method for displaying an image of an article provided by the present application
- FIG. 2 is a schematic diagram of different shooting angle presentation images of an embodiment of an article image display device provided by the present application
- FIG. 3 is a schematic diagram of an embodiment of an apparatus for displaying an image of an article provided by the present application
- FIG. 4 is a flowchart of an embodiment of a video delivery method provided by the present application.
- FIG. 5 is a schematic diagram of an embodiment of a video sending device provided by the present application.
- FIG. 6 is a schematic diagram of an embodiment of an item image display system provided by the present application.
- FIG. 7 is a schematic diagram of an embodiment of an electronic device provided by the present application.
- FIG. 8 is a schematic diagram of an embodiment of a video data generating method provided by the present application.
- FIG. 9 is a schematic diagram of an embodiment of a video data generating apparatus provided by the present application.
- FIG. 10 is a schematic diagram of still another embodiment of an electronic device provided by the present application.
- a method and device for displaying an image of an article a method and device for transmitting a video
- a system for displaying an image of an article an electronic device
- a method, device and electronic device for generating video data are provided.
- device Detailed description will be made one by one in the following embodiments.
- the basic idea of the method for displaying an image of an article provided by the present application is to acquire the tilt data of the mobile smart device by using the motion detecting device disposed in the mobile smart device, and then map the tilt data to the video of the item to be displayed to take out the corresponding image.
- Frame and display this way of processing allows flexible switching by user gestures
- the image to be displayed on the screen which can display the advantages of resource consumption such as less network traffic and higher user experience.
- FIG. 1 is a flowchart of an embodiment of a method for displaying an image of an article. The method includes the following steps:
- Step S101 Determine a tilt angle and a tilt direction of the mobile smart device according to the tilt angle parameter of the mobile smart device detected by the motion detecting device.
- the method for displaying an image of an article provided by the present application is for a mobile smart device configured with a motion detecting device.
- the mobile smart device that is, a so-called mobile phone or a smart phone, a tablet computer, a wearable device, or the like.
- the motion detecting device is installed in the mobile smart device, and can detect the tilt angle parameter of the mobile smart device in real time. Through the library function provided by the motion detecting device, the mobile smart device can collect the tilt angle parameter of the mobile smart device detected by the motion detecting device in real time.
- a key point in the application of the display method of the image of the article provided by the present application to control the image display of the article is the determination and calculation of the position and posture of the mobile smart device.
- the determining and calculating the position and posture of the mobile intelligent device can be completed by the library function provided by the motion detecting device, thereby obtaining the azimuth of the mobile smart device, namely: Tilt angle and tilt direction.
- the motion detecting device is not limited to the angular velocity sensor, and may be a G-sensor, or other sensor capable of acquiring the tilt angle parameter of the mobile smart device.
- a G-sensor or other sensor capable of acquiring the tilt angle parameter of the mobile smart device.
- the direction of gravity can be detected by the gravity sensor.
- a multi-axis gravity sensor can be used to detect the tangential rotation of the mobile smart device in the vertical direction, thereby determining the flip angle of the mobile smart device, that is, the tilt angle and the tilt direction of the mobile smart device.
- An angular velocity sensor is a hardware that measures the deflection and tilt of a device.
- the angular velocity sensor uses the Coriolis force principle and is mainly used in car navigation, position control and attitude control of moving objects, and other occasions requiring precise angle measurement.
- the measured physical quantity of the angular velocity sensor is the rotational angular velocity at the time of deflection and tilt.
- Angular velocity is the increment of displacement per unit time.
- the biggest difference between the angular velocity sensor and the gravity sensor is that the gravity sensor has less dimensionality for spatial displacement, and it is good to be able to sense in six directions, and the angular velocity is good.
- the sensor is all-round.
- Common angular velocity sensors include gyroscopes and the like. Taking the gyroscope as an example, the device can measure the rotation and deflection well, and can accurately analyze and judge the actual action of the user. Then, according to the action, the mobile smart device can be operated accordingly. On mobile smart devices, gyroscopes can be used to measure and reconstruct complete 3D motion. The gyroscope completely monitors the displacement of the user's hand, thereby achieving various viewing angles.
- the mobile smart device is an iPhone smart phone, and the mobile phone has a built-in micro electromechanical gyroscope (MEMS).
- MEMS micro electromechanical gyroscope
- the instantaneous angular velocity (A/D conversion value) of the mobile intelligent device is measured by the gyroscope, and the gyro angular velocity of the mobile intelligent device at different rotational speeds is collected by the program, and the digital integration of the time is performed, thereby obtaining the mobile intelligent device.
- Azimuth to determine the tilt angle and tilt direction of the mobile smart device. Typically, 7 sets of data are collected at each speed, with approximately 200 values per set of data.
- an angular velocity sensor is used as the motion detecting device, and the tilt angle parameter obtained by the angular velocity sensor detection includes parameters such as angular velocity, time, and displacement.
- an angular velocity sensor and a gravity sensor may be combined as the motion detecting device.
- the angular velocity sensor is used to find the angle with respect to the gravity direction for a short time, and the angle measured by the angular velocity sensor is trimmed by the gravity sensor for a long time, thereby improving the tilt angle of the determined mobile smart device and the accuracy of the tilt direction.
- the three motion detection devices that can be applied are briefly described above.
- the gravity sensor has the lowest cost, taking the mobile phone as an example.
- the gravity sensor is a sensor that measures acceleration.
- Various vibrations affect the measurement results of the accelerometer, so that the accurate gravity direction cannot be obtained, and the accuracy of the obtained angle value is also low.
- the accuracy of the tilt angle and the tilt direction of the mobile smart device is significantly improved by the angular velocity sensor.
- the cost of the angular velocity sensor is relatively high.
- Step S103 Extract a frame of the item image corresponding to the current posture of the mobile smart device from the video of the item to be displayed according to the tilt angle and the tilt direction.
- This step is a key step of realizing image switching of the item to be displayed. After determining the tilt angle and the tilt direction of the mobile smart device, an image of a frame corresponding to the current posture of the mobile smart device is extracted from the video of the item to be displayed.
- the following step may be used to extract a frame of the item image corresponding to the current posture of the mobile smart device from the video of the item to be displayed.
- the video of the item to be displayed includes each frame image corresponding to the item at different display angles (ie, different shooting angles).
- the angle to be displayed of the item to be displayed needs to be determined.
- the following steps may be used to determine the angle to be displayed of the item to be displayed.
- the first display image refers to a first display image of the item after the user makes a viewing request corresponding to the item to be displayed.
- the best display angle of the item to be displayed, and the image that best represents the item feature can be designated as the first display image.
- the display angle of the first display image may also be defaulted to 0 degrees, that is, the first display image is the first frame image of the video of the item to be displayed.
- the to-be-displayed angle of the item to be displayed may be calculated according to the preset display angle of the first display image.
- the video of the item to be displayed includes an image taken by rotating the item by 120 degrees, that is, the image of the first frame corresponds to 0 degrees, the image of the last frame corresponds to 120 degrees, and the display angle of the first display image is set to 50 degrees;
- the display angle of the first display image is set to 50 degrees;
- the video of the item to be displayed is different from the general item video.
- the general item video only includes the video file itself, and the video of the item to be displayed described in the present application further includes a correspondence between the frame number of each image in the video file and the shooting angle, that is, the image frame number of the video and The correspondence between image shooting angles.
- the shooting can be performed in various ways, and the mobile smart device with the motion detecting device and the shooting device can be used for shooting in a simple and convenient manner, for example, a built-in gyroscope and a shooting device. Smartphones, etc.
- the shooting angle corresponding to the image presented by each display angle is determined in real time by the motion detecting device;
- the frame number of the image presented by the angle and the shooting angle of the image presented by each display angle form a correspondence relationship between the image frame number and the image capturing angle.
- FIG. 2 is a schematic diagram showing images of different shooting angles of an embodiment of the method for displaying an article image of the present application. It can be seen from Fig. 2 that a circle (360 degrees) is rotated around the object to be photographed, assuming that the starting angle of the shooting (corresponding to the initial position) is 0 degrees (corresponding to the figure a)), the ending angle of the shooting (corresponding to the ending position) ) is 150 degrees (corresponding to figure b)), and the corresponding relationship between each image frame and its shooting angle can be captured after the shooting ends.
- the object to be photographed is fixed, and a circular track is arranged.
- the camera is mounted on the track, and the camera is photographed around the object at a fixed angular velocity.
- the angular velocity is a preset value, that is, the correspondence relationship between the shooting angle and the image frame number is known, for example, the corner x corresponds to the image A.
- This type of shooting is suitable for the shooting of large objects, such as cars; but it requires a large investment, large businesses can use, small businesses are not conducive to promotion.
- Shooting method 2 Configure a motor ground for the object to be photographed (such as a small toy), make a circular motion at a constant angular velocity, and fix the camera to obtain a panoramic video.
- the angular velocity here is also preset, that is, the correspondence between the shooting angle and the image frame number is known. This type of shooting is suitable for small objects, such as small toys; still need some capital investment, such as buying camera equipment, buying studios and motors.
- the video file may be downloaded from a video storage device (such as a server) when the user makes a viewing request for the item to be displayed.
- a video storage device such as a server
- the user's gesture changes, when it is necessary to perform image switching on the displayed item, a frame of the item image corresponding to the current posture can be directly extracted from the downloaded video file.
- the server may be requested to download a video segment including only the image to be displayed and the adjacent images before and after according to a certain video downloading rule.
- the video clip includes an image presented at an angle to be displayed, and an adjacent image and an adjacent image before the image to be presented at an angle to be displayed.
- the video segment includes an adjacent image within 10 degrees of the angle to be displayed, an image to be displayed at an angle to be displayed, and an adjacent image within 10 degrees of the angle to be displayed; or the video segment includes an image before the image to be displayed Adjacent 20 frames of images to all images between adjacent 20 frames of images after the image presented by the angle to be displayed.
- the process of acquiring the video segment is: first, sending, to the server, a video segment request corresponding to an image to be displayed at an angle to be displayed, the video segment requesting to carry an image of the item to be displayed at an angle to be displayed
- the server receives the video request corresponding to the item to be displayed sent by the client
- the identifier information of the image to be displayed at the angle to be displayed according to the video clip request is received from the pre-stored item of the item to be displayed.
- the video clip is extracted, and the extracted video clip is sent back to the client; after receiving the video clip sent back by the server, the client can extract the image of the item from the video clip.
- the identifier information includes a frame number to be displayed or a frame number of an image presented at an angle to be displayed.
- the video segment includes the image to be displayed by the angle to be displayed, and the image of the previous frame and the image of the frame after it, if the image to be displayed includes the image to be displayed at the angle to be displayed, when the image is displayed There is no need to request the server to download the video segment including the image represented by the angle to be displayed, and directly extract the image to be displayed from the downloaded video segment.
- Step S105 Display the extracted item image on a screen associated with the mobile smart device.
- the screens associated with the mobile smart device include, but are not limited to: a display of the mobile smart device, and may also be other display devices connected to the mobile smart device, such as a projector, etc., which can be extracted by the projector.
- the image of the item is displayed on the large screen to enhance the user's visual experience.
- the image of the extracted item may be image rendered by using OpenGL technology.
- OpenGL can use hardware devices to improve the speed of image processing. It has the advantages of increasing the rendering speed, breaking the Java memory limit, and facilitating the addition of more rendering effects. This can improve the overall performance of the image display of the item and provide users with a smooth stereoscopic view.
- a method for displaying an image of an item is provided, and correspondingly, the present application further provides an apparatus for displaying an image of an item.
- the device corresponds to an embodiment of the method of displaying an image of the above article.
- FIG. 3 is a schematic diagram of an embodiment of an apparatus for displaying an image of an application of the present application. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment. The device embodiments described below are merely illustrative.
- An apparatus for displaying an item image includes: a posture determining unit 101, configured to determine a tilt angle of the mobile smart device according to a tilt angle parameter of the mobile smart device detected by the motion detecting device, and An image extraction unit 103 is configured to extract, from the video of the item to be displayed, a frame of the item image corresponding to the current posture of the mobile smart device according to the tilt angle and the tilt direction; the image display unit 105, And for displaying the extracted item image on a screen associated with the mobile smart device.
- the image extracting unit 103 includes:
- a display angle determining subunit configured to determine an angle to be displayed of the item to be displayed according to the tilt angle and the tilt direction of the mobile smart device
- a frame number acquisition subunit configured to acquire, according to a correspondence between an image frame serial number of the video and an image capturing angle, a frame serial number of the image to be displayed at the to-be-displayed angle;
- an image extraction subunit configured to extract the item image from the video according to the obtained frame number.
- the display angle determining subunit includes:
- An initial angle acquisition subunit configured to acquire a display angle of the first display image preset for the item to be displayed
- the display angle calculation sub-unit is configured to calculate the to-be-displayed angle of the item to be displayed according to the preset display angle of the first display image, the tilt angle of the mobile smart device, and the tilt direction.
- the image extracting unit 103 further includes:
- a video request sending subunit configured to send, to the server, a video segment request corresponding to the image presented by the to-be-displayed item at an angle to be displayed; the video segment requesting carrying the identification information of the image to be displayed at an angle to be displayed ;
- a video segment receiving subunit configured to receive a video segment included in the video sent back by the server; the video segment includes the image presented at an angle to be displayed, and the image adjacent to the image presented at an angle to be displayed Image and subsequent adjacent images;
- the image extraction subunit is specifically configured to: extract the item image from the video segment.
- the image extracting unit 103 further includes:
- the determining subunit is configured to determine whether the downloaded video segment includes an image presented by the to-be-displayed item at an angle to be displayed; if not, proceed to the next step.
- the device further includes:
- the noise clearing unit is configured to remove the noise signal in the tilt angle parameter by using a preset noise removing algorithm.
- FIG. 4 is a flowchart of an embodiment of a method for sending a video according to the present application. The parts of the embodiment that are identical to the content of the first embodiment are not described again. Please refer to the corresponding part in the first embodiment.
- a video delivery method provided by the application includes:
- Step S101 Receive a video clip request sent by the client corresponding to a specific item at a specific display angle.
- the video delivery method provided by the present application is not limited to the video segment request sent by the mobile smart device in the first embodiment.
- the method provided by the present application may also be used in other scenarios where the video segment needs to be downloaded.
- the client includes, but is not limited to, a mobile communication device, that is, a so-called mobile phone or a smart phone, and also includes a terminal device such as a personal computer, a PAD, an iPad, and the like.
- a mobile communication device that is, a so-called mobile phone or a smart phone
- a terminal device such as a personal computer, a PAD, an iPad, and the like.
- the video clip request carries identification information of an image presented by the particular item at a particular presentation angle.
- the identification information includes the specific display angle or a frame number of an image presented at the specific display angle.
- the client requests a video clip request including an image of the item presented at a 55 degree shooting angle, in which case the identification information includes a specific display angle of 55 degrees; or the client requests a video clip request including the 80th item image In this case, the identification information is the 80th frame.
- Step S103 Extract a video segment from the video of the specific item stored in advance according to the identification information of the image presented by the specific item at the specific display angle.
- the step After receiving the video clip request through the previous step, the step extracts the video clip from the video of the specific item stored in advance according to the identification information of the image presented by the specific item carried by the video clip request at a specific display angle.
- the video of the particular item is different from the general item video.
- a general item video includes only the video file itself, in which case the video of the specific item also includes a correspondence between the frame number of each image in the video file and the shooting angle.
- the video clip includes the image presented at a particular presentation angle, and an adjacent image and subsequent adjacent images prior to the image presented at a particular presentation angle.
- the video clip includes an adjacent image within 10 degrees of a particular display angle, an image presented by a particular display angle, and an adjacent image within 10 degrees of a particular display angle; or, the video clip includes an image prior to the image presented by the particular display angle Neighboring 20 frames of images to all images between adjacent 20 frames of images after the image presented by the particular presentation angle.
- Step S105 Send back the extracted video segment to the client.
- the extracted video segment is sent back to the client that sends the request for viewing by the client.
- a video delivery method is provided.
- the present application further provides a video delivery device.
- the device corresponds to an embodiment of the above method.
- FIG. 5 is a schematic diagram of an embodiment of a video delivery device of the present application. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
- the device embodiments described below are merely illustrative.
- a video sending device of the present embodiment comprising: a video request receiving unit 101, configured to receive a video segment request sent by a client corresponding to a specific item at a specific display angle; and a video segment extracting unit 103, configured to use the video according to the video
- the segment request carries the identification information of the image presented by the specific item at the specific display angle, and extracts a video segment from the video of the specific item stored in advance; the video segment includes an image presented at the specific display angle And an adjacent image and an adjacent image before the image presented by the specific display angle; the video segment returning unit 105 is configured to send back the extracted video segment to the client.
- the present application also provides an item image display system, as shown in FIG. 6, the system includes the item image display device 601 and the video delivery device 602 described in the above embodiments.
- the display device of the item image may be deployed on a mobile communication device configured with a motion detecting device, such as a smart phone, or may be deployed in a wearable smart device configured with a motion detecting device, such as a smart watch or the like; the video
- the delivery device is usually deployed on a server, but is not limited to a server, and may be any device capable of implementing the video delivery method described in this application.
- the display device of the item image is deployed on a smartphone equipped with a gyroscope, and the video delivery device is deployed on a server.
- the smartphone When the user submits an image viewing request for the item to be displayed, the smartphone first roots According to the display angle or frame number of the first display image preset for the item, the server is requested to download a video segment including the first display image; the video delivery device deployed on the server responds to the request from the pre-stored complete item
- the corresponding video clip is extracted from the video and returned to the smart phone; after receiving the video clip, the smart phone can display the first display image of the item; when the user rotates the smart phone, the smart detection device detects the obtained intelligence.
- the tilt angle parameter of the mobile phone determines the tilt angle and the tilt direction of the smart phone, and extracts a frame image of the object corresponding to the current posture of the smart phone from the video of the item according to the determined tilt angle and the tilt direction, and extracts The resulting item image is displayed on a screen associated with the smartphone.
- the server needs to be requested again to download the video clip including the image presented by the angle to be displayed.
- FIG. 7 is a schematic diagram of an embodiment of an electronic device according to the present application.
- An electronic device of the embodiment comprising: a motion detecting device 101; a processor 102; and a memory 103, configured to store a program for implementing a method for displaying an image of an item, the device being powered on and running by the processor 102
- After the program of the method for displaying the item image performing the following steps: determining the tilt angle and the tilt direction of the electronic device according to the tilt angle parameter of the electronic device obtained by the motion detecting device; according to the electronic device
- the tilt angle and the tilt direction extract a frame of the item image corresponding to the current posture of the electronic device from the video of the item to be displayed; and display the extracted item image on a screen associated with the electronic device.
- the electronic device further includes a display
- the extracted item image is displayed on the display.
- FIG. 8 is a flowchart of an embodiment of a video data generating method provided by the present application. The same parts of the first embodiment are not described again. Please refer to the corresponding part in the first embodiment.
- a video data generating method provided by the present application includes:
- Step S101 capturing, for the camera device, the obtained current frame image of the item to be photographed, according to the motion
- the detecting device detects the obtained tilt angle parameter of the mobile smart device, and determines a tilt angle and a tilt direction of the mobile smart device when the current frame image is captured.
- the video data generating method provided by the present application is used for a mobile smart device configured with a motion detecting device and an imaging device.
- the mobile smart device that is, a so-called mobile phone or a smart phone, a tablet computer, a wearable device, or the like.
- the motion detecting device is not limited to the angular velocity sensor, and may be a G-sensor, or other sensor capable of acquiring the tilt angle parameter of the mobile smart device.
- the image of the captured image of the captured image can be detected in real time by the motion detecting device to obtain the tilt angle parameter of the mobile smart device, and then pass the motion detecting device.
- the library function is provided to determine the tilt angle and tilt direction of the mobile smart device when shooting each frame of image.
- Step S103 Determine a shooting angle of the current frame image according to the tilt angle and the tilt direction of the mobile smart device.
- the shooting angle corresponding to the current frame image may be determined. For example, in a video taken around 120 degrees of an item to be photographed, that is, the first frame image corresponds to 0 degrees, and the last frame image corresponds to 120 degrees.
- the shooting process may be either constant speed or non-uniform speed.
- the number of frames included in the final video formed after shooting is not only related to the range of the shooting angle, but also related to the frame rate.
- the number of corresponding image frames at a certain shooting angle may be significantly more than the number of image frames corresponding at other shooting angles.
- Step S105 Form a correspondence between the image frame number of the current frame image and the image capturing angle according to the frame number of the current frame image and the shooting angle of the current frame image.
- the correspondence between the image frame number and the image capturing angle can be formed according to the frame number of the image and its shooting angle.
- Step S107 The corresponding relationship between the obtained video of the item to be photographed, the image frame number of each image in the video, and the image capturing angle is taken as the video data of the item to be photographed.
- the video of the item generated by applying the video data generating method provided by the present application is different from the general item video.
- the general item video only includes the video file itself, and the item video described in the present application further includes the correspondence between the frame number of each image in the video file and the shooting angle, that is, the correspondence between the image frame number and the image capturing angle. relationship.
- a video data generating method is provided.
- the present application further provides a video data generating apparatus.
- the device corresponds to an embodiment of the above method.
- FIG. 9 is a schematic diagram of an embodiment of a video data generating apparatus of the present application. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment. The device embodiments described below are merely illustrative.
- a video data generating apparatus of the present embodiment comprising: a posture determining unit 101, configured to detect, by the camera apparatus, a current frame image of an item to be photographed obtained by the camera apparatus, and detecting the obtained mobile smart device according to the motion detecting apparatus a tilt angle parameter, determining a tilt angle and a tilt direction of the mobile smart device when the current frame image is captured; the angle determining unit 103, configured to determine the current frame according to the tilt angle and the tilt direction of the mobile smart device a photographing angle of the image; the correspondence relationship generating unit 105 is configured to form a correspondence between the image frame serial number of the current frame image and the image capturing angle according to the frame serial number of the current frame image and the shooting angle of the current frame image a relationship between the video of the item to be photographed, the image frame number of each image in the video, and the image capturing angle as the object to be photographed Video data.
- FIG. 10 is a schematic diagram of another electronic device embodiment of the present application.
- An electronic device of the embodiment comprising: an imaging device 101; a motion detecting device 102; a processor 103; and a memory 104, configured to store a program for implementing a video data generating method, the device energizing and running the video data After the program of the method is generated, the following steps are performed: the current frame image of the object to be photographed obtained by the camera device is captured, and the tilt angle parameter of the electronic device obtained by the motion detecting device is detected, and the current image is determined to be photographed.
- a tilt angle and an oblique direction of the electronic device when the frame image is obtained determining a photographing angle of the current frame image according to the tilt angle and the tilt direction of the electronic device; according to the frame serial number of the current frame image and the current frame a photographing angle of the image, forming a correspondence relationship between the image frame number of the current frame image and an image capturing angle; capturing the obtained video of the item to be photographed, the image frame number of each image in the video, and Correspondence between image capturing angles as video data of the item to be photographed.
- a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
- processors CPUs
- input/output interfaces network interfaces
- memory volatile and non-volatile memory
- the memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory.
- RAM random access memory
- ROM read only memory
- Memory is an example of a computer readable medium.
- Computer readable media including both permanent and non-persistent, removable and non-removable media may be implemented by any method or technology.
- the information can be computer readable instructions, data structures, modules of programs, or other data.
- Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
- computer readable media does not include non-transitory computer readable media, such as modulated data signals and carrier waves.
- embodiments of the present application can be provided as a method, system, or computer program product.
- the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment in combination of software and hardware.
- the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
Abstract
本申请公开了一种物品图像的展示方法、装置及电子设备,一种视频下发方法及装置,一种物品图像的展示系统,以及一种视频数据生成方法、装置及电子设备。其中所述物品图像的展示方法包括:根据运动检测装置检测获得的移动智能设备的倾斜角参数,确定移动智能设备的倾斜角度以及倾斜方向;根据所述倾斜角度以及倾斜方向,从待展示物品的视频中提取与移动智能设备的当前姿势对应的一帧物品图像;将提取到的物品图像显示在与移动智能设备有关联关系的屏幕上。采用本申请提供的方法,可达到全景化、多方位展示物品的效果,使得用户可以通过手势主动选择待展示物品的观看角度,从而兼具较少网络流量等资源消耗和较高用户体验两方面优势。
Description
本申请要求2016年04月06日递交的申请号为201610211628.5、发明名称为“一种物品图像的展示方法、装置及系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及图像处理技术领域,具体涉及一种物品图像的展示方法及装置。本申请同时涉及一种视频下发方法及装置,一种物品图像的展示系统,一种电子设备,以及一种视频数据生成方法、装置及电子设备。
随着互联网技术的高速发展,通过电子商务网站进行商品交易已成为日益普及的一种方式。为了提高商品购买率、降低退货数量,电子商务网站需要给用户提供尽可能充分的商品信息,这些信息可以通过文字、图片和用户评论等形式提供。
在电子商务发展的早期阶段,电商平台主要通过平面图片的单一展示方式向消费者展示商品。随着用户爆发式的增长,平面图片的单一展示方式已经无法满足用户的需求。为了提高用户体验,电子商务网站需要对商品进行多方位展示。
目前,电子商务网站提供商品多方位展示的方法包括:1)选取商品多角度的多张图片,将这些图片以轮播或拼图形式展现;2)直接播放为商品录制的视频;3)采用专门的全局SDK(Software Development Kit,软件开发工具包)来展示全景效果。
然而,上述现有商品多方位展示方法均存在一些问题。上述方法1需要将多个图片进行拼接,因而存在播放画面失真的问题,从而降低了用户体验。上述方法2需要请求整个视频资源,因而存在消耗较高流量和电量的问题,特别的,如果网络不好则无法很好的将商品呈现给用户。同时,采用上述方法1或方法2的观看效果均为用户的被动观看,即:用户无法方便地主动选取商品特定角度图像进行观看,因而,无法带给用户立体直观的感受,既没有3D空间感,画面也不够真实。上述方法3通过SDK安装包能够带给用户立体直观的感受,具有3D空间感及真实感,增强了商品的展示效果。然而,方法3所应用的SDK安装包通常较大,因而存在消耗较高流量和电量的问题。
综上所述,现有技术存在无法兼顾较低资源消耗及较高用户体验两方面优势的问。
发明内容
本申请提供一种物品图像的展示方法和装置,以解决现有技术下无法兼顾较低资源消耗及较高用户体验两方面优势的问题。本申请还提供一种视频下发方法及装置,一种物品图像的展示系统,一种电子设备,以及一种视频数据生成方法、装置及电子设备。
本申请提供一种物品图像的展示方法,用于移动智能设备,所述移动智能设备配置有运动检测装置,包括:
根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定所述移动智能设备的倾斜角度以及倾斜方向;
根据所述倾斜角度和所述倾斜方向,从待展示物品的视频中提取与所述移动智能设备的当前姿势对应的一帧物品图像;
将提取到的物品图像显示在与所述移动智能设备有关联关系的屏幕上。
可选的,所述从待展示物品的视频中提取与所述移动智能设备的当前姿势对应的一帧物品图像,包括:
根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述待展示物品的待展示角度;
根据所述视频的图像帧序号和图像拍摄角度之间的对应关系,获取所述待展示物品在所述待展示角度所呈现图像的帧序号;
根据获取到的所述帧序号,从所述视频中提取所述物品图像。
可选的,所述确定所述待展示物品的待展示角度,包括:
获取为所述待展示物品预设的首次显示图像的展示角度;
根据所述预设的首次显示图像的展示角度、所述移动智能设备的倾斜角度以及倾斜方向,计算所述待展示物品的所述待展示角度。
可选的,在所述从所述视频中提取所述物品图像之前,还包括:
向服务器发送对应所述待展示物品在待展示角度所呈现图像的视频片段请求;所述视频片段请求携带所述待展示物品在待展示角度所呈现图像的标识信息;
接收所述服务器回送的所述视频包括的视频片段;所述视频片段包括所述在待展示角度所呈现图像、及所述在待展示角度所呈现图像之前相邻图像和之后相邻图像;
所述从所述视频文件提取所述物品图像,采用如下方式:
从所述视频片段中提取所述物品图像。
可选的,所述标识信息包括所述待展示角度或所述在待展示角度所呈现图像的帧序号。
可选的,在所述向服务器发送对应所述待展示物品的视频请求之前,还包括:
判断已下载的视频片段是否包括所述待展示物品在待展示角度所呈现图像;若否,则进入下一步骤。
可选的,所述图像帧序号和图像拍摄角度之间的对应关系,采用如下方式生成:
在拍摄所述待展示物品时,对于拍摄到的所述待展示物品的各个展示角度所呈现图像,通过运动检测装置确定所述各个展示角度所呈现图像对应的拍摄角度;
根据所述各个展示角度所呈现图像的帧序号和所述各个展示角度所呈现图像的拍摄角度,形成所述图像帧序号和图像拍摄角度之间的对应关系。
可选的,在所述确定所述移动智能设备的倾斜角度以及倾斜方向之前,还包括:
通过预设的除噪算法,去除所述倾斜角参数中的噪音信号。
可选的,所述在与所述移动智能设备有关联关系的屏幕上显示提取到的物品图像,采用如下方式:
通过OpenGL技术,对所述提取到的物品图像进行图像渲染。
可选的,所述运动检测装置包括角速度传感器和重力感应器的至少一者。
相对应的,本申请还提供一种物品图像的展示装置,用于移动智能设备,所述移动智能设备配置有运动检测装置,包括:
姿态确定单元,用于根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定所述移动智能设备的倾斜角度以及倾斜方向;
图像提取单元,用于根据所述倾斜角度和所述倾斜方向,从待展示物品的视频中提取与所述移动智能设备的当前姿势对应的一帧物品图像;
图像显示单元,用于将提取到的物品图像显示在与所述移动智能设备有关联关系的屏幕上。
可选的,所述图像提取单元包括:
展示角度确定子单元,用于根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述待展示物品的待展示角度;
帧序号获取子单元,用于根据所述视频的图像帧序号和图像拍摄角度之间的对应关系,获取所述待展示物品在所述待展示角度所呈现图像的帧序号;
图像提取子单元,用于根据获取到的所述帧序号,从所述视频中提取所述物品图像。
可选的,所述展示角度确定子单元包括:
初始角度获取子单元,用于获取为所述待展示物品预设的首次显示图像的展示角度;
展示角度计算子单元,用于根据所述预设的首次显示图像的展示角度、所述移动智能设备的倾斜角度以及倾斜方向,计算所述待展示物品的所述待展示角度。
可选的,所述图像提取单元还包括:
视频请求发送子单元,用于向服务器发送对应所述待展示物品的视频片段请求;所述视频片段请求携带所述待展示物品在待展示角度所呈现图像的标识信息;
视频片段接收子单元,用于接收所述服务器回送的所述视频包括的视频片段;所述视频片段包括所述在待展示角度所呈现图像、及所述在待展示角度所呈现图像之前相邻图像和之后相邻图像;
所述图像提取子单元具体用于:从所述视频片段中提取所述物品图像。
可选的,所述图像提取单元还包括:
判断子单元,用于判断已下载的视频片段是否包括所述待展示物品在待展示角度所呈现图像;若否,则进入下一步骤。
可选的,还包括:
噪音清除单元,用于通过预设的除噪算法,去除所述倾斜角参数中的噪音信号。
此外,本申请还提供一种视频下发方法,包括:
接收客户端发送的对应特定物品在特定展示角度的视频片段请求;
根据所述视频片段请求携带的所述特定物品在所述特定展示角度所呈现图像的标识信息,从预先存储的所述特定物品的视频中提取视频片段;所述视频片段包括在所述特定展示角度所呈现图像、及在所述特定展示角度所呈现图像之前相邻图像和之后相邻图像;
向所述客户端回送提取到的视频片段。
可选的,所述标识信息包括所述特定展示角度或在所述特定展示角度所呈现图像的帧序号。
相对应的,本申请还提供一种视频下发装置,包括:
视频请求接收单元,用于接收客户端发送的对应特定物品在特定展示角度的视频片段请求;
视频片段提取单元,用于根据所述视频片段请求携带的所述特定物品在所述特定展示角度所呈现图像的标识信息,从预先存储的所述特定物品的视频中提取视频片段;所
述视频片段包括在所述特定展示角度所呈现图像、及在所述特定展示角度所呈现图像之前相邻图像和之后相邻图像;
视频片段回送单元,用于向所述客户端回送提取到的视频片段。
相对应的,本申请还提供一种物品图像的展示系统,包括:上述任一种所述的物品图像的展示装置,以及上述任一种所述的视频下发装置。
相对应的,本申请还提供一种电子设备,包括:
运动检测装置;
处理器;以及
存储器,用于存储实现物品图像的展示方法的程序,该设备通电并通过所述处理器运行该物品图像的展示方法的程序后,执行下述步骤:根据所述运动检测装置检测获得的所述电子设备的倾斜角参数,确定所述电子设备的倾斜角度以及倾斜方向;根据所述电子设备的倾斜角度以及倾斜方向,从待展示物品的视频中提取与所述电子设备的当前姿势对应的一帧物品图像;在与所述电子设备有关联关系的屏幕上显示提取到的物品图像。
可选的,还包括显示器;
采用如下方式将提取到的物品图像显示在与所述电子设备有关联关系的屏幕上:
在所述显示器上显示所述提取到的物品图像。
此外,本申请还提供一种视频数据生成方法,用于移动智能设备,所述移动智能设备配置有摄像装置和运动检测装置,包括:
对于所述摄像装置拍摄获得的待拍摄物品的当前帧图像,根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定拍摄所述当前帧图像时所述移动智能设备的倾斜角度以及倾斜方向;
根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述当前帧图像的拍摄角度;
根据所述当前帧图像的帧序号和所述当前帧图像的拍摄角度,形成所述当前帧图像的图像帧序号和图像拍摄角度之间的对应关系;
将拍摄获得的所述待拍摄物品的视频、所述视频中各个图像的所述图像帧序号和图像拍摄角度之间的对应关系,作为所述待拍摄物品的视频数据。
相对应的,本申请还提供一种视频数据生成装置,用于移动智能设备,所述移动智能设备配置有摄像装置和运动检测装置,包括:
姿态确定单元,用于对于所述摄像装置拍摄获得的待拍摄物品的当前帧图像,根据
所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定拍摄所述当前帧图像时所述移动智能设备的倾斜角度以及倾斜方向;
角度确定单元,用于根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述当前帧图像的拍摄角度;
对应关系生成单元,用于根据所述当前帧图像的帧序号和所述当前帧图像的拍摄角度,形成所述当前帧图像的图像帧序号和图像拍摄角度之间的对应关系;
视频数据设置单元,用于将拍摄获得的所述待拍摄物品的视频、所述视频中各个图像的所述图像帧序号和图像拍摄角度之间的对应关系,作为所述待拍摄物品的视频数据。
相对应的,本申请还提供一种电子设备,包括:
摄像装置;
运动检测装置;
处理器;以及
存储器,用于存储实现视频数据生成方法的程序,该设备通电并运行该视频数据生成方法的程序后,执行下述步骤:对于所述摄像装置拍摄获得的待拍摄物品的当前帧图像,根据所述运动检测装置检测获得的所述电子设备的倾斜角参数,确定拍摄所述当前帧图像时所述电子设备的倾斜角度以及倾斜方向;根据所述电子设备的倾斜角度以及倾斜方向,确定所述当前帧图像的拍摄角度;根据所述当前帧图像的帧序号和所述当前帧图像的拍摄角度,形成所述当前帧图像的图像帧序号和图像拍摄角度之间的对应关系;将拍摄获得的所述待拍摄物品的视频、所述视频中各个图像的所述图像帧序号和图像拍摄角度之间的对应关系,作为所述待拍摄物品的视频数据。
与现有技术相比,本申请提供的物品图像的展示方法,根据运动检测装置检测获得的移动智能设备的倾斜角参数,确定移动智能设备的倾斜角度以及倾斜方向,并根据所述倾斜角度以及倾斜方向,从待展示物品的视频中提取与移动智能设备的当前姿势对应的一帧物品图像,并将提取到的物品图像显示在与移动智能设备有关联关系的屏幕上。
使用本申请提供的方法,根据移动智能设备的倾斜角度以及倾斜方向,从待展示物品的视频中提取并显示与移动智能设备的当前姿势对应的一帧物品图像;这种处理方式,无需下载及安装SDK包,仅根据待展示物品的视频,并通过感知用户的手势操作,即可达到全景化、多方位展示物品的效果,并使得用户可以通过手势主动选择待展示物品的观看角度;因此,本申请提供的方法可以兼具较少网络流量等资源消耗和较高用户体验两方面优势。
在本申请提供的方法中,无需将存储在服务器中的待展示物品的完整视频一次性全部下载到客户端进行观看,仅需根据移动智能设备的当前姿势所对应的物品待展示角度,向服务器请求该展示角度对应图像的前、后相邻部分图像的视频片段,并从视频片段中提取待展示角度对应的物品图像;这种处理方式,可以进一步有效减少网络流量消耗,有益效果更为显著。
图1是本申请提供的一种物品图像的展示方法的实施例的流程图;
图2是本申请提供的一种物品图像的展示装置的实施例的不同拍摄角度呈现图像的示意图;
图3是本申请提供的一种物品图像的展示装置的实施例的示意图;
图4是本申请提供的一种视频下发方法的实施例的流程图;
图5是本申请提供的一种视频下发装置的实施例的示意图;
图6是本申请提供的一种物品图像的展示系统的实施例的示意图;
图7是本申请提供的一种电子设备的实施例的示意图;
图8是本申请提供的一种视频数据生成方法的实施例的示意图;
图9是本申请提供的一种视频数据生成装置的实施例的示意图;
图10是本申请提供的又一种电子设备的实施例的示意图。
在下面的描述中阐述了很多具体细节以便于充分理解本申请。但是本申请能够以很多不同于在此描述的其它方式来实施,本领域技术人员可以在不违背本申请内涵的情况下做类似推广,因此本申请不受下面公开的具体实施的限制。
在本申请中,提供了一种物品图像的展示方法及装置,一种视频下发方法及装置,一种物品图像的展示系统,一种电子设备,以及一种视频数据生成方法、装置及电子设备。在下面的实施例中逐一进行详细说明。
本申请提供的物品图像的展示方法,其核心的基本思想为:通过设置在移动智能设备中的运动检测装置获取移动智能设备的倾斜数据,然后将倾斜数据映射到待展示物品视频上取出对应图像帧并展示;这种处理方式,使得通过用户的手势动作即可灵活切换
待展示物品在屏幕上所呈现的图像,从而可以兼具较少网络流量等资源消耗和较高用户体验两方面优势。
请参考图1,其为本申请的一种物品图像的展示方法的实施例的流程图。所述方法包括如下步骤:
步骤S101:根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定所述移动智能设备的倾斜角度以及倾斜方向。
本申请提供的物品图像的展示方法,用于配置有运动检测装置的移动智能设备。所述的移动智能设备,即:通常所说的手机或者智能手机、平板电脑、可穿戴设备等。所述的运动检测装置安装在移动智能设备中,能够实时检测获得移动智能设备的倾斜角参数。通过运动检测装置提供的库函数,移动智能设备能够实时采集到运动检测装置检测获得的移动智能设备的倾斜角参数。
应用本申请提供的物品图像的展示方法控制物品图像展示的一个关键之处是:对移动智能设备位置、姿态的确定和推算。本步骤在测得移动智能设备的倾斜角参数后,通过运动检测装置提供的库函数,即可完成对移动智能设备位置、姿态的确定和推算处理,进而得到移动智能设备的方位角,即:倾斜角度以及倾斜方向。
所述的运动检测装置不限于角速度传感器,还可以是重力感应器(G-sensor)、或其它能够获取移动智能设备倾斜角参数的传感器。下面对各种形式的运动检测装置作简要说明。
1)重力感应器。
通过重力感应器可以检测得到重力方向。在具体实施时,可采用多轴的重力感应器以检测移动智能设备切向于竖直方向的转动,从而确定移动智能设备的翻转角度,即:移动智能设备的倾斜角度以及倾斜方向。
2)角速度传感器。
角速度传感器是一种能够测量设备偏转与倾斜角度的硬件。角速度传感器应用Coriolis力原理,主要应用于汽车导航、运动物体的位置控制和姿态控制、以及其它需要精确角度测量的场合。
不同于重力感应器的是,角速度传感器的测量物理量是偏转、倾斜时的转动角速度。角速度是指单位时间内位移的增量。角速度传感器和重力感应器最大的区别就是重力传感器对于空间上的位移感受维较少,能做到6个方向的感应就已经很不错了,而角速度
传感器则是全方位的。
常见的角速度传感器包括陀螺仪等。以陀螺仪为例,该装置可以对转动、偏转的动作做很好的测量,进而可以精确分析判断出使用者的实际动作。而后根据动作可对移动智能设备做相应的操作。在移动智能设备上,通过陀螺仪可测量、重构出完整的3D动作。陀螺仪完整监测用户手的位移,从而实现各种观看角度的操作效果。
在本实施例中,移动智能设备为iPhone智能手机,该手机内置微机电陀螺仪(MEMS)。通过陀螺仪测得移动智能设备的瞬时角速度(A/D转换值),通过程序采集到移动智能设备在不同转速下的陀螺仪角速度后,进行对时间的数字积分,进而可得到移动智能设备的方位角,从而确定移动智能设备的倾斜角度以及倾斜方向。通常,在每个转速下都采集7组数据,每组数据大约200个值。
在本实施例中,采用角速度传感器作为运动检测装置,角速度传感器检测获得的倾斜角参数包括角速度、时间、位移等参数。
需要注意的是,在实际使用过程中,突出的问题是噪声对陀螺仪输出有很大的影响,给后续控制移动智能设备带来很大的障碍。当前处理噪声的方法主要有硬件除噪和软件除噪。硬件除噪要考虑电路的可靠性、稳定性,且要追加成本。软件除噪则较为灵活,成本较低,被广泛采用。
3)角速度传感器与重力感应器的结合。
作为一种优选的实施方式,还可结合角速度传感器和重力感应器作为运动检测装置。短时间用角速度传感器找到相对于重力方向的角度,长时间用重力感应器去修整角速度传感器测到的角度,从而提高确定的移动智能设备的倾斜角度以及倾斜方向的准确性。
以上对可应用的三种运动检测装置进行了简要说明。上述三种运动检测装置均具有各自的优缺点。其中,重力感应器的成本最低,以手机为例,目前绝大多数手机都配置了重力感应器。然而,重力感应器是测量加速度的传感器,各种震动均会影响加速度计的测量结果,从而不能得到准确重力方向,进而得到的角度值的准确性也较低。相对于重力传感器而言,通过角速度传感器确定移动智能设备的倾斜角度、倾斜方向的准确性显著提高。然而,角速度传感器的成本则较高,以陀螺仪为例,现在使用陀螺仪的手机机型比较少,包括:iPhone系列手机、三星盖世系列手机、谷歌手机、小米2等。将角速度传感器与重力感应器组合作为运动检测装置的实施方式,能够进一步提高测量的角度的准确性。但是,该方式的成本最高。在实际应用中,可根据具体情况选用适当的运
动检测装置。
步骤S103:根据所述倾斜角度和所述倾斜方向,从待展示物品的视频中提取与所述移动智能设备的当前姿势对应的一帧物品图像。
本步骤是实现待展示物品图像切换的关键步骤,在确定移动智能设备的倾斜角度以及倾斜方向后,从待展示物品的视频中提取与移动智能设备的当前姿势对应的一帧物品图像。
在具体实施时,可采用如下步骤从待展示物品的视频中提取与所述移动智能设备的当前姿势对应的一帧物品图像。
1)根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述待展示物品的待展示角度。
所述的待展示物品的视频包括该物品在不同展示角度(即:不同拍摄角度)对应的每一帧图像。为了能够根据移动智能设备的姿态变化对待展示物品的图像进行切换,首先需要根据移动智能设备的姿态,确定待展示物品的待展示角度。
在具体实施时,可采用如下步骤确定待展示物品的待展示角度。首先,需要获取为待展示物品预设的首次显示图像的展示角度。所述的首次显示图像是指,用户提出对应待展示物品的观看请求后,该物品的第一张显示图像。通常,可将待展示物品的最佳展示角度、最能表示物品特征的图像指定为所述的首次显示图像。在实际应用中,还可将首次显示图像的展示角度默认为0度,即:首次显示图像为待展示物品视频的第一帧图像。
在步骤S101确定移动智能设备的倾斜角度以及倾斜方向后,可根据预设的首次显示图像的展示角度,计算待展示物品的待展示角度。例如,待展示物品的视频包括围绕该物品转120度所拍摄的图像,即:第1帧图像对应0度,最后一帧图像对应120度,首次显示图像的展示角度设置为50度;在首次显示50度拍摄角度对应的物品图像后,如果将手机向右转动5度角,则待展示角度变换为55度,将显示55度拍摄角度对应的物品图像;如果将手机向左转动5度角,则待展示角度变换为45度,将显示45度拍摄角度对应的物品图像。
2)根据所述视频的图像帧序号和图像拍摄角度之间的对应关系,获取所述待展示物品在所述待展示角度所呈现图像的帧序号。
通过上一步骤确定待展示物品的待展示角度后,可根据待展示物品视频的图像帧序
号和图像拍摄角度之间的对应关系,获取待展示物品在待展示角度所呈现图像的帧序号。由此可见,所述的待展示物品的视频不同于一般的物品视频。一般的物品视频仅包括视频文件本身,而本申请所述的待展示物品的视频还包括视频文件中的各个图像的帧序号和拍摄角度之间的对应关系,即所述视频的图像帧序号和图像拍摄角度之间的对应关系。
要生成本申请所述的待展示物品的视频,可采用多种方式进行拍摄,简单便捷的方式为使用具有运动检测装置及拍摄装置的移动智能设备进行拍摄,例如,内置陀螺仪及拍摄装置的智能手机等。当拍摄者手持移动智能设备围绕待展示物品进行拍摄时,对于拍摄到的待展示物品的各个展示角度所呈现图像,通过运动检测装置实时确定各个展示角度所呈现图像对应的拍摄角度;根据各个展示角度所呈现图像的帧序号和各个展示角度所呈现图像的拍摄角度,形成图像帧序号和图像拍摄角度之间的对应关系。
请参看图2,其为本申请的物品图像的展示方法的实施例的不同拍摄角度呈现图像的示意图。由图2可见,围绕被拍摄物体转动一圈(360度)进行拍摄,假设拍摄的起始角度(对应初始机位)为0度(对应图a)),拍摄的终止角度(对应结束机位)为150度(对应图b)),拍摄结束后即可抓取到各个图像帧与其拍摄角度的对应关系。
在实际应用中,还可采用其它方式对待展示物体进行拍摄,只要能够获取图像帧序号和图像拍摄角度之间的对应关系即可。下面给出其它几种适用于不同场景的物体拍摄方法。
拍摄方法一、被拍摄物品固定不动,配置圆形轨道,将相机架设在轨道上,让相机以一个固定的角速度围绕物体进行拍摄。这里的角速度为预设值,也就是说拍摄角度和图像帧序号的对应关系已知,如转角x则对应图像A。这种拍摄方式适用于大型物体的拍摄,比如轿车等;但需要投入较大的资金,大商家可以用到,小商户则不利于推广。
拍摄方法二、给被拍摄物品(比如小玩具)配置一个电机地盘,以恒定角速度做圆周运动,相机固定拍摄,也可以得到全景视频。这里的角速度也是预设的,即拍摄角度和图像帧序号的对应关系已知。这种拍摄方式适用于小型物体的拍摄,比如小玩具等;仍需要部分资金的投入,如购买摄像设备,购买摄影棚和电机等等。
综上所述,直接使用移动智能设备对待展示物体进行拍摄是一种较为快捷简单的方法。
3)根据获取到的所述帧序号,从所述视频中提取所述物品图像。
根据移动智能设备的当前姿态确定待展示图像的帧序号后,即可根据获取到的帧序
号,从待展示物品的视频中提取与当前姿势对应的一帧物品图像。
在具体实施时,可在用户提出针对待展示物品的观看请求时,从视频存储设备(如服务器)中下载视频文件。随着用户手势的变化,当需要对待展示物品进行图像切换时,直接从已下载的视频文件中即可提取到与当前姿势对应的一帧物品图像。
然而,在实际应用中,用户可能并不需要观看物品的所有已拍摄图像(各个展示角度对应的图像),而可能仅需观看部分角度的图像。在这种情况下,上述一次性下载完整视频文件的方式显然存在浪费网络流量的问题。为了降低网络流量消耗,可在物品图像展示过程中,根据一定视频下载规则向服务器请求下载仅包括待展示图像及其前后相邻图像的视频片段。
所述的视频片段包括在待展示角度所呈现图像、及在待展示角度所呈现图像之前相邻图像和之后相邻图像。例如,视频片段包括小于待展示角度10度内的相邻图像、待展示角度所呈现图像、及大于待展示角度10度内的相邻图像;或者,视频片段包括待展示角度所呈现图像之前相邻20帧图像至待展示角度所呈现图像之后相邻20帧图像之间的所有图像。
在具体实施时,获取所述视频片段的过程为:首先,向服务器发送对应待展示物品在待展示角度所呈现图像的视频片段请求,该视频片段请求携带有待展示物品在待展示角度所呈现图像的标识信息;服务器接收到客户端发送的对应待展示物品的视频请求后,根据视频片段请求携带的待展示物品在待展示角度所呈现图像的标识信息,从预先存储的待展示物品的视频中提取视频片段,并向客户端回送提取到的视频片段;客户端接收到服务器回送的视频片段后,即可从视频片段中提取物品图像。其中,所述的标识信息包括待展示角度或在待展示角度所呈现图像的帧序号。
由于视频片段包括待展示角度所呈现图像、及其之前若干帧图像和之后若干帧图像,因此,如果已下载的视频片段中包括待展示物品在待展示角度所呈现图像,则在显示该图像时无需再向服务器请求下载包括待展示角度所呈现图像的视频片段,直接从已下载的视频片段提取待展示角度所呈现图像即可。
步骤S105:将提取到的物品图像显示在与所述移动智能设备有关联关系的屏幕上。
所述的与移动智能设备有关联关系的屏幕包括但不限于:移动智能设备的显示器,还可以为与移动智能设备相连接的其他显示设备,例如,投影仪等,通过投影仪可将提取到的物品图像显示在大屏幕上,从而增强用户的视觉感受。
在具体实施时,可采用OpenGL技术对提取到的物品图像进行图像渲染。OpenGL可使用硬件设备提高图像处理的速度,具有提高渲染速度、突破Java内存限制、便于加入更多渲染特效的优点,从而能够提高物品图像展示的整体性能,提供给用户流畅的立体观感。
在上述的实施例中,提供了一种物品图像的展示方法,与之相对应的,本申请还提供一种物品图像的展示装置。该装置是与上述物品图像的展示方法的实施例相对应。
请参看图3,其为本申请的物品图像的展示装置实施例的示意图。由于装置实施例基本相似于方法实施例,所以描述得比较简单,相关之处参见方法实施例的部分说明即可。下述描述的装置实施例仅仅是示意性的。
本实施例的一种物品图像的展示装置,包括:姿态确定单元101,用于根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定所述移动智能设备的倾斜角度以及倾斜方向;图像提取单元103,用于根据所述倾斜角度和所述倾斜方向,从待展示物品的视频中提取与所述移动智能设备的当前姿势对应的一帧物品图像;图像显示单元105,用于将提取到的物品图像显示在与所述移动智能设备有关联关系的屏幕上。
可选的,所述图像提取单元103包括:
展示角度确定子单元,用于根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述待展示物品的待展示角度;
帧序号获取子单元,用于根据所述视频的图像帧序号和图像拍摄角度之间的对应关系,获取所述待展示物品在所述待展示角度所呈现图像的帧序号;
图像提取子单元,用于根据获取到的所述帧序号,从所述视频中提取所述物品图像。
可选的,所述展示角度确定子单元包括:
初始角度获取子单元,用于获取为所述待展示物品预设的首次显示图像的展示角度;
展示角度计算子单元,用于根据所述预设的首次显示图像的展示角度、所述移动智能设备的倾斜角度以及倾斜方向,计算所述待展示物品的所述待展示角度。
可选的,所述图像提取单元103还包括:
视频请求发送子单元,用于向服务器发送对应所述待展示物品在待展示角度所呈现图像的视频片段请求;所述视频片段请求携带所述待展示物品在待展示角度所呈现图像的标识信息;
视频片段接收子单元,用于接收所述服务器回送的所述视频包括的视频片段;所述视频片段包括所述在待展示角度所呈现图像、及所述在待展示角度所呈现图像之前相邻图像和之后相邻图像;
所述图像提取子单元具体用于:从所述视频片段中提取所述物品图像。
可选的,所述图像提取单元103还包括:
判断子单元,用于判断已下载的视频片段是否包括所述待展示物品在待展示角度所呈现图像;若否,则进入下一步骤。
可选的,所述装置还包括:
噪音清除单元,用于通过预设的除噪算法,去除所述倾斜角参数中的噪音信号。
与上述的物品图像的展示方法相对应,本申请还提供一种视频下发方法。请参考图4,其为本申请提供的一种视频下发方法实施例的流程图,本实施例与第一实施例内容相同的部分不再赘述,请参见实施例一中的相应部分。本申请提供的一种视频下发方法包括:
步骤S101:接收客户端发送的对应特定物品在特定展示角度的视频片段请求。
本申请提供的视频下发方法,其应用场景不仅仅局限于响应上述实施例一中移动智能设备发送的视频片段请求,在其他需要下载视频片段的场景下也可以采用本申请所提供的方法。
所述的客户端包括但不限于移动通讯设备,即:通常所说的手机或者智能手机,还包括个人电脑、PAD、iPad等终端设备。
所述的视频片段请求携带有所述特定物品在特定展示角度所呈现图像的标识信息。所述的标识信息包括所述特定展示角度或在所述特定展示角度所呈现图像的帧序号。例如,客户端请求包括55度拍摄角度所呈现物品图像的视频片段请求,在此情况下,标识信息包括的特定展示角度为55度;或者,客户端请求包括第80帧物品图像的视频片段请求,在此情况下,标识信息为第80帧。
步骤S103:根据所述视频片段请求携带的所述特定物品在特定展示角度所呈现图像的标识信息,从预先存储的所述特定物品的视频中提取视频片段。
通过上一步骤接收到视频片段请求后,本步骤根据视频片段请求携带的特定物品在特定展示角度所呈现图像的标识信息,从预先存储的特定物品的视频中提取视频片段。
如果标识信息为特定物体的特定展示角度,则所述的特定物品的视频不同于一般的物品视频。一般的物品视频仅包括视频文件本身,在这种情况下,所述的特定物品的视频还包括视频文件中的各个图像的帧序号和拍摄角度之间的对应关系。
所述的视频片段包括所述在特定展示角度所呈现图像、及在特定展示角度所呈现图像之前相邻图像和之后相邻图像。例如,视频片段包括小于特定展示角度10度内的相邻图像、特定展示角度所呈现图像、及大于特定展示角度10度内的相邻图像;或者,视频片段包括特定展示角度所呈现图像之前相邻20帧图像至特定展示角度所呈现图像之后相邻20帧图像之间的所有图像。
步骤S105:向所述客户端回送提取到的视频片段。
最后,本步骤将提取到的视频片段回送至发送请求的客户端,供客户端观看。
在上述的实施例中,提供了一种视频下发方法,与之相对应的,本申请还提供一种视频下发装置。该装置是与上述方法的实施例相对应。
请参看图5,其为本申请的视频下发装置实施例的示意图。由于装置实施例基本相似于方法实施例,所以描述得比较简单,相关之处参见方法实施例的部分说明即可。下述描述的装置实施例仅仅是示意性的。
本实施例的一种视频下发装置,包括:视频请求接收单元101,用于接收客户端发送的对应特定物品在特定展示角度的视频片段请求;视频片段提取单元103,用于根据所述视频片段请求携带的所述特定物品在所述特定展示角度所呈现图像的标识信息,从预先存储的所述特定物品的视频中提取视频片段;所述视频片段包括在所述特定展示角度所呈现图像、及在所述特定展示角度所呈现图像之前相邻图像和之后相邻图像;视频片段回送单元105,用于向所述客户端回送提取到的视频片段。
此外,本申请还提供了一种物品图像的展示系统,如图6所示,该系统包括上述实施例所述的物品图像的展示装置601和视频下发装置602。所述物品图像的展示装置可以部署于配置了运动检测装置的移动通讯设备,例如:智能手机,也可以部署于配置了运动检测装置的可穿戴式智能设备,例如:智能手表等;所述视频下发装置通常部署于服务器,但并不局限于服务器,也可以是能够实现本申请所述的视频下发方法的任何设备。
例如,所述物品图像的展示装置部署于配置了陀螺仪的智能手机上,所述视频下发装置部署于服务器上。当用户提交针对待展示物品的图像观看请求后,智能手机首先根
据为该物品预设的首次显示图像的展示角度或帧序号,向服务器请求下载包括首次显示图像的视频片段;部署于服务器上的视频下发装置响应该请求,从预先存储的该物品的完整视频中提取相应视频片段,并将其返回至智能手机;智能手机接收到视频片段后,即可显示该物品的首次显示图像;当用户转动该智能手机时,根据运动检测装置检测获得的该智能手机的倾斜角参数,确定该智能手机的倾斜角度以及倾斜方向,并根据确定的倾斜角度和倾斜方向,从该物品的视频中提取与智能手机的当前姿势对应的一帧物品图像,并将提取到的物品图像显示在与智能手机有关联关系的屏幕上。当检测到已下载至智能手机的视频片段不包括该物品在待展示角度所呈现图像时,需要再次向服务器请求下载包括该待展示角度所呈现图像的视频片段。
上述例子仅仅是示意性的,在其它的实施方式中,也可以采用不同的部署方式和实施方式,只要能够实现本申请所述的物品图像的展示系统的整体功能,就在本申请的保护范围之内。
此外,本申请还提供了一种电子设备,请参考图7,其为本申请的电子设备实施例的示意图。本实施例的一种电子设备,该电子设备包括:运动检测装置101;处理器102;以及存储器103,用于存储实现物品图像的展示方法的程序,该设备通电并通过所述处理器102运行该物品图像的展示方法的程序后,执行下述步骤:根据所述运动检测装置检测获得的所述电子设备的倾斜角参数,确定所述电子设备的倾斜角度以及倾斜方向;根据所述电子设备的倾斜角度以及倾斜方向,从待展示物品的视频中提取与所述电子设备的当前姿势对应的一帧物品图像;将提取到的物品图像显示在与所述电子设备有关联关系的屏幕上。
可选的,所述电子设备还包括显示器;
所述将提取到的物品图像显示在与所述电子设备有关联关系的屏幕上,采用如下方式:
在所述显示器上显示所述提取到的物品图像。
与上述的物品图像的展示方法相对应,本申请还提供一种视频数据生成方法。请参考图8,其为本申请提供的一种视频数据生成方法实施例的流程图,本实施例与第一实施例内容相同的部分不再赘述,请参见实施例一中的相应部分。本申请提供的一种视频数据生成方法包括:
步骤S101:对于所述摄像装置拍摄获得的待拍摄物品的当前帧图像,根据所述运动
检测装置检测获得的所述移动智能设备的倾斜角参数,确定拍摄所述当前帧图像时所述移动智能设备的倾斜角度以及倾斜方向。
本申请提供的视频数据生成方法,用于配置有运动检测装置和摄像装置的移动智能设备。所述的移动智能设备,即:通常所说的手机或者智能手机、平板电脑、可穿戴设备等。所述的运动检测装置不限于角速度传感器,还可以是重力感应器(G-sensor)、或其它能够获取移动智能设备倾斜角参数的传感器。
当拍摄者手持移动智能设备围绕待拍摄物品进行拍摄时,对于拍摄到的该物品的各个展示角度所呈现图像,通过运动检测装置可实时检测获得移动智能设备的倾斜角参数,继而通过运动检测装置提供的库函数,即可确定拍摄各帧图像时移动智能设备的倾斜角度以及倾斜方向。
步骤S103:根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述当前帧图像的拍摄角度。
通过上一步骤确定拍摄当前帧图像对应的移动智能设备的倾斜角度以及倾斜方向后,即可确定该当前帧图像所对应的拍摄角度。例如,在围绕待拍摄物品转120度所拍摄的视频中,即:第1帧图像对应0度,最后一帧图像对应120度。
需要说明的是,应用本申请提供的视频数据生成方法,其拍摄过程既可为匀速的,也可以是非匀速的。拍摄后最终形成的视频所包括的帧数不仅与拍摄角度的范围有关,也与帧率有关。在某一拍摄角度处对应的图像帧数可能明显多于在其它拍摄角度处对应的图像帧数。
步骤S105:根据所述当前帧图像的帧序号和所述当前帧图像的拍摄角度,形成所述当前帧图像的图像帧序号和图像拍摄角度之间的对应关系。
对于拍摄到的每一帧图像,根据图像的帧序号及其拍摄角度,即可形成图像帧序号和图像拍摄角度之间的对应关系。
步骤S107:将拍摄获得的所述待拍摄物品的视频、所述视频中各个图像的所述图像帧序号和图像拍摄角度之间的对应关系,作为所述待拍摄物品的视频数据。
应用本申请提供的视频数据生成方法所生成的物品视频不同于一般的物品视频。一般的物品视频仅包括视频文件本身,而本申请所述的物品视频还包括视频文件中的各个图像的帧序号和拍摄角度之间的对应关系,即图像帧序号和图像拍摄角度之间的对应关系。
在上述的实施例中,提供了一种视频数据生成方法,与之相对应的,本申请还提供一种视频数据生成装置。该装置是与上述方法的实施例相对应。
请参看图9,其为本申请的视频数据生成装置实施例的示意图。由于装置实施例基本相似于方法实施例,所以描述得比较简单,相关之处参见方法实施例的部分说明即可。下述描述的装置实施例仅仅是示意性的。
本实施例的一种视频数据生成装置,包括:姿态确定单元101,用于对于所述摄像装置拍摄获得的待拍摄物品的当前帧图像,根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定拍摄所述当前帧图像时所述移动智能设备的倾斜角度以及倾斜方向;角度确定单元103,用于根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述当前帧图像的拍摄角度;对应关系生成单元105,用于根据所述当前帧图像的帧序号和所述当前帧图像的拍摄角度,形成所述当前帧图像的图像帧序号和图像拍摄角度之间的对应关系;视频数据设置单元107,用于将拍摄获得的所述待拍摄物品的视频、所述视频中各个图像的所述图像帧序号和图像拍摄角度之间的对应关系,作为所述待拍摄物品的视频数据。
此外,本申请还提供了又一种电子设备,请参考图10,其为本申请的又一电子设备实施例的示意图。本实施例的一种电子设备,该电子设备包括:摄像装置101;运动检测装置102;处理器103;以及存储器104,用于存储实现视频数据生成方法的程序,该设备通电并运行该视频数据生成方法的程序后,执行下述步骤:对于所述摄像装置拍摄获得的待拍摄物品的当前帧图像,根据所述运动检测装置检测获得的所述电子设备的倾斜角参数,确定拍摄所述当前帧图像时所述电子设备的倾斜角度以及倾斜方向;根据所述电子设备的倾斜角度以及倾斜方向,确定所述当前帧图像的拍摄角度;根据所述当前帧图像的帧序号和所述当前帧图像的拍摄角度,形成所述当前帧图像的图像帧序号和图像拍摄角度之间的对应关系;将拍摄获得的所述待拍摄物品的视频、所述视频中各个图像的所述图像帧序号和图像拍摄角度之间的对应关系,作为所述待拍摄物品的视频数据。
本申请虽然以较佳实施例公开如上,但其并不是用来限定本申请,任何本领域技术人员在不脱离本申请的精神和范围内,都可以做出可能的变动和修改,因此本申请的保护范围应当以本申请权利要求所界定的范围为准。
在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。
内存可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。
1、计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括非暂存电脑可读媒体(transitory media),如调制的数据信号和载波。
2、本领域技术人员应明白,本申请的实施例可提供为方法、系统或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
Claims (25)
- 一种物品图像的展示方法,用于移动智能设备,所述移动智能设备配置有运动检测装置,其特征在于,包括:根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定所述移动智能设备的倾斜角度以及倾斜方向;根据所述倾斜角度和所述倾斜方向,从待展示物品的视频中提取与所述移动智能设备的当前姿势对应的一帧物品图像;将提取到的物品图像显示在与所述移动智能设备有关联关系的屏幕上。
- 根据权利要求1所述的物品图像的展示方法,其特征在于,所述从待展示物品的视频中提取与所述移动智能设备的当前姿势对应的一帧物品图像,包括:根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述待展示物品的待展示角度;根据所述视频的图像帧序号和图像拍摄角度之间的对应关系,获取所述待展示物品在所述待展示角度所呈现图像的帧序号;根据获取到的所述帧序号,从所述视频中提取所述物品图像。
- 根据权利要求2所述的物品图像的展示方法,其特征在于,所述确定所述待展示物品的待展示角度,包括:获取为所述待展示物品预设的首次显示图像的展示角度;根据所述预设的首次显示图像的展示角度、所述移动智能设备的倾斜角度以及倾斜方向,计算所述待展示物品的所述待展示角度。
- 根据权利要求2所述的物品图像的展示方法,其特征在于,在所述从所述视频中提取所述物品图像之前,还包括:向服务器发送对应所述待展示物品在待展示角度所呈现图像的视频片段请求;所述视频片段请求携带所述待展示物品在待展示角度所呈现图像的标识信息;接收所述服务器回送的所述视频包括的视频片段;所述视频片段包括所述在待展示角度所呈现图像、及所述在待展示角度所呈现图像之前相邻图像和之后相邻图像;所述从所述视频文件提取所述物品图像,采用如下方式:从所述视频片段中提取所述物品图像。
- 根据权利要求4所述的物品图像的展示方法,其特征在于,所述标识信息包括所述待展示角度或所述在待展示角度所呈现图像的帧序号。
- 根据权利要求4所述的物品图像的展示方法,其特征在于,在所述向服务器发送对应所述待展示物品的视频请求之前,还包括:判断已下载的视频片段是否包括所述待展示物品在待展示角度所呈现图像;若否,则进入下一步骤。
- 根据权利要求2所述的物品图像的展示方法,其特征在于,所述图像帧序号和图像拍摄角度之间的对应关系,采用如下方式生成:在拍摄所述待展示物品时,对于拍摄到的所述待展示物品的各个展示角度所呈现图像,通过运动检测装置确定所述各个展示角度所呈现图像对应的拍摄角度;根据所述各个展示角度所呈现图像的帧序号和所述各个展示角度所呈现图像的拍摄角度,形成所述图像帧序号和图像拍摄角度之间的对应关系。
- 根据权利要求1所述的物品图像的展示方法,其特征在于,在所述确定所述移动智能设备的倾斜角度以及倾斜方向之前,还包括:通过预设的除噪算法,去除所述倾斜角参数中的噪音信号。
- 根据权利要求1所述的物品图像的展示方法,其特征在于,所述在与所述移动智能设备有关联关系的屏幕上显示提取到的物品图像,采用如下方式:通过OpenGL技术,对所述提取到的物品图像进行图像渲染。
- 根据权利要求1所述的物品图像的展示方法,其特征在于,所述运动检测装置包括角速度传感器和重力感应器的至少一者。
- 一种物品图像的展示装置,用于移动智能设备,所述移动智能设备配置有运动检测装置,其特征在于,包括:姿态确定单元,用于根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定所述移动智能设备的倾斜角度以及倾斜方向;图像提取单元,用于根据所述倾斜角度和所述倾斜方向,从待展示物品的视频中提取与所述移动智能设备的当前姿势对应的一帧物品图像;图像显示单元,用于将提取到的物品图像显示在与所述移动智能设备有关联关系的屏幕上。
- 根据权利要求11所述的物品图像的展示装置,其特征在于,所述图像提取单元包括:展示角度确定子单元,用于根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述待展示物品的待展示角度;帧序号获取子单元,用于根据所述视频的图像帧序号和图像拍摄角度之间的对应关系,获取所述待展示物品在所述待展示角度所呈现图像的帧序号;图像提取子单元,用于根据获取到的所述帧序号,从所述视频中提取所述物品图像。
- 根据权利要求12所述的物品图像的展示装置,其特征在于,所述展示角度确定子单元包括:初始角度获取子单元,用于获取为所述待展示物品预设的首次显示图像的展示角度;展示角度计算子单元,用于根据所述预设的首次显示图像的展示角度、所述移动智能设备的倾斜角度以及倾斜方向,计算所述待展示物品的所述待展示角度。
- 根据权利要求12所述的物品图像的展示装置,其特征在于,所述图像提取单元还包括:视频请求发送子单元,用于向服务器发送对应所述待展示物品的视频片段请求;所述视频片段请求携带所述待展示物品在待展示角度所呈现图像的标识信息;视频片段接收子单元,用于接收所述服务器回送的所述视频包括的视频片段;所述视频片段包括所述在待展示角度所呈现图像、及所述在待展示角度所呈现图像之前相邻图像和之后相邻图像;所述图像提取子单元具体用于:从所述视频片段中提取所述物品图像。
- 根据权利要求14所述的物品图像的展示装置,其特征在于,所述图像提取单元还包括:判断子单元,用于判断已下载的视频片段是否包括所述待展示物品在待展示角度所呈现图像;若否,则进入下一步骤。
- 根据权利要求11所述的物品图像的展示装置,其特征在于,还包括:噪音清除单元,用于通过预设的除噪算法,去除所述倾斜角参数中的噪音信号。
- 一种视频下发方法,其特征在于,包括:接收客户端发送的对应特定物品在特定展示角度的视频片段请求;根据所述视频片段请求携带的所述特定物品在所述特定展示角度所呈现图像的标识信息,从预先存储的所述特定物品的视频中提取视频片段;所述视频片段包括在所述特定展示角度所呈现图像、及在所述特定展示角度所呈现图像之前相邻图像和之后相邻图像;向所述客户端回送提取到的视频片段。
- 根据权利要求17所述的视频下发方法,其特征在于,所述标识信息包括所述特定展示角度或在所述特定展示角度所呈现图像的帧序号。
- 一种视频下发装置,其特征在于,包括:视频请求接收单元,用于接收客户端发送的对应特定物品在特定展示角度的视频片段请求;视频片段提取单元,用于根据所述视频片段请求携带的所述特定物品在所述特定展示角度所呈现图像的标识信息,从预先存储的所述特定物品的视频中提取视频片段;所述视频片段包括在所述特定展示角度所呈现图像、及在所述特定展示角度所呈现图像之前相邻图像和之后相邻图像;视频片段回送单元,用于向所述客户端回送提取到的视频片段。
- 一种物品图像的展示系统,其特征在于,包括:上述权利要求11所述的物品图像的展示装置,以及上述权利要求19所述的视频下发装置。
- 一种电子设备,其特征在于,包括:运动检测装置;处理器;以及存储器,用于存储实现物品图像的展示方法的程序,该设备通电并通过所述处理器运行该物品图像的展示方法的程序后,执行下述步骤:根据所述运动检测装置检测获得的所述电子设备的倾斜角参数,确定所述电子设备的倾斜角度以及倾斜方向;根据所述电子设备的倾斜角度以及倾斜方向,从待展示物品的视频中提取与所述电子设备的当前姿势对应的一帧物品图像;在与所述电子设备有关联关系的屏幕上显示提取到的物品图像。
- 根据权利要求21所述的电子设备,其特征在于,还包括显示器;采用如下方式将提取到的物品图像显示在与所述电子设备有关联关系的屏幕上:在所述显示器上显示所述提取到的物品图像。
- 一种视频数据生成方法,用于移动智能设备,所述移动智能设备配置有摄像装置和运动检测装置,其特征在于,包括:对于所述摄像装置拍摄获得的待拍摄物品的当前帧图像,根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定拍摄所述当前帧图像时所述移动智能设备的倾斜角度以及倾斜方向;根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述当前帧图像的拍摄角 度;根据所述当前帧图像的帧序号和所述当前帧图像的拍摄角度,形成所述当前帧图像的图像帧序号和图像拍摄角度之间的对应关系;将拍摄获得的所述待拍摄物品的视频、所述视频中各个图像的所述图像帧序号和图像拍摄角度之间的对应关系,作为所述待拍摄物品的视频数据。
- 一种视频数据生成装置,用于移动智能设备,所述移动智能设备配置有摄像装置和运动检测装置,其特征在于,包括:姿态确定单元,用于对于所述摄像装置拍摄获得的待拍摄物品的当前帧图像,根据所述运动检测装置检测获得的所述移动智能设备的倾斜角参数,确定拍摄所述当前帧图像时所述移动智能设备的倾斜角度以及倾斜方向;角度确定单元,用于根据所述移动智能设备的倾斜角度以及倾斜方向,确定所述当前帧图像的拍摄角度;对应关系生成单元,用于根据所述当前帧图像的帧序号和所述当前帧图像的拍摄角度,形成所述当前帧图像的图像帧序号和图像拍摄角度之间的对应关系;视频数据设置单元,用于将拍摄获得的所述待拍摄物品的视频、所述视频中各个图像的所述图像帧序号和图像拍摄角度之间的对应关系,作为所述待拍摄物品的视频数据。
- 一种电子设备,其特征在于,包括:摄像装置;运动检测装置;处理器;以及存储器,用于存储实现视频数据生成方法的程序,该设备通电并运行该视频数据生成方法的程序后,执行下述步骤:对于所述摄像装置拍摄获得的待拍摄物品的当前帧图像,根据所述运动检测装置检测获得的所述电子设备的倾斜角参数,确定拍摄所述当前帧图像时所述电子设备的倾斜角度以及倾斜方向;根据所述电子设备的倾斜角度以及倾斜方向,确定所述当前帧图像的拍摄角度;根据所述当前帧图像的帧序号和所述当前帧图像的拍摄角度,形成所述当前帧图像的图像帧序号和图像拍摄角度之间的对应关系;将拍摄获得的所述待拍摄物品的视频、所述视频中各个图像的所述图像帧序号和图像拍摄角度之间的对应关系,作为所述待拍摄物品的视频数据。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610211628.5A CN107272983A (zh) | 2016-04-06 | 2016-04-06 | 一种物品图像的展示方法、装置及系统 |
| CN201610211628.5 | 2016-04-06 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2017173933A1 true WO2017173933A1 (zh) | 2017-10-12 |
Family
ID=60000843
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/078057 Ceased WO2017173933A1 (zh) | 2016-04-06 | 2017-03-24 | 一种物品图像的展示方法、装置及系统 |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN107272983A (zh) |
| TW (1) | TW201810217A (zh) |
| WO (1) | WO2017173933A1 (zh) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110796045A (zh) * | 2019-10-17 | 2020-02-14 | 上海红星美凯龙设计云信息科技有限公司 | 一种视野中可见物体实时智能抓取排序算法 |
| CN111445559A (zh) * | 2020-04-07 | 2020-07-24 | 珠海格力电器股份有限公司 | 图像处理和展示方法、装置、设备及计算机可读介质 |
| CN113012106A (zh) * | 2021-02-22 | 2021-06-22 | 北京星网锐捷网络技术有限公司 | 显示设备的自动检测方法、装置及系统 |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107895293A (zh) * | 2016-09-30 | 2018-04-10 | 阿里巴巴集团控股有限公司 | 一种图像显示方法、装置及系统 |
| CN110569927A (zh) * | 2019-09-19 | 2019-12-13 | 浙江大搜车软件技术有限公司 | 移动端全景图像扫描提取的方法、终端和计算机设备 |
| CN110766830A (zh) * | 2019-09-24 | 2020-02-07 | 重庆特斯联智慧科技股份有限公司 | 一种基于全景成像的安防门禁系统及控制方法 |
| CN112801764B (zh) * | 2021-04-14 | 2022-02-11 | 浙江口碑网络技术有限公司 | 图像展示方法、图像处理方法、装置及电子设备 |
| CN113032282B (zh) * | 2021-04-29 | 2024-04-09 | 北京字节跳动网络技术有限公司 | 一种手势识别装置的测试方法、装置及设备 |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101452581A (zh) * | 2008-12-30 | 2009-06-10 | 暨南大学 | 一种计算全息动画的快速生成方法 |
| CN101582959A (zh) * | 2008-05-15 | 2009-11-18 | 财团法人工业技术研究院 | 智能型多视角数字显示系统及显示方法 |
| CN101639921A (zh) * | 2009-08-21 | 2010-02-03 | 于学先 | 网络数据交互方法和网络服务器 |
-
2016
- 2016-04-06 CN CN201610211628.5A patent/CN107272983A/zh active Pending
-
2017
- 2017-03-09 TW TW106107795A patent/TW201810217A/zh unknown
- 2017-03-24 WO PCT/CN2017/078057 patent/WO2017173933A1/zh not_active Ceased
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582959A (zh) * | 2008-05-15 | 2009-11-18 | 财团法人工业技术研究院 | 智能型多视角数字显示系统及显示方法 |
| CN101452581A (zh) * | 2008-12-30 | 2009-06-10 | 暨南大学 | 一种计算全息动画的快速生成方法 |
| CN101639921A (zh) * | 2009-08-21 | 2010-02-03 | 于学先 | 网络数据交互方法和网络服务器 |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110796045A (zh) * | 2019-10-17 | 2020-02-14 | 上海红星美凯龙设计云信息科技有限公司 | 一种视野中可见物体实时智能抓取排序算法 |
| CN110796045B (zh) * | 2019-10-17 | 2024-04-09 | 上海红星美凯龙设计云信息科技有限公司 | 一种视野中可见物体实时智能抓取排序算法 |
| CN111445559A (zh) * | 2020-04-07 | 2020-07-24 | 珠海格力电器股份有限公司 | 图像处理和展示方法、装置、设备及计算机可读介质 |
| CN113012106A (zh) * | 2021-02-22 | 2021-06-22 | 北京星网锐捷网络技术有限公司 | 显示设备的自动检测方法、装置及系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107272983A (zh) | 2017-10-20 |
| TW201810217A (zh) | 2018-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017173933A1 (zh) | 一种物品图像的展示方法、装置及系统 | |
| US11393173B2 (en) | Mobile augmented reality system | |
| US8660362B2 (en) | Combined depth filtering and super resolution | |
| US9031283B2 (en) | Sensor-aided wide-area localization on mobile devices | |
| KR20200146040A (ko) | 깊이 추정 시스템의 자가 감독 훈련 | |
| KR20200130472A (ko) | 깊이 힌트를 사용하는 깊이 추정 모델의 자가 감독 훈련 | |
| WO2014162044A1 (en) | Method and apparatus for determining camera location information and/or camera pose information according to a global coordinate system | |
| BR112015023345B1 (pt) | Criação in situ de alvos planos de recurso natural | |
| US9756260B1 (en) | Synthetic camera lenses | |
| US20170064289A1 (en) | System and method for capturing and displaying images | |
| CN110351480A (zh) | 用于电子设备的图像处理方法、装置及电子设备 | |
| CN107832331A (zh) | 可视化对象的生成方法、装置和设备 | |
| CN109040525B (zh) | 图像处理方法、装置、计算机可读介质及电子设备 | |
| US8451346B2 (en) | Optically projected mosaic rendering | |
| CN114900621B (zh) | 特效视频确定方法、装置、电子设备及存储介质 | |
| US20260011017A1 (en) | Virtual selfie stick | |
| WO2025232770A1 (zh) | 音频处理方法、装置、设备、介质及程序产品 | |
| HK1245442A1 (zh) | 一种物品图像的展示方法、装置及系统 | |
| CN108734721B (zh) | 追踪系统以及追踪方法 | |
| Chang et al. | Augmented reality services of photos and videos from filming sites using their shooting locations and attitudes | |
| CN105787988B (zh) | 一种信息处理方法、服务器及终端设备 | |
| HK1253258A1 (zh) | 一种图像显示方法、装置及系统 | |
| CN107895293A (zh) | 一种图像显示方法、装置及系统 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17778597 Country of ref document: EP Kind code of ref document: A1 |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17778597 Country of ref document: EP Kind code of ref document: A1 |