CN116708801B - Video compression method, shared sales counter and storage medium - Google Patents
Video compression method, shared sales counter and storage medium Download PDFInfo
- Publication number
- CN116708801B CN116708801B CN202310976521.XA CN202310976521A CN116708801B CN 116708801 B CN116708801 B CN 116708801B CN 202310976521 A CN202310976521 A CN 202310976521A CN 116708801 B CN116708801 B CN 116708801B
- Authority
- CN
- China
- Prior art keywords
- video
- time point
- camera
- weight change
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 75
- 238000007906 compression Methods 0.000 title claims abstract description 64
- 230000006835 compression Effects 0.000 title claims abstract description 63
- 230000008859 change Effects 0.000 claims abstract description 72
- 238000004590 computer program Methods 0.000 claims description 11
- 239000012634 fragment Substances 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 abstract description 13
- 230000008569 process Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013585 weight reducing agent Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01G—WEIGHING
- G01G19/00—Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F9/00—Details other than those peculiar to special kinds or types of apparatus
- G07F9/002—Vending machines being part of a centrally controlled network of vending machines
Abstract
The invention provides a video compression method, a shared vending cabinet and a storage medium, which are applied to the technical field of vending machines, wherein the method is applied to the shared vending cabinet, and the shared vending cabinet comprises a weight sensor and a camera, and comprises the following steps: acquiring a first video of a user taking and placing goods, which is shot by the camera; determining a time point when a weight change occurs based on the sensing data of the weight sensor; compressing the first video based on the time point to obtain a second video; uploading the second video to the server, wherein the second video is used for identifying goods taken and put by the user; or uploading the time point when the weight change occurs and the first video to a server; the time point is used for compressing the first video by the server. In the scheme, on one hand, bandwidth pressure can be reduced, and on the other hand, transmission time can be shortened, and recognition and settlement time can be reduced.
Description
Technical Field
The invention relates to the technical field of vending machines, in particular to a video compression method, a shared vending cabinet and a storage medium.
Background
At present, vending machines are mainly divided into two types, namely a traditional goods channel vending machine, and after a user finishes paying, the vending machine pushes out corresponding goods from a goods channel. The other type is an open type vending cabinet, the vending cabinet is based on the credit of a user, the user can unlock the cabinet door to automatically take the commodities in the equipment, and then commodity identification and settlement are carried out based on the result perceived by the sensor.
In the prior art, an open type vending cabinet senses based on a camera, and images acquired by the camera determine commodities taken out by a user through an image analysis model. Typically limited to technical capabilities, most equipment manufacturers do not have the ability to develop complex video image processing models, and camera image recognition based schemes are typically based on third party payment interfaces, so the settlement period of such equipment is long, tens of seconds and minutes.
Disclosure of Invention
The invention provides a video compression method, a shared selling cabinet and a storage medium, which are used for solving the defect of long settlement period in the prior art and realizing a scheme with short settlement time and high settlement efficiency.
The invention provides a video compression method which is applied to a shared vending cabinet, wherein the shared vending cabinet comprises a weight sensor and a camera, and the method comprises the following steps:
acquiring a first video of a user taking and placing goods, which is shot by the camera;
determining a time point when a weight change occurs based on the sensing data of the weight sensor;
compressing the first video based on the time point to obtain a second video; uploading the second video to the server, wherein the second video is used for identifying goods taken and put by the user; or alternatively, the first and second heat exchangers may be,
uploading the time point when the weight change occurs and the first video to a server; the time point is used for compressing the first video by the server. Comprising the following steps:
according to the video compression method provided by the invention, the compression processing is performed on the first video based on the time point to obtain a second video, which comprises the following steps:
and intercepting the video segments of the first video in a first preset time length before the time point and the video segments of the first video in a second preset time length after the time point to obtain the second video.
According to the video compression method provided by the invention, under the condition that the weight change becomes light, the first preset duration is smaller than the second preset duration;
and under the condition that the weight change is heavier, the first preset time period is longer than the second preset time period.
According to the video compression method provided by the invention, the compression processing is performed on the first video based on the time point to obtain a second video, which comprises the following steps:
and compressing the video frames of the first video outside the preset time range of the time point to obtain the second video.
According to the video compression method provided by the invention, the compressing processing is performed on the video frames of the first video outside the preset time range of the time point to obtain the second video, and the method comprises the following steps:
reducing the resolution of the video frames of the first video outside the preset time range of the time point to obtain the second video; or alternatively, the first and second heat exchangers may be,
and extracting frames of the video frames of the first video outside the preset time range of the time point according to preset frequency to obtain the second video.
According to the video compression method provided by the invention, when the time points of weight change are multiple, after the first video is intercepted based on the time points, the method further comprises:
and merging the video clips corresponding to the time points.
The invention also provides a video compression method, which is applied to the server and comprises the following steps:
receiving a time point of weight change sent by the sharing vending cabinet and a first video; the first video is a video of a user taking and placing goods, which is shot by a camera of the shared vending cabinet;
compressing the first video based on the time point to obtain a second video; or alternatively, the first and second heat exchangers may be,
receiving a second video sent by the sharing vending cabinet, wherein the second video is obtained by compressing the first video by the sharing vending cabinet based on the time point;
and sending the second video to third-party equipment, wherein the second video is used for identifying goods fetched and placed by the user.
The invention also provides a video compression device applied to a shared vending cabinet, wherein the shared vending cabinet comprises a weight sensor and a camera, and the device comprises:
the acquisition module is used for acquiring a first video of the goods taking and placing process of the user shot by the camera;
the processing module is used for determining a time point when weight change occurs based on the sensing data of the weight sensor;
the processing module is further used for compressing the first video based on the time point to obtain a second video;
the sending module is used for uploading the second video to the server, and the second video is used for identifying goods taken and put by the user; or alternatively, the first and second heat exchangers may be,
the sending module is used for uploading the time point with the weight change and the first video to a server; the time point is used for compressing the first video by the server.
The invention also provides a video compression device, which is applied to a server and comprises:
the receiving module is used for receiving the time point of weight change sent by the sharing vending cabinet and the first video; the first video is a video of a user taking and placing goods, which is shot by a camera of the shared vending cabinet;
the processing module is used for compressing the first video based on the time point to obtain a second video; or alternatively, the first and second heat exchangers may be,
the receiving module is used for receiving a second video sent by the sharing vending cabinet, wherein the second video is obtained by compressing the first video by the sharing vending cabinet based on the time point;
and the sending module is used for sending the second video to third-party equipment, and the second video is used for identifying goods fetched and placed by the user.
The invention also provides a shared vending cabinet, comprising:
the device comprises a cabinet body, a weight sensor, a camera and a main control board respectively connected with the weight sensor and the camera;
the weight sensor, the camera and the main control board are arranged in the cabinet body;
the weight sensor and the camera acquire data, and the server for communicating with the shared vending cabinet performs order settlement based on the weight sensor and the camera acquire data and payment information of a user;
and the main control board is used for executing the video compression method according to any one of the above.
The invention also provides a master control device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the video compression method according to any one of the above when executing the program.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a video compression method as described in any of the above.
The invention also provides a computer program product comprising a computer program which when executed by a processor implements a video compression method as described in any one of the above.
According to the video compression method, the shared vending cabinet and the storage medium, a first video of a commodity taking and placing process of a user shot by the camera is obtained; determining a time point when a weight change occurs based on the sensing data of the weight sensor; compressing the first video based on the time point to obtain a second video; uploading the second video to the server, wherein the second video is used for identifying goods taken and put by the user, and because the first video of the goods taking and put process of the user is compressed at the time point of weight change on the side of the sales counter, the transmitted data volume is less, the bandwidth pressure can be reduced, the transmission time can be shortened, the identification and settlement time can be shortened, and the calculation efficiency can be improved; or the sales counter uploads the time point when the weight change occurs and the first video to a server; the server compresses according to the information of the sensor and sends the compressed information to the third party equipment for identification, so that the data transmission quantity and the transmission time between the server and the third party equipment are reduced, the identification and settlement time can be reduced, and the calculation efficiency is improved; moreover, since the compression processing is performed based on the time point when the weight change occurs, the recognition accuracy can be ensured.
Drawings
In order to more clearly illustrate the invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a video compression method according to the present invention;
fig. 2 is a schematic diagram of a shared vending cabinet of the video compression method provided by the invention;
FIG. 3 is a schematic diagram of a video capturing principle of the video compression method according to the present invention;
FIG. 4 is a schematic diagram of a video capturing principle of the video compression method according to the second embodiment of the present invention;
FIG. 5 is a second flow chart of the video compression method according to the present invention;
FIG. 6 is a schematic diagram of a video compression apparatus according to the present invention;
FIG. 7 is a second schematic diagram of a video compression apparatus according to the present invention;
fig. 8 is a schematic structural diagram of a master control device provided by the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
First, the nouns and application scenarios related to the embodiments of the present invention are described:
at present, vending machines are mainly divided into two types, namely a traditional goods channel vending machine, and after a user finishes paying, the vending machine pushes out corresponding goods from a goods channel. The other type is an open type vending cabinet, the vending cabinet is based on the credit of a user, the user can unlock the cabinet door to automatically take the commodities in the equipment, and then commodity identification and settlement are carried out based on the result perceived by the sensor.
The method of the embodiment of the invention is mainly aimed at an open type shared vending cabinet.
In the prior art, for the scheme of performing perception recognition and settlement based on a camera, in general, the security of a third party interface is considered, the calling authority is not lowered to the shared selling cabinet equipment, but the shared selling cabinet equipment transmits the video clip to the server first, and then the video clip is called through the server. The scheme has longer time in identifying settlement.
The following describes the technical solution of the embodiment of the present invention in detail with reference to fig. 1 to 8. The following embodiments may be combined with each other, and some embodiments may not be repeated for the same or similar concepts or processes.
Fig. 1 is a schematic flow chart of a video compression method according to the present invention. The method of the embodiment is applied to a shared vending cabinet, the shared vending cabinet includes a weight sensor and a camera, in this embodiment, accurate settlement can be performed by combining data of the weight sensor and an image collected by the camera, generally, weight change sensed by the weight sensor is utilized to assist in determining an image recognition result, meanwhile, data detected by the weight sensor can also be used for functions such as inventory management, as shown in fig. 1, the method provided by the embodiment includes:
step 101, acquiring a first video of a user taking and placing goods, which is shot by a camera;
specifically, as shown in fig. 2, the shared vending cabinet comprises a cabinet body, a multi-layer goods shelf, a main control board and a camera, wherein the multi-layer goods shelf, the main control board and the camera are arranged in the cabinet body, and a weight sensor (such as a pressure sensor and the like) for sensing the weight of the goods shelf of each layer is arranged in each layer of goods shelf; the main control board is connected with the weight sensor and converts the data based on the weight sensor into sales information, and optionally, the data of the weight sensor can be uploaded to the server, and the server determines what commodity the user takes.
Wherein cameras are typically used for video surveillance. The camera is connected with the main control board.
It should be noted that, in fig. 2, a shelf may have one or more weight sensors, and the camera may have more than one.
In the process of taking and putting goods by a user, the camera shoots, and a first video of the process of taking and putting goods by the user is obtained. And carrying out goods identification and settlement based on the first video.
102, determining a time point when weight change occurs based on sensing data of a weight sensor;
specifically, the time point when the weight changes, namely the video clip of the time point when the weight changes, can be determined based on the sensing data of the weight sensor, namely the video clip comprising the time point is an important video clip, and can be used for identifying the goods taken and put by the user and further settling the settlement, so that the time point is taken as the time point for intercepting the video.
Step 103, compressing the first video based on the time point to obtain a second video; uploading a second video to a server, wherein the second video is used for identifying goods taken and put by a user;
specifically, in order to reduce the data transmission amount and the cycle of goods identification and settlement, and improve the settlement efficiency, the first video shot by the camera and used for the process of taking and placing the goods can be compressed, for example, only the key segments are intercepted or the image quality is reduced for the non-key segments, etc., the principle of intercepting is to intercept the key segments of the process of taking and placing the goods, namely the video of taking and placing the goods, so that the first video is compressed based on the time point of weight change to obtain the second video; uploading the second video to a server, and calling a third party interface by the server to identify goods and settle the order of the user.
Or, step 104, uploading the time point when the weight change occurs and the first video to the server; the time point is used for compressing the first video by the server.
Specifically, the compression processing process can also be performed in the server, the implementation complexity of the sales cabinet is low, the sales cabinet uploads the information of the time point when the weight change occurs and the first video to the server, the server performs compression processing on the first video based on the time point when the weight change occurs to obtain the second video, and calls the third party interface to perform goods identification and settle the order of the user based on the second video, namely the server sends the second video to the third party device, and the third party device performs goods identification and settles the order of the user.
In the video reporting process, the first video can be transmitted after the compression processing is locally completed by the sales counter equipment, the first video can also be synchronously uploaded to the server, the sales counter equipment simultaneously reports weight change state information (such as time point information of weight change), the server performs compression processing, and then the second video obtained through processing is sent to the third party equipment for identification and settlement, so that the data transmission quantity is reduced. On the one hand, the bandwidth pressure can be reduced, and on the other hand, the transmission time can be shortened, and the recognition and settlement time can be reduced.
In some scenarios, the complete first video needs to be uploaded to the server, so if the way of compression processing and re-reporting is performed by the sales counter device, it can be actually understood that important segments and unimportant segments are uploaded in priority for optimizing the settlement speed, that is, important segments are uploaded first and then unimportant segments are uploaded. At this time, the server can restore the complete original video after splicing the segments again.
In summary, the scheme of the embodiment of the invention includes the following two steps that 1, the sales counter equipment locally compresses videos, then preferentially reports important video clip contents, and then reports unimportant video clip contents. The server then calls the third party interface based on the important video clip content to perform video recognition, and then restores the important content and the unimportant content in the correct order. 2. The sales counter device only reports the information (such as when the weight changes) of the sensor and the complete video clip, and the server compresses the information according to the information of the sensor and sends the information to the third party device for identification.
The method of the embodiment comprises the steps of obtaining a first video of a user taking and placing goods, wherein the first video is shot by a camera; determining a time point when a weight change occurs based on the sensing data of the weight sensor; compressing the first video based on the time point to obtain a second video; uploading the second video to the server, wherein the second video is used for identifying goods taken and put by the user, and because the first video of the goods taking and put process of the user is compressed at the time point of weight change on the side of the sales counter, the transmitted data volume is less, the bandwidth pressure can be reduced, the transmission time can be shortened, the identification and settlement time can be shortened, and the calculation efficiency can be improved; or the sales counter uploads the time point when the weight change occurs and the first video to a server; the server compresses according to the information of the sensor and sends the compressed information to the third party equipment for identification, so that the data transmission quantity and the transmission time between the server and the third party equipment are reduced, the identification and settlement time can be reduced, and the calculation efficiency is improved; moreover, since the compression processing is performed based on the time point when the weight change occurs, the recognition accuracy can be ensured.
In one possible implementation, step 103 may be specifically implemented by:
and intercepting the video segments of the first video in a first preset time length before the time point and the video segments of the first video in a second preset time length after the time point to obtain the second video.
Specifically, the video segments of the first preset duration before the time point and the video segments of the second preset duration after the time point may be intercepted, alternatively, the first preset duration may be the same, for example, 1 second before and after each other.
As shown in fig. 3, for the weight change point 1 (i.e., time point 1), the weight change point 2 (i.e., time point 2), and the weight change point 3 (i.e., time point 3), video clips of a predetermined duration before and after each other are cut out, respectively.
Since the key segments are sequentially re-stitched to obtain the second video, such as the video segments corresponding to 3 time points in fig. 3, the recognition effect is better, and there is no actual difference between the recognition result and the recognition result based on the complete first video.
Optionally, in the case where the time point at which the weight change occurs is plural, after "compression processing is performed on the first video based on the time point" in step 103, the following operation may be further performed:
and merging the video clips corresponding to the time points.
In particular, it will be appreciated that it is possible that a change in weight may be perceived multiple times during the time a user opens the merchandiser, resulting in overlapping cuts of video segments. As shown in fig. 3, the video segments taken from the weight change point 1 and the weight change point 2 have overlapping portions, and are combined into a key segment.
In the above embodiment, the compression processing is performed based on the time point when the weight change occurs, and the video clips within the preset duration around the time point when the weight change occurs are retained, so that the identification accuracy can be ensured.
Optionally, according to the difference of the recognition algorithm, a part of the recognition algorithm needs to upload the images after the sales counter device is opened and closed as the information for assisting in judgment. The stitching and cropping of the final video can be performed according to the requirements of different third party interfaces. The cropping of the video clip is mainly performed with the distribution of the time points where the weight changes on the time axis.
Alternatively, in order to make the accuracy of the recognition higher, the following manner may be adopted:
the first preset time period is smaller than the second preset time period under the condition that the weight change becomes light;
and under the condition that the weight change is heavier, the first preset time period is longer than the second preset time period.
Specifically, the important segments can be determined according to whether the weight change is heavy or light;
it will be appreciated that for the case of lightening, the user has taken the merchandise, for which case the important segment is the segment after the weight change, and conversely, the weight change is the behavior of the user in putting the merchandise, for which case the important segment is the segment before the weight change. Thus, the method is applicable to a variety of applications. The interception of the time length is not uniform before and after the time point based on the type of the weight change. For example, as shown in fig. 4, for the case of light weight, video contents of 0.5s before the time point to 1s after the time point may be intercepted, and for the case of heavy weight, video contents of 1s before the time point to 0.5s after the time point may be intercepted. The video clips are inclined according to different conditions of weight change, namely, the video clips which are more useful for recognition are intercepted as much as possible. It will be appreciated that for a user to put items back on the shelves, there is more concern in the video recognition process, and therefore, for a change in weight increase, it is necessary to tilt towards the segment before the point of change. Similarly, the take-out process is more focused in video recognition for taking out the article, and therefore, for a change in weight reduction, it is necessary to tilt toward a segment after the change point.
In the above embodiment, the video clips within the preset duration around the time point where the weight change occurs are reserved, and the intercepted video clips are inclined according to different conditions of the weight change, i.e. the video clips which are more useful for recognition are intercepted as much as possible, and the recognition accuracy is higher.
In another possible implementation manner, the step 103 may be specifically implemented by:
and compressing the video frames of the first video outside the preset time range of the time point to obtain the second video.
Specifically, the video segments around the time point are important segments, so that high-quality transmission can be kept, and the video segments of other parts can be compressed, so that the data volume of transmission is reduced.
Alternatively, the compression process may be performed in several ways:
reducing the resolution of the video frames of the first video outside the preset time range of the time point to obtain the second video; or alternatively, the first and second heat exchangers may be,
and extracting frames of the video frames of the first video outside the preset time range of the time point according to preset frequency to obtain the second video.
Specifically, for the image compression processing, besides the way of cutting out the segments, the image compression processing can also be realized by reducing the image quality, and the simplest way is to reduce the resolution or frame extraction.
Reducing resolution, namely, carrying out resolution reduction processing on video frames outside a preset time range of a time point, and not processing the video frames in the preset time range of the time point;
and extracting frames, namely extracting partial video frames from the video clips outside the preset time range of the time point according to a certain frequency so as to reduce the data quantity.
In some embodiments, to further reduce the data amount, the resolution of the video frame within the preset time range at the time point may be reduced appropriately, so long as it is ensured that the goods taken and put by the user can be identified, for example, some non-important areas in the video frame are subjected to resolution reduction and other processes.
The above scheme is simply that the transmission amount is reduced by sensing which video clips are important according to the sensor and then extracting the important video clips, or compressing important video clips and non-important video clips according to different qualities.
Fig. 5 is a second flowchart of a video compression method according to the present invention. The video compression method of the present embodiment may be applied to a server, as shown in fig. 5, where the video compression method provided in the present embodiment includes:
step 501, receiving a time point of weight change sent by a sharing vending cabinet and a first video; the first video is a video of a user taking and placing goods, which is shot by a camera of the shared vending cabinet;
step 502, compressing the first video based on the time point to obtain a second video; or alternatively, the first and second heat exchangers may be,
step 503, receiving a second video sent by the shared vending cabinet, where the second video is obtained by compressing the first video by the shared vending cabinet based on a time point;
step 504, sending a second video to the third party device, where the second video is used to identify the goods fetched and placed by the user.
Optionally, the sales counter may also send specific information to the server that a weight change has occurred, such as whether it is heavy or light, etc.
The method of the embodiment of the present invention is similar to the method of any of the foregoing embodiments of the method of sharing the vending cabinet side, and its implementation principle and technical effects are similar, and are not repeated here.
The video compression apparatus provided by the present invention will be described below, and the video compression apparatus described below and the video compression method described above may be referred to correspondingly to each other.
Fig. 6 is a schematic structural diagram of a video compression device according to the present invention. The video compression device of this embodiment can be applied to the sharing and sell the cabinet, the sharing is sold the cabinet and is included weight sensor and camera, as shown in fig. 6, and the video compression device that this embodiment provided includes:
the acquiring module 110 is configured to acquire a first video of a process of taking and placing goods by a user, where the first video is shot by the camera;
a processing module 120 for determining a time point when a weight change occurs based on sensing data of the weight sensor;
the processing module 120 is further configured to perform compression processing on the first video based on the time point to obtain a second video;
a sending module 130, configured to upload the second video to the server, where the second video is used to identify the goods taken and put by the user; or alternatively, the first and second heat exchangers may be,
the sending module 130 is configured to upload the time point when the weight change occurs and the first video to a server; the time point is used for compressing the first video by the server.
Optionally, the processing module 120 is specifically configured to:
and intercepting the video segments of the first video in a first preset time length before the time point and the video segments of the first video in a second preset time length after the time point to obtain the second video.
Optionally, in the case that the weight change becomes lighter, the first preset time period is smaller than the second preset time period;
and under the condition that the weight change is heavier, the first preset time period is longer than the second preset time period.
Optionally, the processing module 120 is specifically configured to:
and compressing the video frames of the first video outside the preset time range of the time point to obtain the second video.
Optionally, the processing module 120 is specifically configured to:
reducing the resolution of the video frames of the first video outside the preset time range of the time point to obtain the second video; or alternatively, the first and second heat exchangers may be,
and extracting frames of the video frames of the first video outside the preset time range of the time point according to preset frequency to obtain the second video.
Optionally, in the case that the time point at which the weight change occurs is plural, the processing module 120 is further configured to:
and merging video fragments corresponding to a plurality of time points after the first video is intercepted based on the time points.
The device of the embodiment of the present invention is configured to execute the method of any method embodiment on the side of the shared vending cabinet, and its implementation principle and technical effects are similar, and are not repeated here.
Fig. 7 is a second schematic structural diagram of the video compression device according to the present invention. The video compression apparatus of the present embodiment may be applied to a server, as shown in fig. 7, and the video compression apparatus provided in the present embodiment includes:
a receiving module 210, configured to receive a time point at which the weight change sent by the shared vending cabinet occurs and a first video; the first video is a video of a user taking and placing goods, which is shot by a camera of the shared vending cabinet;
the processing module is used for compressing the first video based on the time point to obtain a second video; or alternatively, the first and second heat exchangers may be,
the receiving module 210 is configured to receive a second video sent by the shared vending cabinet, where the second video is obtained by compressing the first video by the shared vending cabinet based on the time point;
and the sending module 220 is configured to send the second video to a third party device, where the second video is used to identify the goods taken and put by the user.
The device of the embodiment of the present invention is configured to execute the method of any of the foregoing method embodiments on the server side, and its implementation principle and technical effects are similar, and are not repeated here.
Fig. 8 illustrates a physical structure diagram of a master device, and as shown in fig. 8, the master device may include: processor 810, communication interface (Communications Interface) 820, memory 830, and communication bus 840, wherein processor 810, communication interface 820, memory 830 accomplish communication with each other through communication bus 840. The processor 810 may invoke logic instructions in the memory 830 to perform a video compression method comprising: acquiring a first video of a user taking and placing goods, which is shot by the camera;
determining a time point when a weight change occurs based on the sensing data of the weight sensor;
compressing the first video based on the time point to obtain a second video; uploading the second video to the server, wherein the second video is used for identifying goods taken and put by the user; or alternatively, the first and second heat exchangers may be,
uploading the time point when the weight change occurs and the first video to a server; the time point is used for compressing the first video by the server.
Further, the logic instructions in the memory 830 described above may be implemented in the form of software functional units and may be stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product comprising a computer program storable on a non-transitory computer readable storage medium, the computer program, when executed by a processor, is capable of performing the video compression method provided by the methods described above, the method comprising: acquiring a first video of a user taking and placing goods, which is shot by the camera;
determining a time point when a weight change occurs based on the sensing data of the weight sensor;
compressing the first video based on the time point to obtain a second video; uploading the second video to the server, wherein the second video is used for identifying goods taken and put by the user; or alternatively, the first and second heat exchangers may be,
uploading the time point when the weight change occurs and the first video to a server; the time point is used for compressing the first video by the server.
In yet another aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, is implemented to perform the video compression method provided by the above methods, the method comprising: acquiring a first video of a user taking and placing goods, which is shot by the camera;
determining a time point when a weight change occurs based on the sensing data of the weight sensor;
compressing the first video based on the time point to obtain a second video; uploading the second video to the server, wherein the second video is used for identifying goods taken and put by the user; or alternatively, the first and second heat exchangers may be,
uploading the time point when the weight change occurs and the first video to a server; the time point is used for compressing the first video by the server.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (5)
1. A video compression method, characterized by being applied to a shared merchandiser, the shared merchandiser comprising a weight sensor and a camera, the method comprising:
acquiring a first video of a user taking and placing goods, which is shot by the camera;
determining a time point when a weight change occurs based on the sensing data of the weight sensor;
compressing the first video based on the time point to obtain a second video; uploading the second video to a server, wherein the second video is used for identifying goods taken and put by the user;
the compressing the first video based on the time point to obtain a second video includes:
intercepting video fragments of a first preset duration before the time point and video fragments of a second preset duration after the time point of the first video, and reducing the resolution of the intercepted video fragments to obtain the second video;
the first preset time period is smaller than the second preset time period under the condition that the weight change becomes light;
the first preset time period is longer than the second preset time period under the condition that the weight change is heavier;
when the time points of weight change are multiple, capturing the video segments of the first video with the first preset duration before the time points and the video segments with the second preset duration after the time points, and further including:
merging the overlapped parts in the video clips corresponding to the time points, and sequentially re-stitching the merged video clips.
2. A video compression method, applied to a server, comprising:
receiving a second video sent by a sharing vending cabinet, wherein the sharing vending cabinet comprises a weight sensor and a camera, the second video is obtained by intercepting a video fragment of a first video with a first preset duration before a time point and a video fragment of a second preset duration after the time point by the sharing vending cabinet, and reducing resolution; the first video is a video of a user taking and placing goods, which is shot by the camera; the time point is a time point at which weight change occurs, which is determined based on sensing data of the weight sensor;
the second video is sent to third-party equipment and is used for identifying goods fetched and placed by the user;
the first preset time period is smaller than the second preset time period under the condition that the weight change becomes light;
the first preset time period is longer than the second preset time period under the condition that the weight change is heavier;
and under the condition that the time points of the weight change are multiple, combining the overlapping parts in the video clips corresponding to the time points, and sequentially re-stitching the combined video clips.
3. A shared merchandiser, comprising:
the device comprises a cabinet body, a weight sensor, a camera and a main control board respectively connected with the weight sensor and the camera;
the weight sensor, the camera and the main control board are arranged in the cabinet body;
the weight sensor and the camera acquire data, and the server for communicating with the shared vending cabinet performs order settlement based on the weight sensor and the camera acquire data and payment information of a user;
and the main control board is used for executing the video compression method as claimed in claim 1.
4. A master control device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the video compression method of claim 1 or the video compression method of claim 2 when executing the program.
5. A non-transitory computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the video compression method of claim 1 or the video compression method of claim 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310976521.XA CN116708801B (en) | 2023-08-04 | 2023-08-04 | Video compression method, shared sales counter and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310976521.XA CN116708801B (en) | 2023-08-04 | 2023-08-04 | Video compression method, shared sales counter and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116708801A CN116708801A (en) | 2023-09-05 |
| CN116708801B true CN116708801B (en) | 2023-11-03 |
Family
ID=87831488
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310976521.XA Active CN116708801B (en) | 2023-08-04 | 2023-08-04 | Video compression method, shared sales counter and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116708801B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110020848A (en) * | 2018-12-14 | 2019-07-16 | 拉扎斯网络科技（上海）有限公司 | A kind of method that nobody sells, intelligent commodity shelf and storage medium |
| CN111736642A (en) * | 2020-06-23 | 2020-10-02 | 深圳创维－Rgb电子有限公司 | Control method and device of intelligent shoe cabinet and intelligent shoe cabinet |
| CN111783509A (en) * | 2019-08-29 | 2020-10-16 | 北京京东尚科信息技术有限公司 | Automatic settlement method, device, system and storage medium |
| CN111815852A (en) * | 2020-07-07 | 2020-10-23 | 武汉马克到家科技有限公司 | Image and gravity dual-mode automatic commodity identification system for open-door self-taking type sales counter |
| CN114333144A (en) * | 2021-12-22 | 2022-04-12 | 合肥美的智能科技有限公司 | Video processing method and device, readable storage medium and vending machine |
| KR102436494B1 (en) * | 2022-06-02 | 2022-08-26 | (주) 인터마인즈 | Product sales calculation method and calculation device through product recognition algorithm |
-
2023
- 2023-08-04 CN CN202310976521.XA patent/CN116708801B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110020848A (en) * | 2018-12-14 | 2019-07-16 | 拉扎斯网络科技（上海）有限公司 | A kind of method that nobody sells, intelligent commodity shelf and storage medium |
| CN111783509A (en) * | 2019-08-29 | 2020-10-16 | 北京京东尚科信息技术有限公司 | Automatic settlement method, device, system and storage medium |
| CN111736642A (en) * | 2020-06-23 | 2020-10-02 | 深圳创维－Rgb电子有限公司 | Control method and device of intelligent shoe cabinet and intelligent shoe cabinet |
| CN111815852A (en) * | 2020-07-07 | 2020-10-23 | 武汉马克到家科技有限公司 | Image and gravity dual-mode automatic commodity identification system for open-door self-taking type sales counter |
| CN114333144A (en) * | 2021-12-22 | 2022-04-12 | 合肥美的智能科技有限公司 | Video processing method and device, readable storage medium and vending machine |
| KR102436494B1 (en) * | 2022-06-02 | 2022-08-26 | (주) 인터마인즈 | Product sales calculation method and calculation device through product recognition algorithm |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116708801A (en) | 2023-09-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Fernandes et al. | Predicting heart rate variations of deepfake videos using neural ode | |
| JP7181437B2 (en) | A technique for identifying skin tones in images under uncontrolled lighting conditions | |
| CN108416902B (en) | Real-time object identification method and device based on difference identification | |
| WO2020047919A1 (en) | Self-service vending method, apparatus and system, and server and computer-readable storage medium | |
| CN104574331B (en) | A kind of data processing method, device, computer storage medium and user terminal | |
| KR102321397B1 (en) | Systems and Processes for Detecting Video Spoofing Based on Vibrance Assessment | |
| EP4027311A1 (en) | Vision- and gravity sensing-based product identification method, device, and system | |
| CN110321792A (en) | Without card enchashment method, apparatus, equipment and computer readable storage medium | |
| CN111768553A (en) | Vending method of automatic vending cabinet and automatic vending cabinet | |
| CN109741192A (en) | Date storage method, device, equipment and readable storage medium storing program for executing based on block chain | |
| CN114418922A (en) | Tea cake anti-counterfeiting method, tea cake anti-counterfeiting system and cloud server | |
| CN114092108A (en) | Method for identifying authenticity of Pu' er tea | |
| CN115631011A (en) | Product pushing method and system based on Internet | |
| CN116708801B (en) | Video compression method, shared sales counter and storage medium | |
| CN112016985A (en) | User identity identification method and device, electronic equipment and storage medium | |
| CN116684626B (en) | Video compression method and sharing vending cabinet | |
| CN111369557A (en) | Image processing method, image processing device, computing equipment and storage medium | |
| CN111988666B (en) | Video detection method, 3D convolution and mapping method, equipment and storage medium | |
| CN116721496B (en) | Data transmission method, shared sales counter and storage medium | |
| CN110728522A (en) | Face brushing public traffic system | |
| CN111583101B (en) | Image anti-theft system and method based on deep learning | |
| CN116939171B (en) | Power transmission line monitoring method, device and computer equipment | |
| CN111569413B (en) | Data synchronization method and device | |
| CN117557354A (en) | Abnormal transaction behavior identification method, device, electronic equipment and storage medium | |
| CN117437682A (en) | Method and device for preprocessing face image, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |