CN110445966B - Panoramic camera video shooting method and device, electronic equipment and storage medium - Google Patents
Panoramic camera video shooting method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110445966B CN110445966B CN201910736529.2A CN201910736529A CN110445966B CN 110445966 B CN110445966 B CN 110445966B CN 201910736529 A CN201910736529 A CN 201910736529A CN 110445966 B CN110445966 B CN 110445966B
- Authority
- CN
- China
- Prior art keywords
- lens
- shots
- time period
- preset time
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/957—Light-field or plenoptic cameras or camera modules
Abstract
The application discloses a video shooting method of a panoramic camera, wherein the panoramic camera comprises a plurality of lenses, and the method comprises the following steps: receiving images shot by the plurality of lenses within a preset time period; calibrating one or more scene shots and one or more character shots in the plurality of shots based on images shot by the plurality of shots within a preset time period; the one or more character shots are sorted based on images shot by each of the one or more character shots within a preset time period; sequentially opening the one or more character shots based on the sorting, and determining the position of the target tourist; and controlling the one or more character shots to shoot the target tourist based on the position of the target tourist.
Description
Technical Field
The present application relates to the field of panoramic cameras, and in particular, to a method and an apparatus for capturing a video using a panoramic camera, an electronic device, and a storage medium.
Background
The panoramic camera is a special shooting technology which is popular in recent years and is widely applied, and can generate 360/720 three-dimensional space scene images through a shooting technology realized by splicing a plurality of lenses, a sensor system and images. With the continuous development of the panoramic camera technology, due to the characteristics of simple operation, shocking effect, capability of generating 720-degree three-dimensional space scene images by one-key shooting and the like, the application scenes of the panoramic camera are more and more extensive, such as the fields of tourism and security protection. Taking the tourism industry as an example, aiming at the existing scenic spots, deploying panoramic cameras in the scenic spots is a good entertainment solution. 360/720 panoramic photo that panoramic camera shot will improve visitor's intention nature and interest greatly, simplify the scenic spot flow of shooing, improve visitor's experience. Some panoramic cameras have been deployed and operated in scenic spots at present, for example, a king brand 720 ° panoramic shooting panoramic camera of beijing runbo company has been deployed in a three-scenic spot for commissioning.
However, the arrangement of the panoramic camera in the scenic spot also has a lot of problems, one outstanding problem is the power supply problem of the panoramic camera, as the coverage of the scenic spot is wide (especially in mountainous areas and forest zones), most of the arrangement positions can not be provided with power lines, and the power supply of the scenic spot can not be fully covered, the panoramic camera arranged at present can supply power to the panoramic camera by depending on the battery module of the camera, maintenance personnel monitor the electric quantity of the panoramic camera through a background monitoring system, and when the electric quantity of the panoramic camera is lower than a certain threshold value, the battery module is manually replaced on site, the electric quantity of the panoramic camera is used faster, the times for replacing the battery module are more frequent, and the maintenance cost is higher. Therefore, how to optimize the use of the electric quantity of the panoramic camera has important practical significance, and the maintenance cost is greatly reduced by optimizing the use of the electric quantity of the panoramic camera.
Disclosure of Invention
Aiming at the problem of data inclination in the prior art, the embodiment of the application provides a panoramic camera shooting method and device, electronic equipment and a computer readable storage medium, so as to solve the problem that the battery of the panoramic camera consumes too fast.
A first aspect of an embodiment of the present application provides a video shooting method for a panoramic camera, where the panoramic camera includes a plurality of lenses, and includes: receiving images shot by the plurality of lenses within a preset time period; calibrating one or more scene shots and one or more character shots in the plurality of shots based on images shot by the plurality of shots within a preset time period; the one or more character shots are sorted based on images shot by each of the one or more character shots within a preset time period; sequentially opening the one or more character shots based on the sorting, and determining the position of the target tourist; and controlling the one or more character shots to shoot the target tourist based on the position of the target tourist.
In some embodiments, the calibrating one or more scene shots and one or more person shots of the plurality of shots based on the images taken by the plurality of shots within the preset time period comprises: determining a portrait shooting proportion of each lens in the plurality of lenses, wherein the portrait shooting proportion is the proportion of images including people in a plurality of images shot by the lens in a preset time period to all images shot by the lens in the preset time period; when the ratio is larger than a preset threshold value, the lens is calibrated as a human lens; and when the proportion is not greater than a preset threshold value, calibrating the lens as a scene lens.
In some embodiments, the determining a ratio of images including a person in the images captured by the lens in the preset time period to all the images captured by the lens in the preset time period includes: inputting a plurality of images shot in a preset time period of the lens into a neural network model, and determining images containing human faces in the plurality of images; and determining the proportion of the image containing the face to all images shot by the lens in a preset time period.
In some embodiments, the sorting the one or more person shots based on images taken by each of the one or more person shots within a preset time period includes: and sorting the one or more character shots in descending order based on one or more image shooting proportions corresponding to the one or more character shots.
In some embodiments, the controlling the one or more character shots to shoot the target guest based on the location of the target guest includes: processing a video frame of the target tourist, which is acquired by a figure shot corresponding to the position of the target tourist, determining the position of the target tourist in the current video frame, and determining a motion vector of the target tourist based on the current video frame and a previous video frame; when the position of the target visitor in the current video frame is close to a preset edge and the motion vector of the target visitor points to the outside of the preset edge, determining the estimated position of the target visitor; and opening the figure lens corresponding to the estimated position.
In some embodiments, the method further comprises: closing the figure lens corresponding to the original position when the figure lens corresponding to the estimated position is opened; or after the character lens corresponding to the estimated position is opened, closing the character lens corresponding to the original position after a certain time interval.
A second aspect of an embodiment of the present application provides a panoramic camera video capture device, the panoramic camera including a plurality of lenses, the device including: the receiving unit is used for receiving images shot by the plurality of lenses within a preset time period; the calibration unit is used for calibrating one or more scenery shots and one or more character shots in the multiple shots based on images shot by the multiple shots within a preset time period; the sorting unit is used for sorting the one or more character shots based on images shot by each character shot in the one or more character shots within a preset time period; the position determining unit is used for sequentially opening the one or more character shots based on the sorting and determining the position of the target tourist; and the control unit is used for controlling the figure lens corresponding to the position of the target tourist to shoot the target tourist.
In some embodiments, the calibration unit is specifically configured to: for each lens in the plurality of lenses, determining the proportion of images containing people in a plurality of images shot by the lens in a preset time period to all images shot by the lens in the preset time period; when the ratio is larger than a preset threshold value, the lens is calibrated as a human lens; and when the proportion is not greater than a preset threshold value, calibrating the lens as a scene lens.
In some embodiments, the determining a ratio of images including a person in the images captured by the lens in the preset time period to all the images captured by the lens in the preset time period includes: inputting a plurality of images shot in a preset time period of the lens into a neural network model, and determining images containing human faces in the plurality of images; and determining the proportion of the image containing the face to all images shot by the lens in a preset time period.
In some embodiments, the sorting unit is specifically configured to: and sorting the one or more character shots in descending order based on one or more image shooting proportions corresponding to the one or more character shots.
In some embodiments, the control unit is specifically configured to: processing a video frame of the target tourist, which is acquired by a figure shot corresponding to the position of the target tourist, and determining the position of the target tourist in the current video frame, and the motion vector of the target tourist between the current video frame and the previous video frame; when the position of the target visitor in the current video frame is a preset edge and the motion vector of the target visitor points to the outside of the preset edge, determining the estimated position of the target visitor; and opening the figure lens corresponding to the estimated position.
In some embodiments, the control unit is further configured to: closing the figure lens corresponding to the original position when the figure lens corresponding to the estimated position is opened; or after the character lens corresponding to the estimated position is opened, closing the character lens corresponding to the original position after a preset time interval.
A third aspect of an embodiment of the present application provides an electronic device, including:
a memory and one or more processors;
wherein the memory is communicatively connected to the one or more processors, and the memory stores instructions executable by the one or more processors, and when the instructions are executed by the one or more processors, the electronic device is configured to implement the panoramic camera shooting method according to the foregoing embodiments.
A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, having stored thereon computer-executable instructions, which, when executed by a computing apparatus, may be used to implement the panoramic camera video shooting method according to the foregoing embodiments.
A fifth aspect of embodiments of the present application provides a computer program product comprising a computer program stored on a computer-readable storage medium, the computer program comprising program instructions which, when executed by a computer, are operable to implement a panoramic camera video capture method as described in the preceding embodiments.
According to the embodiment of the application, the video shooting method and device, the electronic equipment and the storage medium of the panoramic camera capable of saving electric quantity can be realized by calibrating the lens of the panoramic camera and controlling the calibrated lens.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the description of the embodiments will be briefly introduced below. It is obvious that the drawings in the following description are only some embodiments of the application, and that it is also possible for a person skilled in the art to apply the application to other similar scenarios without inventive effort on the basis of these drawings. Unless otherwise apparent from the context of language or otherwise indicated, like reference numerals in the figures refer to like structures and operations.
FIG. 1 is a schematic diagram of a panoramic camera in the prior art;
FIG. 2 is a schematic diagram of a panoramic camera video capture method according to some embodiments of the present application;
FIG. 3 is a representation according to some embodiments of the present application
FIG. 4 is a schematic diagram of a panoramic camera video capture device according to some embodiments of the present application; and
FIG. 5 is a schematic diagram of an electronic device shown in accordance with some embodiments of the present application.
Detailed Description
In the following detailed description, numerous specific details of the present application are set forth by way of examples in order to provide a thorough understanding of the relevant disclosure. It will be apparent, however, to one skilled in the art that the present application may be practiced without these specific details. It should be understood that the use of the terms "system," "apparatus," "unit" and/or "module" herein is a method for distinguishing between different components, elements, portions or assemblies at different levels of sequential arrangement. However, these terms may be replaced by other expressions if they can achieve the same purpose.
It will be understood that when a device, unit or module is referred to as being "on" … … "," connected to "or" coupled to "another device, unit or module, it can be directly on, connected or coupled to or in communication with the other device, unit or module, or intervening devices, units or modules may be present, unless the context clearly dictates otherwise. For example, as used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the present application. As used in the specification and claims of this application, the terms "a", "an", and/or "the" are not intended to be inclusive in the singular, but rather are intended to be inclusive in the plural, unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" are intended to cover only the explicitly identified features, integers, steps, operations, elements, and/or components, but not to constitute an exclusive list of such features, integers, steps, operations, elements, and/or components.
These and other features and characteristics of the present application, as well as the methods of operation and functions of the related elements of structure and the combination of parts and economies of manufacture, will be better understood upon consideration of the following description and the accompanying drawings, which form a part of this specification. It is to be expressly understood, however, that the drawings are for the purpose of illustration and description only and are not intended as a definition of the limits of the application. It will be understood that the figures are not drawn to scale.
Various block diagrams are used in this application to illustrate various variations of embodiments according to the application. It should be understood that the foregoing and following structures are not intended to limit the present application. The protection scope of this application is subject to the claims.
Fig. 1 is a schematic structural diagram of a panoramic camera in the prior art. Specifically, fig. 1 is a schematic structural diagram of a conventional 360 ° panoramic camera. As shown in fig. 1, the panoramic camera includes 4 photographing lenses, wherein a lens 1 faces the direction in which the tourist stands to photograph images in the direction of the tourist; the lens 2, the lens 3 and the lens 4 are used for shooting scenes, so that the panoramic camera can shoot the scenes within the range of 360 degrees, the shooting principle of the 720-degree panoramic camera is similar to that of the 360-degree panoramic camera, and only 2 lenses are additionally arranged up and down.
Fig. 2 is a schematic diagram of a panoramic camera video capture method according to some embodiments of the present application.
At 202, images captured by the plurality of lenses within a preset time period are received. In some embodiments, the preset time period may be any time period. For example, ten minutes, three hours, a day, a week, a month, a year, or any period of time. In some embodiments, the number of the plurality of lenses is arbitrary. For example, one lens may be disposed in each of four directions as shown in fig. 1. For another example, any number of lenses may be arranged on one horizontal circumference.
In 204, one or more scene shots and one or more character shots of the plurality of shots are calibrated based on images taken by the plurality of shots within a preset time period.
Specifically, for each of the plurality of shots, a ratio of an image including a person in a plurality of images shot by the shot in a preset time period to all images shot by the shot in the preset time period is determined. And when the proportion is larger than a preset threshold corresponding to the lens, calibrating the lens as a human lens. And when the proportion is not greater than the preset threshold corresponding to the lens, calibrating the lens as a scene lens.
In some embodiments, the preset thresholds corresponding to the plurality of lenses in the panoramic camera are the same, but the preset thresholds may be artificially adjustable. For example, different preset thresholds are set for panoramic cameras in different positions. This is because, for panoramic cameras in different positions, the preferences of the guests to take pictures are different, some panoramic camera guests are frequently used and some panoramic camera guests are not frequently used.
In some embodiments, the plurality of lenses in the panoramic camera are correspondingly set with different preset thresholds. This is because, for the same panoramic camera, some shots are front face taking shots preferred by the guest, and some guest shots are not frequently used for taking the front face but do not frequently appear, which cannot indicate that the shot is not a person shot, so a lower preset threshold needs to be set for the shot.
In some embodiments, the determining a ratio of images including a person in the images captured by the lens in the preset time period to all the images captured by the lens in the preset time period includes: inputting a plurality of images shot in a preset time period of the lens into a neural network model, and determining images containing human faces in the plurality of images; and determining the proportion of the image containing the face to all images shot by the lens in a preset time period.
In some embodiments, the recognition method may also be any face recognition algorithm. For example, a recognition algorithm based on human face feature points, a recognition algorithm based on the whole human face image, or the like, or an image including a human face is recognized using a neural network model, or the like.
At 206, the one or more character shots are ranked based on images taken by each of the one or more character shots within a preset time period.
In some embodiments, the sorting the one or more person shots based on images taken by each of the one or more person shots within a preset time period includes: and sorting the one or more character shots in descending order based on one or more image shooting proportions corresponding to the one or more character shots.
At 208, the one or more character shots are opened in sequence based on the ranking, and the location of the target guest is determined. For example, after a first person shot is opened, an image is captured, and when a target person is not detected in the image captured by the first person shot, a second person shot is opened. Furthermore, after the second character lens is opened, the first character lens is closed, so that the electric quantity is saved. In some embodiments, the target person may be located without taking all of the shots of the persons. For example, when the second person takes an image of a target person, the subsequent person takes no longer need to be opened.
At 210, the one or more character shots are controlled to shoot the target visitor based on the position of the target visitor.
In some embodiments, the controlling the one or more character shots to shoot the target guest based on the location of the target guest includes: processing a video frame of the target tourist, which is acquired by a figure shot corresponding to the position of the target tourist, determining the position of the target tourist in the current video frame, and determining a motion vector of the target tourist based on the current video frame and a previous video frame; when the position of the target visitor in the current video frame is close to a preset edge and the motion vector of the target visitor points to the outside of the preset edge, determining the estimated position of the target visitor; and opening the figure lens corresponding to the estimated position.
Further, when the character lens corresponding to the estimated position is opened, the character lens corresponding to the original position may be closed. Or after the character lens corresponding to the estimated position is opened, closing the character lens corresponding to the original position after a preset time interval.
For example, the panoramic camera shown in fig. 3 has four lenses, and assuming that all four lenses are the lenses of the person, the preset edge may be the middle line between the lens No. 1 and the lens No. 2 during the process of moving the target person from the lens No. 1 to the lens No. 2, as shown in fig. 3. It should be noted that fig. 3 is only an example, and in other arrangements of panoramic cameras, the preset edge may be changed accordingly, or the preset range may be set arbitrarily.
FIG. 4 is a schematic diagram of a panoramic camera video capture device according to some embodiments of the present application. As shown in fig. 4, the panoramic camera video photographing apparatus 400 includes a receiving unit 410, a calibration unit 420, a sorting unit 430, a position determination unit 440, and a control unit 450.
The receiving unit 410 is configured to receive images captured by the plurality of lenses within a preset time period. The calibration unit 420 is configured to calibrate one or more scene shots and one or more character shots of the plurality of shots based on images captured by the plurality of shots within a preset time period. The sorting unit 430 is configured to sort the one or more character shots based on images captured by each of the one or more character shots within a preset time period. The position determining unit 440 is configured to sequentially open the one or more character shots based on the ranking, and determine a position of the target visitor. The control unit 450 is configured to control the figure shot corresponding to the position of the target visitor, and shoot the target visitor.
In some embodiments, the calibration unit is specifically configured to: for each lens in the plurality of lenses, determining the proportion of images containing people in a plurality of images shot by the lens in a preset time period to all images shot by the lens in the preset time period; when the proportion is larger than a preset threshold corresponding to the lens, the lens is calibrated as a human lens; and when the proportion is not greater than the preset threshold corresponding to the lens, calibrating the lens as a scene lens.
In some embodiments, the determining a ratio of images including a person in the images captured by the lens in the preset time period to all the images captured by the lens in the preset time period includes: inputting a plurality of images shot in a preset time period of the lens into a neural network model, and determining images containing human faces in the plurality of images; and determining the proportion of the image containing the face to all images shot by the lens in a preset time period.
In some embodiments, the sorting unit is specifically configured to: and sorting the one or more character shots in descending order based on one or more image shooting proportions corresponding to the one or more character shots.
In some embodiments, the control unit is specifically configured to: processing a video frame of the target tourist, which is acquired by a figure shot corresponding to the position of the target tourist, and determining the position of the target tourist in the current video frame, and the motion vector of the target tourist between the current video frame and the previous video frame; when the position of the target visitor in the current video frame is a preset edge and the motion vector of the target visitor points to the outside of the preset edge, determining the estimated position of the target visitor; and opening the figure lens corresponding to the estimated position.
In some embodiments, the control unit is further configured to: closing the figure lens corresponding to the original position when the figure lens corresponding to the estimated position is opened; or after the character lens corresponding to the estimated position is opened, closing the character lens corresponding to the original position after a preset time interval.
It is worth mentioning that the panoramic camera video camera is used to perform the method as shown in fig. 2. For details, see fig. 2 and the description thereof, which are not described herein.
Fig. 5 is a schematic structural diagram suitable for implementing an electronic device according to an embodiment of the present application.
As shown in fig. 5, the electronic apparatus 500 includes a Central Processing Unit (CPU)501 that can execute various processes in the embodiment shown in fig. 2 described above according to a program stored in a Read Only Memory (ROM)502 or a program loaded from a storage section 508 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The CPU501, ROM502, and RAM503 are connected to each other via a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
The following components are connected to the I/O interface 505: an input portion 506 including a keyboard, a mouse, and the like; an output portion 507 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 508 including a hard disk and the like; and a communication section 509 including a network interface card such as a LAN card, a modem, or the like. The communication section 509 performs communication processing via a network such as the internet. The driver 510 is also connected to the I/O interface 505 as necessary. A removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 510 as necessary, so that a computer program read out therefrom is mounted into the storage section 508 as necessary.
In particular, according to embodiments of the present application, the method described above with reference to fig. 2 may be implemented as a computer software program. For example, embodiments of the present application include a computer program product comprising a computer program tangibly embodied on a medium readable thereby, the computer program comprising program code for performing the method of FIG. 2. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 509, and/or installed from the removable medium 511.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowcharts or block diagrams may represent a module, a program segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units or modules described in the embodiments of the present application may be implemented by software or hardware. The units or modules described may also be provided in a processor, and the names of the units or modules do not in some cases constitute a limitation of the units or modules themselves.
As another aspect, the present application also provides a computer-readable storage medium, which may be the computer-readable storage medium included in the apparatus in the above-described embodiment; or it may be a separate computer readable storage medium not incorporated into the device. The computer readable storage medium stores one or more programs for use by one or more processors in performing the methods described herein.
In summary, the present application provides a panoramic camera shooting method, a panoramic camera shooting device, an electronic device, and a computer-readable storage medium thereof. According to the embodiment of the application, the multiple character lenses are controlled based on the current position of the target tourist, and the lenses are closed after the user leaves the range of the current character lenses, so that the energy conservation of the panoramic camera is realized to the maximum extent.
It is to be understood that the above-described embodiments of the present application are merely illustrative of or illustrative of the principles of the present application and are not to be construed as limiting the present application. Therefore, any modification, equivalent replacement, improvement and the like made without departing from the spirit and scope of the present application shall be included in the protection scope of the present application. Further, it is intended that the appended claims cover all such changes and modifications that fall within the scope and range of equivalents of the appended claims, or the equivalents of such scope and range.
Claims (12)
1. A method of video capture by a panoramic camera, the panoramic camera including a plurality of lenses, comprising:
receiving images shot by the plurality of lenses within a preset time period;
calibrating one or more scene shots and one or more character shots in the plurality of shots based on images shot by the plurality of shots within a preset time period;
the one or more person shots are sorted in descending order based on one or more person image shooting proportions of each person shot in the one or more person shots within a preset time period; the portrait shooting proportion is the proportion of images containing figures in a plurality of images shot by the lens in a preset time period to all images shot by the lens in the preset time period;
sequentially opening the one or more character shots based on the sorting, and determining the position of the target tourist; when the image shot by a certain person shot detects a target tourist, the subsequent person shots do not need to be opened continuously;
and controlling the one or more character shots to shoot the target tourist based on the position of the target tourist.
2. The method of claim 1, wherein said scaling one or more scene shots, and one or more character shots, of the plurality of shots based on images taken by the plurality of shots within a preset time period comprises:
determining a portrait photographing ratio of each of the plurality of shots;
when the ratio is larger than a preset threshold value, the lens is calibrated as a human lens;
and when the proportion is not greater than a preset threshold value, calibrating the lens as a scene lens.
3. The method of claim 2, wherein determining the portrait session scale for the shot comprises:
inputting a plurality of images shot in a preset time period of the lens into a neural network model, and determining images containing human faces in the plurality of images;
and determining the proportion of the image containing the face to all images shot by the lens in a preset time period.
4. The method of claim 1, wherein controlling the one or more character shots to capture the target guest based on the location of the target guest comprises:
processing a video frame of the target tourist, which is acquired by a figure shot corresponding to the position of the target tourist, determining the position of the target tourist in the current video frame, and determining a motion vector of the target tourist based on the current video frame and a previous video frame;
when the position of the target visitor in the current video frame is close to a preset edge and the motion vector of the target visitor points to the outside of the preset edge, determining the estimated position of the target visitor;
and opening the figure lens corresponding to the estimated position.
5. The method of claim 4, further comprising:
closing the figure lens corresponding to the original position when the figure lens corresponding to the estimated position is opened;
or after the character lens corresponding to the estimated position is opened, closing the character lens corresponding to the original position after a certain time interval.
6. A panoramic camera video capture apparatus, the panoramic camera including a plurality of lenses, the apparatus comprising:
the receiving unit is used for receiving images shot by the plurality of lenses within a preset time period;
the calibration unit is used for calibrating one or more scenery shots and one or more character shots in the multiple shots based on images shot by the multiple shots within a preset time period;
the sorting unit is used for sorting the one or more character shots according to a descending order based on one or more human image shooting proportions of each of the one or more character shots shot in a preset time period; the portrait shooting proportion is the proportion of images containing figures in a plurality of images shot by the lens in a preset time period to all images shot by the lens in the preset time period;
the position determining unit is used for sequentially opening the one or more character shots based on the sorting and determining the position of the target tourist; when the image shot by a certain person shot detects a target tourist, the subsequent person shots do not need to be opened continuously;
and the control unit is used for controlling the one or more character shots to shoot the target tourist based on the position of the target tourist.
7. The apparatus according to claim 6, wherein the calibration unit is specifically configured to:
for each lens in the plurality of lenses, determining the proportion of images containing people in a plurality of images shot by the lens in a preset time period to all images shot by the lens in the preset time period;
when the ratio is larger than a preset threshold value, the lens is calibrated as a human lens;
and when the proportion is not greater than a preset threshold value, calibrating the lens as a scene lens.
8. The apparatus of claim 7, wherein the determining a ratio of an image of a person included in the plurality of images captured by the lens in the preset time period to all the images captured by the lens in the preset time period comprises:
inputting a plurality of images shot in a preset time period of the lens into a neural network model, and determining images containing human faces in the plurality of images;
and determining the proportion of the image containing the face to all images shot by the lens in a preset time period.
9. The apparatus of claim 6, wherein the control unit is specifically configured to:
processing a video frame of the target tourist, which is acquired by a figure shot corresponding to the position of the target tourist, and determining the position of the target tourist in the current video frame, and the motion vector of the target tourist between the current video frame and the previous video frame;
when the position of the target visitor in the current video frame is a preset edge and the motion vector of the target visitor points to the outside of the preset edge, determining the estimated position of the target visitor;
and opening the figure lens corresponding to the estimated position.
10. The apparatus of claim 9, wherein the control unit is further to:
closing the figure lens corresponding to the original position when the figure lens corresponding to the estimated position is opened;
or after the character lens corresponding to the estimated position is opened, closing the character lens corresponding to the original position after a preset time interval.
11. An electronic device, comprising:
a memory and one or more processors;
wherein the memory is communicatively coupled to the one or more processors and has stored therein instructions executable by the one or more processors, the electronic device being configured to implement the panoramic camera video capture method of any of claims 1-5 when the instructions are executed by the one or more processors.
12. A computer-readable storage medium having stored thereon computer-executable instructions operable to implement the panoramic camera video capture method of any of claims 1-5 when executed by a computing device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910736529.2A CN110445966B (en) | 2019-08-09 | 2019-08-09 | Panoramic camera video shooting method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910736529.2A CN110445966B (en) | 2019-08-09 | 2019-08-09 | Panoramic camera video shooting method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110445966A CN110445966A (en) | 2019-11-12 |
| CN110445966B true CN110445966B (en) | 2021-09-21 |
Family
ID=68434455
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910736529.2A Active CN110445966B (en) | 2019-08-09 | 2019-08-09 | Panoramic camera video shooting method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110445966B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115103106A (en) * | 2019-12-18 | 2022-09-23 | 荣耀终端有限公司 | Control method, electronic equipment, computer readable storage medium and chip |
| CN112261218B (en) * | 2020-10-21 | 2022-09-20 | 维沃移动通信有限公司 | Video control method, video control device, electronic device and readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716594A (en) * | 2014-01-08 | 2014-04-09 | 深圳英飞拓科技股份有限公司 | Panorama splicing linkage method and device based on moving target detecting |
| CN104333745A (en) * | 2014-11-27 | 2015-02-04 | 无锡北斗星通信息科技有限公司 | Overwater and underwater image monitoring system of bathing beach |
| CN104853097A (en) * | 2015-04-30 | 2015-08-19 | 广东欧珀移动通信有限公司 | Panoramic mode shooting method and shooting device |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9363487B2 (en) * | 2005-09-08 | 2016-06-07 | Avigilon Fortress Corporation | Scanning camera-based video surveillance system |
| CN102254169B (en) * | 2011-08-23 | 2012-08-22 | 东北大学秦皇岛分校 | Multi-camera-based face recognition method and multi-camera-based face recognition system |
| CN102436662B (en) * | 2011-11-29 | 2013-07-03 | 南京信息工程大学 | Human body target tracking method in nonoverlapping vision field multi-camera network |
| EP2713238B1 (en) * | 2012-10-01 | 2014-11-26 | Axis AB | Power management in a monitoring camera. |
| CN103905713B (en) * | 2012-12-26 | 2018-02-27 | 联想(北京)有限公司 | Control method, control device and electronic equipment |
| CN103559781A (en) * | 2013-10-25 | 2014-02-05 | 同济大学 | Distributive real-time energy consumption monitoring and analyzing system based on camera |
| CN107547858B (en) * | 2016-09-20 | 2020-05-08 | 郑州蓝视科技有限公司 | Method for preventing cell burglary by using camera |
| CN108933899B (en) * | 2018-08-22 | 2020-10-16 | Oppo广东移动通信有限公司 | Panorama shooting method, device, terminal and computer readable storage medium |
-
2019
- 2019-08-09 CN CN201910736529.2A patent/CN110445966B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716594A (en) * | 2014-01-08 | 2014-04-09 | 深圳英飞拓科技股份有限公司 | Panorama splicing linkage method and device based on moving target detecting |
| CN104333745A (en) * | 2014-11-27 | 2015-02-04 | 无锡北斗星通信息科技有限公司 | Overwater and underwater image monitoring system of bathing beach |
| CN104853097A (en) * | 2015-04-30 | 2015-08-19 | 广东欧珀移动通信有限公司 | Panoramic mode shooting method and shooting device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110445966A (en) | 2019-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109819208B (en) | Intensive population security monitoring management method based on artificial intelligence dynamic monitoring | |
| CN104123544B (en) | Anomaly detection method and system based on video analysis | |
| Shimada et al. | Dynamic control of adaptive mixture-of-Gaussians background model | |
| WO2021047306A1 (en) | Abnormal behavior determination method and apparatus, terminal, and readable storage medium | |
| EP3598736A1 (en) | Method and apparatus for processing image | |
| CN111160202B (en) | Identity verification method, device, equipment and storage medium based on AR equipment | |
| US10255683B1 (en) | Discontinuity detection in video data | |
| CN110659391A (en) | Video detection method and device | |
| CN110445966B (en) | Panoramic camera video shooting method and device, electronic equipment and storage medium | |
| CN102542552B (en) | Frontlighting and backlighting judgment method of video images and detection method of shooting time | |
| TWI769787B (en) | Target tracking method and apparatus, storage medium | |
| US10909388B2 (en) | Population density determination from multi-camera sourced imagery | |
| CN111325051A (en) | Face recognition method and device based on face image ROI selection | |
| CN112287827A (en) | Complex environment pedestrian mask wearing detection method and system based on intelligent lamp pole | |
| CN107483894A (en) | Judge to realize the high ferro station video monitoring system of passenger transportation management based on scene | |
| CN104820995A (en) | Large public place-oriented people stream density monitoring and early warning method | |
| CN111240612A (en) | Method and terminal for adjusting screen resolution | |
| CN105763814B (en) | The method and device of night scene shooting | |
| CN110991297A (en) | Target positioning method and system based on scene monitoring | |
| CN110536066B (en) | Panoramic camera shooting method and device, electronic equipment and storage medium | |
| CN116894789A (en) | Method, device, equipment and medium for enhancing image under mine based on LED control | |
| Loke et al. | Testing dataset for head segmentation accuracy for the algorithms in the ‘BGSLibrary’v3. 0.0 developed by Andrews Sobral | |
| Moumene et al. | Generalized exposure fusion weights estimation | |
| JP2019153986A (en) | Monitoring system, management apparatus, monitoring method, computer program, and storage medium | |
| Tung et al. | Why accuracy is not enough: The need for consistency in object detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201223 Address after: 100020 17th floor, building 1, century wealth center, No.5 Guanghua Road, Chaoyang District, Beijing Applicant after: Runbo panoramic culture and Tourism Technology Co.,Ltd. Address before: 100055 108-4, building 1, 168 Guang'anmen street, Xicheng District, Beijing Applicant before: Beijing Runbo Internet Digital Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |