CN114500981B - Venue target tracking method, device, equipment and medium - Google Patents

Venue target tracking method, device, equipment and medium Download PDF

Info

Publication number
CN114500981B
CN114500981B CN202210130891.7A CN202210130891A CN114500981B CN 114500981 B CN114500981 B CN 114500981B CN 202210130891 A CN202210130891 A CN 202210130891A CN 114500981 B CN114500981 B CN 114500981B
Authority
CN
China
Prior art keywords
wide
selected target
angle
image
focusing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210130891.7A
Other languages
Chinese (zh)
Other versions
CN114500981A (en
Inventor
宋学武
夏勇峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Beehive Century Technology Co ltd
Original Assignee
Beijing Beehive Century Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Beehive Century Technology Co ltd filed Critical Beijing Beehive Century Technology Co ltd
Priority to CN202210130891.7A priority Critical patent/CN114500981B/en
Publication of CN114500981A publication Critical patent/CN114500981A/en
Application granted granted Critical
Publication of CN114500981B publication Critical patent/CN114500981B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/634Warning indications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

The application relates to a venue target tracking method, a venue target tracking device, venue target tracking equipment and a venue target tracking medium, which are applied to the technical field of intelligent equipment, wherein the venue target tracking method comprises the following steps: responding to a target selection action of a user, and acquiring first related characteristic information of a selected target; collecting a wide-angle image by using a wide-angle camera; judging whether the wide-angle image contains the selected target or not according to the first related characteristic information of the selected target; if yes, focusing the wide-angle image by using a long-focus camera according to the first related characteristic information of the selected target, and collecting a focusing image containing the selected target; if not, generating prompt information, wherein the prompt information is used for prompting a user to change the shooting angle of the wide-angle camera. The application has the effect of improving the viewing experience of the user.

Description

Venue target tracking method, device, equipment and medium
Technical Field
The application relates to the technical field of intelligent equipment, in particular to a venue target tracking method, a venue target tracking device, venue target tracking equipment and venue target tracking media.
Background
Football attracts thousands of fans as the first sports in the world, so that a great number of fans go to the scene for watching every football match, and shouting and help the self-supporting team.
In the process of playing a football game, because the playing field is large, the players at a far distance in the field can only see the situation on the playing field by watching the large screen on the field, the view angle of the large screen display picture is limited, the watching requirement of the players cannot be met, and meanwhile, when a camera tracks football, the football is separated from the picture due to the high-speed motion of the football, so that the watching experience of the players is influenced.
Disclosure of Invention
In order to improve the viewing experience of users, the application provides a venue target tracking method, a venue target tracking device, venue target tracking equipment and a venue target tracking medium.
In a first aspect, the present application provides a venue target tracking method, which adopts the following technical scheme:
a head-mounted display device based tracking method, comprising:
responding to a target selection action of a user, and acquiring first related characteristic information of a selected target;
collecting a wide-angle image by using a wide-angle camera;
judging whether the wide-angle image contains the selected target or not according to the first related characteristic information of the selected target;
if yes, focusing the wide-angle image by using a long-focus camera according to the first related characteristic information of the selected target, and collecting a focusing image containing the selected target;
if not, generating prompt information, wherein the prompt information is used for prompting a user to change the shooting angle of the wide-angle camera.
Through adopting above-mentioned technical scheme, after the user selected the target, utilize the wide-angle camera to gather the image in the stadium, obtain the wide-angle image, when selecting the well target and breaking away from the wide-angle image, generate prompt message, prompt user changes the shooting angle of wide-angle camera, makes the wide-angle image contain the target of selecting all the time to make the user pay attention to the target of selecting when watching the video, and then improved user's viewing experience.
Optionally, if the selected target is a human body, the first related feature information includes at least one of facial image features, wearing image features, and skeletal points;
and if the selected target is a sphere, the first related characteristic information comprises a sphere volume and a pattern.
By adopting the technical scheme, when the selected target is determined to be a human body, a player meeting the characteristics can be searched on the competition field according to the number of the player, the color of the ball coat and the skeleton point of the player through the camera, and then tracking is carried out, so that the user can more conveniently enjoy the operation of the supported player; when the selected target is a ball, the football icon or football with different sizes possibly appears on site, so that tracking fails, the size and the color of the football need to be acquired, meanwhile, a viewer can track the football in the whole course when watching the game, and focus of the game is focused at any time, so that watching experience of a user is improved.
Optionally, the determining whether the wide-angle image includes the selected object includes:
extracting relevant features of all targets in the wide-angle image to obtain second relevant feature information;
comparing the second related characteristic information with the first related characteristic information;
if the comparison is consistent, judging that the wide-angle image contains the selected target;
and if the comparison is inconsistent, judging that the selected target is not contained in the wide-angle image.
Optionally, the focusing the wide-angle image by using a tele camera, and collecting a focusing image including the selected target includes:
acquiring the position of the selected target in the wide-angle image;
focusing an area taking the selected target as a center by using a long-focus camera to obtain a focusing picture;
extracting relevant characteristic information of all targets in the focusing picture to obtain third relevant characteristic information;
comparing the third related characteristic information with the first related characteristic information;
if the comparison is consistent, the focusing picture is used as the focusing image containing the selected target;
and if the contrast is inconsistent, repeating focusing on the area taking the selected target as the center by using the long-focus camera to acquire a focusing picture.
By adopting the technical scheme, the focusing image is the amplified image centering on the selected target in the wide-angle image, so that a user can clearly see the selected target when watching the game, and the watching experience of the user for watching the game is improved.
Optionally, the generating the prompt information includes:
acquiring a moving panoramic image corresponding to the venue;
determining the position information of the selected target in the moving panoramic image;
determining relative position information of the wide-angle image and the movable panoramic image;
judging the offset direction of the selected target and the wide-angle image based on the position information and the relative position information;
and generating the prompt information based on the offset direction.
Through adopting above-mentioned technical scheme, when not containing in the wide-angle image and selecting the target, through selecting the target in the moving panoramic image the position information and the wide-angle image with moving panoramic image's relative position information contrast, judge the skew direction of selecting target and wide-angle image, produce prompt message according to the skew direction, can make the user more convenient when adjusting wide-angle camera.
Optionally, the head mounted display device includes a vibration motor; the prompt message comprises:
the different offset directions correspond to different vibration properties of the vibration motor;
wherein the vibration properties include vibration intensity, vibration frequency, and/or vibration time.
Through adopting above-mentioned technical scheme, when the shooting angle of wide-angle camera is adjusted according to prompt message to the user, can more accurate messenger wide-angle camera pursue the target of selecting to improve user's viewing experience.
In a second aspect, the present application provides a venue target tracking device, which adopts the following technical scheme:
a venue target tracking apparatus for use with a head mounted display device, the apparatus comprising:
the response acquisition module is used for responding to the target selection action of the user and acquiring first related characteristic information of the selected target;
the acquisition module is used for acquiring wide-angle images by using the wide-angle camera;
the judging module is used for judging whether the wide-angle image contains the selected target or not according to the first related characteristic information of the selected target;
the focusing acquisition module is used for focusing the wide-angle image by using a long-focus camera according to the first related characteristic information of the selected target and acquiring a focusing image containing the selected target;
and generating a prompt module, generating prompt information, and prompting a user to change the shooting angle of the wide-angle camera according to the prompt information.
In a third aspect, the present application provides a head-mounted display device, which adopts the following technical scheme:
a head mounted display device comprising a memory and a processor, the memory having stored thereon a computer program capable of being loaded by the processor and executing any of the prompting methods of the first aspect.
In a fourth aspect, the present application provides a computer readable storage medium, which adopts the following technical scheme:
a computer readable storage medium storing a computer program capable of being loaded by a processor and executing the prompting method according to any one of the first aspects.
Drawings
Fig. 1 is a flowchart of a venue object tracking method according to an embodiment of the present application.
Fig. 2 is a block diagram of a venue object tracking device according to an embodiment of the present application.
Fig. 3 is a block diagram of a head-mounted display device according to an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the accompanying drawings.
Fig. 1 is a flowchart of a venue object tracking method according to an embodiment of the present application.
As shown in fig. 1, the main flow of the method is described as follows (steps S101 to S105):
step S101, first relevant characteristic information of a selected target is acquired in response to a target selection action of a user.
Specifically, the user inputs the target to be watched into the head-mounted display device, the user can input the target to be watched by adopting voice, the target to be watched by the user can also be input into the head-mounted display device through wireless connection of the mobile terminal and the head-mounted display device, and further, when the target is selected by the head-mounted display device, the first related characteristic information of the selected target is called, and the selected target is described to the user in a voice playing mode.
As an optional implementation manner of this embodiment, the manner of acquiring the first relevant feature information may be that the head-mounted display device is connected to the internet, and the first relevant feature information of the selected target may be acquired through the internet, or may be manually input by a staff in a venue.
Further, if the selected target is a player, the first related feature information includes at least one of facial image features of the player, wearing image features, and skeletal points of the player;
if the selected target is a football, the first relevant characteristic information comprises the volume and the floral pattern of the football.
Step S102, collecting wide-angle images of a venue.
Specifically, the head-mounted display device includes a wide-angle camera, and when a user views a game using the head-mounted display device, the wide-angle camera changes a shooting direction of the wide-angle camera along with movement of a user's line of sight, thereby collecting a wide-angle image of a venue.
Step S103, judging whether the wide-angle image contains the selected target or not according to the first related characteristic information of the selected target; if yes, go to step S104, otherwise go to step S105.
As an optional implementation manner in this embodiment, determining whether the wide-angle image includes the selected object includes: extracting relevant features of all targets in the wide-angle image to obtain second relevant feature information; comparing the second related characteristic information with the first related characteristic information; if the comparison is consistent, judging that the wide-angle image contains the selected target; and if the comparison is inconsistent, judging that the selected target is not contained in the wide-angle image.
Specifically, when watching a football match, the head-mounted display device takes a nine-player as a selected target, then obtains facial image features, wearing image features and skeleton points of the nine-player as reference objects, the head-mounted display device collects wide-angle images of a venue, then adopts an image feature extraction algorithm to extract relevant feature information of all targets in the wide-angle images as human bodies, and obtains second relevant feature information, wherein all targets in the wide-angle images possibly comprise the nine-player, the seven-player, the thirteen-player and the like, the second relevant feature information comprises facial image features, wearing image features and skeleton points of the nine-player, then compares the second relevant feature information with the first relevant feature information, when second relevant feature information which accords with the first relevant feature information of the nine-player exists in the wide-angle images, the nine-player can be judged to be contained in the images, and when all targets in the wide-angle images do not accord with the first relevant feature information of the nine-player, the nine-player is not contained in the wide-angle images can be judged to be judged.
Step S104, focusing the wide-angle image by using the long-focus camera according to the first related characteristic information of the selected target, and collecting a focusing image containing the selected target.
In this embodiment, when the head-mounted display device determines that the wide-angle image includes the selected target, focusing the wide-angle image by using the tele camera, and collecting the focused image including the selected target includes: acquiring the position of a selected target in a wide-angle image; focusing an area taking a selected target as a center by using a long-focus camera to obtain a focusing picture; extracting relevant characteristic information of all targets in the focusing picture to obtain third relevant characteristic information; comparing the third related characteristic information with the first related characteristic information; if the contrast is consistent, taking the focusing picture as a focusing image containing the selected target; if the contrast is inconsistent, repeatedly using the long-focus camera to focus the area taking the selected target as the center, and obtaining a focusing image.
Specifically, the head-mounted display device extracts third relevant characteristic information of all targets in the focusing picture, wherein all targets in the focusing picture possibly comprise a nine-player and/or a seven-player, the third relevant characteristic information comprises facial image characteristics, wearing image characteristics and skeleton points of the player, the third relevant characteristic information is compared with the first relevant characteristic information, when the third relevant characteristic information conforming to the first relevant characteristic information of the nine-player exists in the focusing picture, the fact that the nine-player is contained in the focusing picture can be judged, when all targets in the focusing picture do not conform to the first relevant characteristic information of the nine-player, the long-focus camera is required to be repeatedly utilized to focus an area taking the selected target as the center, and the focusing picture is obtained until the focusing picture contains the selected target.
In this embodiment, when the user watches the football match on site, the user is affected by the distance, and the action of the player cannot be seen clearly when watching, so that the watching experience of the user is affected, so that the long-focus camera can be utilized to focus on the area with the selected target as the center, a focusing picture is obtained, the user can see the operation of the player more clearly when watching, and the watching experience of the user is improved.
Step S105, generating prompt information, where the prompt information is used to prompt a user to change the shooting angle of the wide-angle camera.
As an alternative manner of this embodiment, generating the prompt information includes: acquiring a moving panoramic image corresponding to a venue; determining the position information of the selected target in the moving panoramic image; determining relative position information of the wide-angle image and the movable panoramic image; judging the offset direction of the selected target and the wide-angle image based on the position information and the relative position information; and generating prompt information based on the offset direction.
Specifically, when the wide-angle image does not contain the selected target, a plurality of cameras at different positions are required to be preset in the venue, the head-mounted display device acquires the moving panoramic image of the venue, then determines the position information of the selected target in the moving panoramic image based on the first related characteristic information of the selected target, determines the relative position information of the wide-angle image in the moving panoramic image based on the picture in the wide-angle image, can judge the offset direction of the selected target relative to the wide-angle image through the position information of the selected target and the relative position information of the wide-angle image, and generates prompt information based on the offset direction.
For example, when the wide-angle image is located in the left half of the moving panoramic image and the selected object is located in the right half of the moving panoramic object, the head-mounted display device generates a hint information that is offset to the right; when the wide-angle image is positioned at the right half part of the movable panoramic image, and the selected target is positioned at the left half part of the movable panoramic target, the head-mounted display device generates prompt information which shifts leftwards;
as an alternative to the present embodiment, the head-mounted display device includes a vibration motor; the prompt information comprises: different offset directions correspond to different vibration properties of the vibration motor; wherein the vibration properties include vibration intensity, vibration frequency, and/or vibration time.
Specifically, when the head-mounted display device prompts the user, different deviation directions correspond to different vibration properties of the vibration motor, for example, when the selected object deviates leftwards relative to the wide-angle image, the vibration frequency of the vibration motor can be controlled to be 30, and when the selected object deviates rightwards relative to the wide-angle image, the vibration frequency of the vibration motor can be controlled to be 20.
Fig. 2 is a block diagram of a venue object tracking device 200 according to an embodiment of the present application.
As shown in fig. 2, a venue object tracking device 200 mainly includes:
a response obtaining module 201, configured to respond to a target selection action of a user, and obtain first relevant feature information of a selected target;
a wide-angle acquisition module 202 for acquiring a wide-angle image using a wide-angle camera;
a judging module 203, configured to judge whether the selected object is included in the wide-angle image according to the first relevant feature information of the selected object;
the focusing acquisition module 204 is configured to focus the wide-angle image with a tele camera according to the first relevant feature information of the selected target, and acquire a focused image including the selected target;
the generating module 205 generates prompt information, where the prompt information is used to prompt the user to change the shooting angle of the wide-angle camera.
As an optional implementation manner of the embodiment of the present application, the response obtaining module 201 is further specifically configured to, if the selected target is a human body, the first relevant feature information includes at least one of facial image features, wearing image features, and skeletal points; and if the selected target is a sphere, the first related characteristic information comprises a sphere volume and a pattern.
As an optional implementation manner of the embodiment of the present application, the judging module 203 is further specifically configured to extract relevant features of all objects in the wide-angle image, so as to obtain second relevant feature information; comparing the second related characteristic information with the first related characteristic information; if the comparison is consistent, judging that the wide-angle image contains the selected target; if the contrast is inconsistent, the wide-angle image is judged to not contain the selected target.
As an optional implementation manner of the embodiment of the present application, the focusing acquisition module 204 is further specifically configured to acquire a position of the selected target in the wide-angle image; focusing an area taking a selected target as a center by using a long-focus camera to obtain a focusing picture; extracting relevant characteristic information of all targets in the focusing picture to obtain third relevant characteristic information; comparing the third related characteristic information with the first related characteristic information; if the contrast is consistent, taking the focusing picture as a focusing image containing the selected target; if the contrast is inconsistent, repeatedly using the long-focus camera to focus the area taking the selected target as the center, and obtaining a focusing image.
As an optional implementation manner of the embodiment of the present application, the generating module 205 is further specifically configured to obtain a moving panoramic image corresponding to a venue; determining the position information of the selected target in the moving panoramic image; determining relative position information of the wide-angle image and the movable panoramic image; judging the offset direction of the selected target and the wide-angle image based on the position information and the relative position information; and generating prompt information based on the offset direction.
As an alternative implementation of the embodiment of the present application, the generating module 205 is further specifically configured for a head-mounted display device including a vibration motor; the prompt information comprises: different offset directions correspond to different vibration properties of the vibration motor; wherein the vibration properties include vibration intensity, vibration frequency and/or vibration time.
In one example, a module in any of the above apparatuses may be one or more integrated circuits configured to implement the above methods, for example: one or more application specific integrated circuits (application specific integratedcircuit, ASIC), or one or more digital signal processors (digital signal processor, DSP), or one or more field programmable gate arrays (field programmable gate array, FPGA), or a combination of at least two of these integrated circuit forms.
For another example, when a module in an apparatus may be implemented in the form of a scheduler of processing elements, the processing elements may be general-purpose processors, such as a central processing unit (central processing unit, CPU) or other processor that may invoke a program. For another example, the modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
It will be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the apparatus and modules described above may refer to the corresponding process in the foregoing method embodiment, which is not repeated herein.
Fig. 3 is a block diagram of a head-mounted display device 300 according to an embodiment of the present application.
As shown in fig. 3, the head mounted display device 300 includes a memory 301, a processor 302, and a communication bus 303; the memory 301 and the processor 302 are connected by a communication bus 303. The memory 301 has stored thereon a computer program that can be loaded by the processor 302 and that performs the venue object tracking method.
Memory 301 may be used to store instructions, programs, code sets, or instruction sets. The memory 301 may include a storage program area and a storage data area, wherein the storage program area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing a venue target tracking method, and the like; the storage data area may store data and the like involved in the venue object tracking method.
Processor 302 may include one or more processing cores. The processor 302 performs the various functions of the present application and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 301, invoking data stored in the memory 301. The processor 302 may be at least one of an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a digital signal processor (Digital Signal Processor, DSP), a digital signal processing device (Digital Signal Processing Device, DSPD), a programmable logic device (Programmable Logic Device, PLD), a field programmable gate array (Field Programmable Gate Array, FPGA), a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, and a microprocessor. It will be appreciated that the electronics for implementing the above-described processor functions may be other for different devices, and embodiments of the present application are not particularly limited.
Communication bus 303 may include a path to transfer information between the components. The communication bus 203 may be a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus or an EISA (Extended Industry Standard Architecture ) bus, or the like. The communication bus 303 may be classified into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one double arrow is shown in FIG. 3, but not only one bus or one type of bus.
The application also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program realizes the steps of the venue target tracking method when being executed by a processor.
The computer readable storage medium may include: a U-disk, a removable hard disk, a read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
The above description is only illustrative of the preferred embodiments of the present application and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the application is not limited to the specific combinations of the features described above, but also covers other embodiments which may be formed by any combination of the features described above or their equivalents without departing from the spirit of the application. Such as the above-mentioned features and the technical features having similar functions (but not limited to) applied for in the present application are replaced with each other.

Claims (7)

1. A venue target tracking method for use with a head mounted display device, the method comprising:
responding to a target selection action of a user, and acquiring first related characteristic information of a selected target;
collecting wide-angle images of the venue; the head-mounted display device comprises a wide-angle camera, and a wide-angle image of the venue is acquired by the wide-angle camera;
judging whether the wide-angle image contains the selected target or not according to the first related characteristic information of the selected target;
if yes, focusing the wide-angle image by using a long-focus camera according to the first related characteristic information of the selected target, and collecting a focusing image containing the selected target;
if not, generating prompt information, wherein the prompt information is used for prompting a user to change the shooting angle of the wide-angle camera;
the generating the prompt message comprises the following steps:
acquiring a moving panoramic image corresponding to the venue;
determining the position information of the selected target in the moving panoramic image;
determining relative position information of the wide-angle image and the movable panoramic image;
judging the offset direction of the selected target and the wide-angle image based on the position information and the relative position information;
generating the prompt information based on the offset direction;
the head mounted display device includes a vibration motor;
the prompt message comprises: different offset directions correspond to different vibration properties of the vibration motor; wherein the vibration properties include vibration intensity, vibration frequency, and/or vibration time.
2. The method of claim 1, wherein if the selected object is a human body, the first related feature information includes at least one of facial image features, wearing image features, and skeletal points;
and if the selected target is a sphere, the first related characteristic information comprises a sphere volume and a pattern.
3. The method according to claim 1 or 2, wherein the determining whether the selected object is included in the wide-angle image includes:
extracting relevant features of all targets in the wide-angle image to obtain second relevant feature information;
comparing the second related characteristic information with the first related characteristic information;
if the comparison is consistent, judging that the wide-angle image contains the selected target;
and if the comparison is inconsistent, judging that the selected target is not contained in the wide-angle image.
4. The method of claim 3, wherein focusing the wide-angle image with a tele camera, acquiring a focused image containing the selected object comprises:
acquiring the position of the selected target in the wide-angle image;
focusing an area taking the selected target as a center by using a long-focus camera to obtain a focusing picture;
extracting relevant characteristic information of all targets in the focusing picture to obtain third relevant characteristic information;
comparing the third related characteristic information with the first related characteristic information;
if the comparison is consistent, the focusing picture is used as the focusing image containing the selected target;
and if the contrast is inconsistent, repeating focusing on the area taking the selected target as the center by using the long-focus camera to acquire a focusing image.
5. A venue target tracking apparatus for use with a head mounted display device, the apparatus comprising:
the response acquisition module is used for responding to the target selection action of the user and acquiring first related characteristic information of the selected target;
the wide-angle acquisition module acquires a wide-angle image by using a wide-angle camera; the head-mounted display device comprises a wide-angle camera, and a wide-angle image of the venue is acquired by the wide-angle camera; the judging module is used for judging whether the wide-angle image contains the selected target or not according to the first related characteristic information of the selected target;
the focusing acquisition module is used for focusing the wide-angle image by using a long-focus camera according to the first related characteristic information of the selected target and acquiring a focusing image containing the selected target;
the generation module is used for generating prompt information which is used for prompting a user to change the shooting angle of the wide-angle camera;
the generating the prompt message comprises the following steps:
acquiring a moving panoramic image corresponding to the venue;
determining the position information of the selected target in the moving panoramic image;
determining relative position information of the wide-angle image and the movable panoramic image;
judging the offset direction of the selected target and the wide-angle image based on the position information and the relative position information;
generating the prompt information based on the offset direction;
the head mounted display device includes a vibration motor;
the prompt message comprises: different offset directions correspond to different vibration properties of the vibration motor; wherein the vibration properties include vibration intensity, vibration frequency, and/or vibration time.
6. A head mounted display device comprising a memory and a processor, the memory having stored thereon a computer program capable of being loaded by the processor and performing the method of any of claims 1 to 4.
7. A computer readable storage medium, characterized in that a computer program is stored which can be loaded by a processor and which performs the method according to any of claims 1 to 4.
CN202210130891.7A 2022-02-12 2022-02-12 Venue target tracking method, device, equipment and medium Active CN114500981B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210130891.7A CN114500981B (en) 2022-02-12 2022-02-12 Venue target tracking method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210130891.7A CN114500981B (en) 2022-02-12 2022-02-12 Venue target tracking method, device, equipment and medium

Publications (2)

Publication Number Publication Date
CN114500981A CN114500981A (en) 2022-05-13
CN114500981B true CN114500981B (en) 2023-08-11

Family

ID=81479683

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210130891.7A Active CN114500981B (en) 2022-02-12 2022-02-12 Venue target tracking method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN114500981B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2003213534A1 (en) * 2003-07-15 2005-02-03 Chao-Hung Chang Active Video Surveillance System and Active Video Surveillance Method Therefor
CN101547344A (en) * 2009-04-24 2009-09-30 清华大学深圳研究生院 Video monitoring device and tracking and recording method based on linkage camera
CN105893510A (en) * 2016-03-30 2016-08-24 北京格灵深瞳信息技术有限公司 Video structurization system and target search method thereof
JP2017037146A (en) * 2015-08-07 2017-02-16 キヤノン株式会社 Imaging apparatus, imaging method, shooting system and program
CN111683204A (en) * 2020-06-18 2020-09-18 南方电网数字电网研究院有限公司 Unmanned aerial vehicle shooting method and device, computer equipment and storage medium
CN112087571A (en) * 2019-06-14 2020-12-15 Oppo广东移动通信有限公司 Image acquisition method and device, electronic equipment and computer readable storage medium
CN112995507A (en) * 2021-02-08 2021-06-18 北京蜂巢世纪科技有限公司 Method and device for prompting object position

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105547318B (en) * 2016-01-26 2019-03-05 京东方科技集团股份有限公司 A kind of control method of intelligence helmet and intelligent helmet

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2003213534A1 (en) * 2003-07-15 2005-02-03 Chao-Hung Chang Active Video Surveillance System and Active Video Surveillance Method Therefor
CN101547344A (en) * 2009-04-24 2009-09-30 清华大学深圳研究生院 Video monitoring device and tracking and recording method based on linkage camera
JP2017037146A (en) * 2015-08-07 2017-02-16 キヤノン株式会社 Imaging apparatus, imaging method, shooting system and program
CN105893510A (en) * 2016-03-30 2016-08-24 北京格灵深瞳信息技术有限公司 Video structurization system and target search method thereof
CN112087571A (en) * 2019-06-14 2020-12-15 Oppo广东移动通信有限公司 Image acquisition method and device, electronic equipment and computer readable storage medium
CN111683204A (en) * 2020-06-18 2020-09-18 南方电网数字电网研究院有限公司 Unmanned aerial vehicle shooting method and device, computer equipment and storage medium
CN112995507A (en) * 2021-02-08 2021-06-18 北京蜂巢世纪科技有限公司 Method and device for prompting object position

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
高精度大视场空间目标测量光学系统研究;张坤;《中国优秀硕士学位论文集》;全文 *

Also Published As

Publication number Publication date
CN114500981A (en) 2022-05-13

Similar Documents

Publication Publication Date Title
CN106803966B (en) Multi-user network live broadcast method and device and electronic equipment thereof
CN106982387B (en) Bullet screen display and push method and device and bullet screen application system
JP7132730B2 (en) Information processing device and information processing method
JP7303754B2 (en) Method and system for integrating user-specific content into video production
JP6720587B2 (en) Video processing device, video processing method, and video processing program
CN107623819B (en) A kind of method taken pictures and mobile terminal and related media production
JP2020086983A (en) Image processing device, image processing method, and program
CN114449252A (en) Method, device, equipment, system and medium for dynamically adjusting live video based on explication audio
CN110266955B (en) Image processing method, image processing apparatus, electronic device, and storage medium
CN114143561B (en) Multi-view roaming playing method for ultra-high definition video
CN110891168A (en) Information processing apparatus, information processing method, and storage medium
US20210258505A1 (en) Image processing apparatus, image processing method, and storage medium
JP6283329B2 (en) Augmented Reality Object Recognition Device
CN114500981B (en) Venue target tracking method, device, equipment and medium
JP2022073651A (en) Information processing apparatus, information processing method, and program
CN114584681A (en) Target object motion display method and device, electronic equipment and storage medium
CN112437231A (en) Image shooting method and device, electronic equipment and storage medium
CN108419127A (en) A method of preventing child myopia
US11683549B2 (en) Information distribution apparatus, information distribution method, and information distribution program
KR101943554B1 (en) Method and server for providing sports game information
CN113971693A (en) Live broadcast picture generation method, system and device and electronic equipment
CN114625468A (en) Augmented reality picture display method and device, computer equipment and storage medium
CN108965859B (en) Projection mode identification method, video playing method and device and electronic equipment
CN112887606A (en) Shooting method and device and electronic equipment
CN114500846B (en) Live action viewing angle switching method, device, equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant