CN108347657B - Method and device for displaying bullet screen information - Google Patents
Method and device for displaying bullet screen information Download PDFInfo
- Publication number
- CN108347657B CN108347657B CN201810185259.6A CN201810185259A CN108347657B CN 108347657 B CN108347657 B CN 108347657B CN 201810185259 A CN201810185259 A CN 201810185259A CN 108347657 B CN108347657 B CN 108347657B
- Authority
- CN
- China
- Prior art keywords
- plane area
- bullet screen
- target
- image picture
- screen information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the invention provides a method and a device for displaying bullet screen information, which can be applied to AR (augmented reality) equipment. Based on the processing, the AR equipment can display the bullet screen information to be played in a plane different from the plane where the target video is located, so that video pictures shielded by the bullet screen information can be reduced, and the user experience is improved.
Description
Technical Field
The invention relates to the technical field of video display, in particular to a method and a device for displaying bullet screen information.
Background
Barrage information may appear on the playing interface of a video in a scrolling, hovering, or other special effect manner, the content of which is typically a brief comment sent by a user viewing the video. In the prior art, the display of the bullet screen information is mainly realized by overlapping the bullet screen information in a video playing interface. When a plurality of pieces of bullet screen information are displayed simultaneously, the bullet screen information can be displayed to a user in a directional rolling or line-by-line display mode.
However, the inventor finds that the prior art has at least the following problems in the process of implementing the invention:
when the bullet screen information that needs to be displayed is more, because the size restriction of the video playing interface, the bullet screen information can shelter from more video pictures, resulting in poor user experience.
Disclosure of Invention
The embodiment of the invention aims to provide a method and a device for displaying bullet screen information so as to improve user experience. The specific technical scheme is as follows:
in a first aspect, to achieve the above object, an embodiment of the present invention discloses a method for displaying bullet screen information, which can be applied to an AR (Augmented Reality) device, where the method includes:
acquiring an image picture in the current view field of the AR equipment, wherein the image picture is a three-dimensional image picture and comprises one or more plane areas;
acquiring a target plane area which meets the video playing requirement in the image picture, and playing a target video in the target plane area;
acquiring first spatial position information of the target plane area in the image picture, and determining second spatial position information of bullet screen information to be played according to the first spatial position information;
and displaying the bullet screen information to be played according to the second spatial position information.
Optionally, the obtaining of the target plane area in the image picture, which meets the video playing requirement, includes:
judging whether a first preset direction of the image picture contains a plane area or not;
and if the first preset direction of the image picture contains a plane area, taking the plane area contained in the first preset direction as the target plane area.
Optionally, the method further includes:
if the first preset direction of the image picture does not contain the plane area, judging whether the second preset direction of the image picture contains the plane area;
if the second preset direction of the image picture contains a plane area, taking the plane area contained in the second preset direction of the image picture as the target plane area;
or, if the second preset direction of the image picture does not contain the plane area, judging whether the third preset direction of the image picture contains the plane area;
and if the third preset direction of the image picture contains a plane area, taking the plane area contained in the third preset direction of the image picture as the target plane area.
Optionally, the playing the target video in the target plane area includes:
acquiring the perspective shape of the target plane area;
judging whether the picture shape of the target video is matched with the perspective shape of the target plane area;
and if the picture shape of the target video is not matched with the perspective shape of the target plane area, adjusting the picture shape of the target video so as to enable the picture shape of the target video to be matched with the perspective shape of the target plane area.
Optionally, the displaying the bullet screen information to be played according to the second spatial position information includes:
acquiring the quantity of bullet screen information generated in unit time in real time;
judging whether the quantity of the bullet screen information generated in the unit time is greater than a preset threshold value or not;
if the quantity of the bullet screen information generated in the unit time is not greater than a preset threshold value, displaying the bullet screen information to be played in the target plane area;
or if the quantity of the bullet screen information generated in the unit time is greater than a preset threshold value, respectively displaying the bullet screen information to be played in the target plane area and other plane areas, wherein the other plane areas are the plane areas except the target plane area in the image picture.
Optionally, the obtaining of the first spatial position information of the target plane area in the image frame includes obtaining a plurality of coordinate points of the target plane area, and determining, according to the first spatial position information, second spatial position information of the bullet screen information to be played, including:
determining a display plane where the target plane area is located according to a plurality of coordinate points of the target plane area in the visual field range of the AR equipment;
determining a preset number of bullet screen planes with included angles with the display plane within a preset angle range;
and determining second spatial position information of the bullet screen information to be played according to the bullet screen plane.
Optionally, the method further includes:
when the AR equipment is detected to move, acquiring coordinate position information of the target plane area in the moved view range;
and updating second spatial position information of the bullet screen information to be played according to the coordinate position information.
In a second aspect, to achieve the above object, an embodiment of the present invention discloses an apparatus for displaying bullet screen information, where the apparatus may be applied to an AR device, and the apparatus includes:
the AR equipment comprises an image acquisition module, a display module and a display module, wherein the image acquisition module is used for acquiring an image picture in the current view field range of the AR equipment, the image picture is a three-dimensional image picture, and the image picture comprises one or more plane areas;
the plane acquisition module is used for acquiring a target plane area which meets the video playing requirement in the image picture;
the playing module is used for playing a target video in the target plane area;
the determining module is used for acquiring first spatial position information of the target plane area in the image picture and determining second spatial position information of bullet screen information to be played according to the first spatial position information;
and the display module is used for displaying the bullet screen information to be played according to the second spatial position information.
Optionally, the plane obtaining module is specifically configured to determine whether a first preset direction of the image frame includes a plane area;
and if the first preset direction of the image picture contains a plane area, taking the plane area contained in the first preset direction as the target plane area.
Optionally, the plane obtaining module is further configured to determine whether a second preset direction of the image picture includes a plane region if the first preset direction of the image picture does not include the plane region;
if the second preset direction of the image picture contains a plane area, taking the plane area contained in the second preset direction of the image picture as the target plane area;
or, if the second preset direction of the image picture does not contain the plane area, judging whether the third preset direction of the image picture contains the plane area;
and if the third preset direction of the image picture contains a plane area, taking the plane area contained in the third preset direction of the image picture as the target plane area.
Optionally, the playing module is specifically configured to obtain a perspective shape of the target plane area;
judging whether the picture shape of the target video is matched with the perspective shape of the target plane area;
and if the picture shape of the target video is not matched with the perspective shape of the target plane area, adjusting the picture shape of the target video so as to enable the picture shape of the target video to be matched with the perspective shape of the target plane area.
Optionally, the display module is specifically configured to obtain the number of bullet screen information generated in unit time in real time;
judging whether the quantity of the bullet screen information generated in the unit time is greater than a preset threshold value or not;
if the quantity of the bullet screen information generated in the unit time is not greater than a preset threshold value, displaying the bullet screen information to be played in the target plane area;
or if the quantity of the bullet screen information generated in the unit time is greater than a preset threshold value, respectively displaying the bullet screen information to be played in the target plane area and other plane areas, wherein the other plane areas are the plane areas except the target plane area in the image picture.
Optionally, the first spatial location information includes a plurality of coordinate points of the target plane area, and the determining module is specifically configured to determine a display plane where the target plane area is located according to the plurality of coordinate points of the target plane area within the visual field of the AR device; determining a preset number of bullet screen planes with included angles with the display plane within a preset angle range; and determining second spatial position information of the bullet screen information to be played according to the bullet screen plane.
Optionally, the apparatus further comprises:
the updating module is used for acquiring coordinate position information of the target plane area in the moved view range when the AR equipment is detected to move;
and updating second spatial position information of the bullet screen information to be played according to the coordinate position information.
In another aspect of the present invention, in order to achieve the above object, an embodiment of the present invention further discloses an AR device, where the AR device includes a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the method for displaying bullet screen information according to the first aspect when executing the program stored in the memory.
In yet another aspect of the present invention, there is also provided a computer-readable storage medium having stored therein instructions which, when run on a computer, implement the method for displaying bullet screen information according to the first aspect described above.
In another aspect of the present invention, an embodiment of the present invention further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute the method for displaying bullet screen information according to the first aspect.
The method and the device for displaying the bullet screen information can be applied to AR equipment, the AR equipment can acquire a target plane area meeting video playing requirements in an image picture in a current visual field range, play a target video in the target plane area, then acquire first spatial position information of the target plane area in the image picture, determine second spatial position information of the bullet screen information to be played according to the first spatial position information, and display the bullet screen information to be played according to the second spatial position information. Based on the processing, the AR equipment can display the bullet screen information to be played in a plane different from the plane where the target video is located, so that video pictures shielded by the bullet screen information can be reduced, and the user experience is improved.
Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a block diagram of a system for displaying bullet screen information according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for displaying bullet screen information according to an embodiment of the present invention;
fig. 3 is a flowchart of a method for determining second spatial location information according to an embodiment of the present invention;
fig. 4 is a flowchart of a method for adjusting a display angle of bullet screen information according to an embodiment of the present invention;
fig. 5 is a structural diagram of an apparatus for displaying bullet screen information according to an embodiment of the present invention;
fig. 6 is a structural diagram of an AR device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.
In the prior art, when the bullet screen information required to be displayed is more, the bullet screen information can shield more video pictures due to the limitation of the size of a video playing interface, so that the user experience is poor.
Based on the above consideration, the present invention provides a method and an apparatus for displaying bullet screen information, which can be applied to an AR device, where the AR device can acquire an image frame in a current view range, acquire a target plane area satisfying video playing requirements in the image frame, and then play a target video in the target plane area. The AR device can determine second spatial position information of the bullet screen information to be played according to the first spatial position information of the target plane area in the image picture, and display the bullet screen information to be played according to the second spatial position information. Based on the processing, the AR equipment can display the bullet screen information to be played in a plane different from the plane where the target video is located, so that video pictures shielded by the bullet screen information can be reduced, and the user experience is improved.
First, the method for displaying bullet screen information according to the present invention is described in its entirety.
Referring to fig. 1, fig. 1 is a block diagram of a system for displaying bullet screen information according to an embodiment of the present invention, including:
the device comprises a camera 101, an AR analysis processing module 102, a player 103, an AR barrage module 104, a display calculation module 105, an AR drawing module 106 and a display module 107.
The camera 101 may be configured to acquire a real-time image frame within a field of view of a user wearing the AR device (that is, a field of view of the AR device), and send the image frame to the AR analysis processing module 102.
The AR analysis processing module 102 may be configured to receive an image frame sent by the camera 101, detect a planar area in the image frame that meets a video playing requirement, and send coordinates of the detected planar area to the AR bullet screen module 104.
The player 103 may be configured to send the video playing time to the AR barrage module 104, and send the video frame of the target video to the display calculation module 105.
The AR barrage module 104 may be configured to receive the coordinates of the plane area sent by the AR analysis processing module, receive the video playing time sent by the player 103, and send to the display calculation module 105 barrage information to be played and a display mode of the barrage information to be played, where the display mode may include a stop mode, a scroll mode, or another special effect mode.
The display calculation module 105 may receive the video picture sent by the player 103, the bullet screen information to be played and the display mode of the bullet screen information to be played, sent by the AR bullet screen module 104, calculate the spatial position information of the video picture and the bullet screen information to be played, and send the video picture, the bullet screen information to be played and the spatial position information to the AR rendering module 106.
The AR rendering module 106 may be configured to receive the video picture, the bullet screen information to be played, and the spatial position information sent by the display calculation module 105, render a virtual image including the video picture and the bullet screen information to be played, and send the virtual image to the display module 107.
The display module 107 may be configured to receive the virtual image sent by the AR rendering module 106 and display the virtual image.
The present invention will be described in detail below with reference to specific examples.
Referring to fig. 2, fig. 2 is a flowchart of a method for displaying bullet screen information according to an embodiment of the present invention, including:
s201: and acquiring an image picture in the current visual field range of the AR equipment.
The image picture may be a three-dimensional image picture, and the image picture may include one or more planar regions.
In implementation, the AR device may acquire images (i.e., image frames) within the field of view in real time using a camera. The camera usually has a preset field angle, and the image frames acquired by the AR device may be image frames of a real scene within the field angle range. In addition, the AR device may automatically adjust an angle of the camera in the process of acquiring the image frame, so as to acquire image frames in different directions.
S202: and acquiring a target plane area which meets the video playing requirement in the image picture, and playing the target video in the target plane area.
In implementation, the AR device may analyze the image frame according to a preset augmented reality technology framework, identify a plane region in the image frame, and determine a target plane region that meets a video playing requirement in the identified plane region. The augmented reality technology framework may be an ARCore (augmented reality core) or an ARKit (augmented reality equipment). For example, the AR device may use, as the target plane area, a plane area that occupies a larger proportion than a preset threshold (may be referred to as a first threshold) in the image screen, among the identified plane areas. The target plane area may be a plane area having a regular geometric shape in the image frame, and may be, for example, an area to which a rectangular desktop in the image frame belongs, or an area to which a square floor in the image frame belongs. Specifically, the method for acquiring the target plane area by the AR device will be described in detail later. After the AR device acquires the target plane area, the target video may be played in the target plane area.
S203: acquiring first spatial position information of a target plane area in an image picture, and determining second spatial position information of bullet screen information to be played according to the first spatial position information.
The bullet screen information to be played can be one or more pieces.
In an implementation, the AR device may acquire relative position information (i.e., first spatial position information) of the target plane area in the image screen, and the first spatial position information may include coordinates of a plurality of points in the target plane area, which are not on the same straight line, in the image screen. For example, the target plane area is a rectangle, and the first spatial position information may include coordinates of four vertices of the rectangle in the image screen. The AR device may perform spatial coordinate operation according to the first spatial position information, determine a plane different from a plane where the target plane region is located, and may use spatial position information of the plane in the image picture as the second spatial position information. Specifically, the second spatial position information may include: the position information of the plane where the target plane area is located and/or the position information of the plane forming the preset angle with the target plane area may be one or a plurality of planes forming the preset angle with the target plane area.
S204: and displaying the bullet screen information to be played according to the second spatial position information.
In implementation, the AR device may directly display the bullet screen information to be played in the plane where the target plane area is located, or may display the bullet screen information to be played in other plane areas of the image picture. The AR device may determine a display method of the bullet screen information to be played according to the number of the bullet screen information to be displayed in unit time, and a specific display method will be described in detail later. The AR equipment can display each bullet screen information to be played according to the preset display size, font color and font format of each bullet screen information to be played, and the display special effect can comprise a stopping mode, a rolling mode or other special effect modes.
As can be seen from the above, based on the method for displaying barrage information in the embodiment of the present invention, the AR device may display the barrage information to be played in a plane different from the plane where the target video is located, so as to reduce video pictures blocked by the barrage information, and improve user experience.
Alternatively, the AR device may determine the target plane area in different directions of the image screen. Specifically, the method for acquiring the target plane area by the AR device may include the following steps: judging whether a first preset direction of an image picture contains a plane area or not; and if the first preset direction of the image picture contains the plane area, taking the plane area contained in the first preset direction as a target plane area.
The first preset direction may be set by a technician according to experience, and in order to improve the display effect of the bullet screen information, the first preset direction may be below the image frame.
In implementation, after the AR device acquires the image frame, it may determine whether the first preset direction of the image frame includes a plane area, where the plane area is a plane area meeting a preset video playing requirement, for example, a proportion of the plane area in the image frame is greater than a first threshold, and the plane area is a rectangle. If the first preset direction includes a plane area satisfying the video playing requirement, the AR device may use the plane area included in the first preset direction as a target plane area for playing the target video.
As can be seen from the above, based on the method for displaying bullet screen information in the embodiment of the present invention, the AR device may use a plane area in the first preset direction of the image picture as a target plane area, so as to improve user experience.
Optionally, the AR device may further determine the target plane area according to different directions of the image frame. Specifically, the method for acquiring the target plane area by the AR device may further include the following steps: if the first preset direction of the image picture does not contain the plane area, judging whether the second preset direction of the image picture contains the plane area; if the second preset direction of the image picture contains the plane area, taking the plane area contained in the second preset direction of the image picture as a target plane area; or, if the second preset direction of the image picture does not contain the plane area, judging whether the third preset direction of the image picture contains the plane area; and if the third preset direction of the image picture contains the plane area, taking the plane area contained in the third preset direction of the image picture as the target plane area.
The second preset direction may be right in front of the image frame, and the third preset direction may be left of the image frame or right of the image frame.
In implementation, when the AR device determines that there is no flat area satisfying the video playing requirement in the lower area of the image screen, the AR device may perform a search right in front of the image screen to determine whether there is a flat area satisfying the video playing requirement. If a planar area satisfying the video playback requirement exists directly in front of the image screen, the AR device may take the planar area as a target planar area. If the plane area meeting the video playing requirement does not exist right in front of the image picture, the AR device can search on the left or right of the image picture to judge whether the plane area meeting the video playing requirement exists, if the plane area meeting the video playing requirement exists on the left or right of the image picture, the AR device can take the plane area as a target plane area, and if the plane area meeting the video playing requirement does not exist on the left or right of the image picture, the AR device can adjust the angle of the camera to obtain the image pictures in different directions until the target plane area is obtained.
As can be seen from the above, based on the method for displaying bullet screen information in the embodiment of the present invention, the AR device may use the plane areas in different directions of the image as the target plane area, so that the success rate of obtaining the target plane area can be improved, and the user experience can be improved.
Optionally, the AR device may also adjust the picture shape of the target video. Specifically, the method for adjusting the picture shape of the target video by the AR device may include the following steps: acquiring a perspective shape of a target plane area; judging whether the picture shape of the target video is matched with the perspective shape of the target plane area; and if the picture shape of the target video does not match the perspective shape of the target plane area, adjusting the picture shape of the target video so as to enable the picture shape of the target video to match the perspective shape of the target plane area.
In implementation, after the AR device identifies the target plane area, the AR device may determine the perspective shape of the target plane area by using the coordinate transformation matrix of the identification plane according to the coordinates of the points at the edge of the target plane area. For example, the target plane area recognized by the AR device may be a rectangular desktop within the field of view, and the desktop is usually displayed as a trapezoid with a narrow top and a wide bottom in the image frame, and the AR device may determine the perspective shape of the desktop (i.e. the trapezoid with the narrow top and the wide bottom) according to the coordinates of the edge point of the desktop in the image frame. If the picture shape of the target video does not match the perspective shape of the target plane area, the AR device may adjust the picture shape of the target video according to the perspective shape of the target plane area to match the picture shape of the target video with the perspective shape of the target plane area. Illustratively, the AR device may adjust the picture shape of the target video to a trapezoid with a narrow top and a wide bottom.
As can be seen from the above, based on the method for displaying barrage information in the embodiment of the present invention, the AR device may adjust the picture shape of the target video to the perspective shape of the target plane area, so as to improve user experience.
Optionally, the AR device displays the bullet screen information to be played according to the second spatial position information, and may include the following steps: acquiring the quantity of bullet screen information generated in unit time in real time; judging whether the quantity of the bullet screen information generated in unit time is greater than a preset threshold value or not; if the quantity of the bullet screen information generated in unit time is not greater than a preset threshold value, displaying bullet screen information to be played in a target plane area; or if the quantity of the bullet screen information generated in the unit time is larger than a preset threshold value, the bullet screen information to be played is displayed in the target plane area and the other plane areas respectively.
And the other plane areas are the plane areas except the target plane area in the image picture.
In implementation, the AR device may acquire the number of bullet screen information generated per unit time (which may be referred to as a first number) in real time. If the first number is smaller than a preset threshold (may be referred to as a second threshold) or equal to the second threshold, the AR device may directly display the bullet screen information to be played in the target plane area. If the first number is greater than the second threshold, at this time, if the bullet screen information to be played is displayed only in the target plane area, more video pictures can be shielded, and the AR device can display the bullet screen information to be played in the target plane area and other plane areas respectively. Specifically, the AR device may display a second number of pieces of bullet screen information in the target plane area, and display difference pieces of bullet screen information between the first number and the second number in other plane areas, where the second number may be less than or equal to the second threshold.
As can be seen from the above, based on the method for displaying bullet screen information in the embodiment of the present invention, the AR device may determine the manner of displaying bullet screen information according to the number of bullet screen information generated in a unit time, so as to further reduce video frames blocked by the bullet screen information, and improve user experience.
Alternatively, the first spatial position information may include a plurality of coordinate points of the target plane area. Correspondingly, referring to fig. 3, fig. 3 is a flowchart of a method for determining second spatial location information according to an embodiment of the present invention, which may specifically include:
s301: and determining a display plane where the target plane area is located according to a plurality of coordinate points of the target plane area in the visual field range of the AR equipment.
The plurality of coordinate points are usually a plurality of points that are not on the same straight line in the target plane area. For example, if the target plane area is a rectangle, the plurality of coordinate points may include four vertices of the rectangle, and if the target plane area is a triangle, the plurality of coordinate points may include three vertices of the triangle.
In an implementation, the AR device may determine a plane (i.e., a display plane) in which the target plane area is located according to the relative coordinates of the coordinate points in the field of view.
S302: and determining a preset number of bullet screen planes with the included angle with the display plane within a preset angle range.
Wherein the preset angle range and the preset number can be set by a technician according to experience.
In implementation, the AR device may perform spatial coordinate operation according to the coordinate information (i.e., coordinates of a plurality of coordinate points) of the display plane, and determine a plane having an included angle with the display plane as a preset angle, as a bullet screen plane for displaying bullet screen information. Generally, the area of the bullet screen plane determined by the AR device in the image frame occupies a proportion greater than a third threshold value in the image frame. Illustratively, the preset angle may be 90 degrees, i.e., the AR device may determine a plurality of planes perpendicular to the display plane as the bullet screen plane.
S303: and determining second spatial position information of the bullet screen information to be played according to the bullet screen plane.
In implementation, the AR device may use the determined coordinate information of one bullet screen plane as the second spatial position information, or may use the coordinate information of multiple bullet screen planes as the second spatial position information.
As can be seen from the above, based on the method for displaying bullet screen information in the embodiment of the present invention, the AR device may display the bullet screen information in a plane different from the target plane area, so that the mutual shielding situation between the bullet screen information can be reduced, the video frames shielded by the bullet screen information can be reduced, and the user experience is improved.
Optionally, the AR device may also adjust the display angle of the bullet screen information. Referring to fig. 4, fig. 4 is a flowchart of a method for adjusting a display angle of bullet screen information according to an embodiment of the present invention, where the method may include:
s401: and when the AR equipment is detected to move, acquiring coordinate position information of the target plane area in the moved view field.
In implementation, a user wearing the AR device may choose to view the barrage information from different angles, and when the user changes the viewing angle, the AR device may move. The AR device may obtain coordinate position information (may be referred to as third spatial position information) of the target plane region within the moved view range according to the image frame obtained in real time, where the third spatial position information may include coordinates of a plurality of points in the target plane region that are not on the same straight line within the view range, and specifically, reference may be made to the description of the first spatial position information.
S402: and updating the second spatial position information of the bullet screen information to be played according to the coordinate position information.
In implementation, the AR device may perform spatial coordinate operation according to the third spatial position information, and recalculate the second spatial position information corresponding to the bullet screen information, so that the AR device may display the bullet screen information to be played according to the updated second spatial position information, and the relative position of the bullet screen information and the target plane area is unchanged.
As can be seen from the above, based on the method for displaying bullet screen information in the embodiment of the present invention, the AR device may adjust the display angle of the bullet screen information, so that a user may view the bullet screen information from different angles, and user experience is improved.
Corresponding to the embodiment of the method in fig. 2, referring to fig. 5, fig. 5 is a structural diagram of an apparatus for displaying bullet screen information according to an embodiment of the present invention, where the apparatus may be applied to an AR device, and the apparatus includes:
an image obtaining module 501, configured to obtain an image frame within a current view range of the AR device, where the image frame is a three-dimensional image frame, and the image frame includes one or more planar regions;
a plane obtaining module 502, configured to obtain a target plane area in the image frame, where the target plane area meets a video playing requirement;
a playing module 503, configured to play the target video in the target plane area;
a determining module 504, configured to obtain first spatial position information of the target plane area in the image frame, and determine, according to the first spatial position information, second spatial position information of the bullet screen information to be played;
and a display module 505, configured to display the bullet screen information to be played according to the second spatial position information.
Optionally, the plane obtaining module 502 is specifically configured to determine whether the first preset direction of the image frame includes a plane area;
and if the first preset direction of the image picture contains a plane area, taking the plane area contained in the first preset direction as the target plane area.
Optionally, the plane obtaining module 502 is further configured to determine whether the second preset direction of the image picture includes a plane region if the first preset direction of the image picture does not include the plane region;
if the second preset direction of the image picture contains a plane area, taking the plane area contained in the second preset direction of the image picture as the target plane area;
or, if the second preset direction of the image picture does not contain the plane area, judging whether the third preset direction of the image picture contains the plane area;
and if the third preset direction of the image picture contains a plane area, taking the plane area contained in the third preset direction of the image picture as the target plane area.
Optionally, the playing module 503 is specifically configured to obtain a perspective shape of the target plane area;
judging whether the picture shape of the target video is matched with the perspective shape of the target plane area;
and if the picture shape of the target video is not matched with the perspective shape of the target plane area, adjusting the picture shape of the target video so as to enable the picture shape of the target video to be matched with the perspective shape of the target plane area.
Optionally, the display module 505 is specifically configured to obtain the number of bullet screen information generated in unit time in real time;
judging whether the quantity of the bullet screen information generated in the unit time is greater than a preset threshold value or not;
if the quantity of the bullet screen information generated in the unit time is not larger than a preset threshold value, displaying the bullet screen information in the target plane area;
or if the quantity of the bullet screen information generated in the unit time is larger than a preset threshold value, respectively displaying the bullet screen information in the target plane area and other plane areas, wherein the other plane areas are the plane areas except the target plane area in the image picture.
Optionally, the first spatial location information includes a plurality of coordinate points of the target plane area, and the determining module 504 is specifically configured to determine a display plane where the target plane area is located according to the plurality of coordinate points of the target plane area within the visual field of the AR device; determining a preset number of bullet screen planes with included angles with the display plane within a preset angle range; and determining second spatial position information of the bullet screen information to be played according to the bullet screen plane.
Optionally, the apparatus further comprises:
the updating module is used for acquiring coordinate position information of the target plane area in the moved view range when the AR equipment is detected to move;
and updating second spatial position information of the bullet screen information to be played according to the coordinate position information.
An embodiment of the present invention further provides an AR device, as shown in fig. 6, including a processor 601, a communication interface 602, a memory 603, and a communication bus 604, where the processor 601, the communication interface 602, and the memory 603 complete mutual communication through the communication bus 604,
a memory 603 for storing a computer program;
the processor 601 is configured to implement the following steps when executing the program stored in the memory 603:
acquiring an image picture in the current view field of the AR equipment, wherein the image picture is a three-dimensional image picture and comprises one or more plane areas;
acquiring a target plane area which meets the video playing requirement in the image picture, and playing a target video in the target plane area;
acquiring first spatial position information of the target plane area in the image picture, and determining second spatial position information of bullet screen information to be played according to the first spatial position information;
and displaying the bullet screen information to be played according to the second spatial position information.
The communication bus 604 mentioned in the above AR device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus 604 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface 602 is used for communication between the above-described electronic apparatus and other apparatuses.
The Memory 603 may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory 603 may also be at least one storage device located remotely from the aforementioned processor.
The Processor 601 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
The AR equipment provided by the embodiment of the invention can display the bullet screen information to be played in a plane different from the plane where the target video is located, can reduce video pictures blocked by the bullet screen information, and improves user experience.
The embodiment of the invention also provides a computer-readable storage medium, wherein the computer-readable storage medium is stored with instructions, and when the computer-readable storage medium runs on a computer, the computer is enabled to execute the method for displaying bullet screen information provided by the embodiment of the invention.
Specifically, the method for displaying bullet screen information includes:
acquiring an image picture in the current view field of the AR equipment, wherein the image picture is a three-dimensional image picture and comprises one or more plane areas;
acquiring a target plane area which meets the video playing requirement in the image picture, and playing a target video in the target plane area;
acquiring first spatial position information of the target plane area in the image picture, and determining second spatial position information of bullet screen information to be played according to the first spatial position information;
and displaying the bullet screen information to be played according to the second spatial position information.
It should be noted that other implementation manners of the method for displaying bullet screen information are the same as those of the foregoing method embodiment, and are not described herein again.
By operating the instruction stored in the computer-readable storage medium provided by the embodiment of the invention, the bullet screen information to be played can be displayed in a plane different from the plane where the target video is located, so that video pictures blocked by the bullet screen information can be reduced, and the user experience is improved.
Embodiments of the present invention further provide a computer program product containing instructions, which when run on a computer, enable the computer to execute the method for displaying bullet screen information provided by embodiments of the present invention.
Specifically, the method for displaying bullet screen information includes:
acquiring an image picture in the current view field of the AR equipment, wherein the image picture is a three-dimensional image picture and comprises one or more plane areas;
acquiring a target plane area which meets the video playing requirement in the image picture, and playing a target video in the target plane area;
acquiring first spatial position information of the target plane area in the image picture, and determining second spatial position information of bullet screen information to be played according to the first spatial position information;
and displaying the bullet screen information to be played according to the second spatial position information.
It should be noted that other implementation manners of the method for displaying bullet screen information are the same as those of the foregoing method embodiment, and are not described herein again.
By operating the computer program product provided by the embodiment of the invention, the bullet screen information to be played can be displayed in a plane different from the target video, so that video pictures shielded by the bullet screen information can be reduced, and the user experience is improved.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus, AR device, computer-readable storage medium, computer program product embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference may be made to some descriptions of the method embodiments for relevant points.
Claims (13)
1. A method for displaying barrage information, which is applied to an AR (augmented reality) device, comprises the following steps:
acquiring an image picture in the current view field of the AR equipment, wherein the image picture is a three-dimensional image picture and comprises one or more plane areas;
acquiring a target plane area which meets the video playing requirement in the image picture, and playing a target video in the target plane area;
acquiring first spatial position information of the target plane area in the image picture, and determining second spatial position information of bullet screen information to be played according to the first spatial position information; the second spatial position information represents a plane area other than the target plane area in the image screen;
displaying the bullet screen information to be played according to the second spatial position information;
the first spatial position information includes a plurality of coordinate points of the target plane area, the first spatial position information of the target plane area in the image picture is acquired, and the second spatial position information of the bullet screen information to be played is determined according to the first spatial position information, and the method includes:
determining a display plane where the target plane area is located according to a plurality of coordinate points of the target plane area in the visual field range of the AR equipment;
determining a preset number of bullet screen planes with included angles with the display plane within a preset angle range;
and determining second spatial position information of the bullet screen information to be played according to the bullet screen plane.
2. The method according to claim 1, wherein the obtaining of the target plane area in the image frame that meets video playing requirements comprises:
judging whether a first preset direction of the image picture contains a plane area or not;
and if the first preset direction of the image picture contains a plane area, taking the plane area contained in the first preset direction as a target plane area.
3. The method of claim 2, further comprising:
if the first preset direction of the image picture does not contain the plane area, judging whether the second preset direction of the image picture contains the plane area;
if the second preset direction of the image picture contains a plane area, taking the plane area contained in the second preset direction of the image picture as the target plane area;
or, if the second preset direction of the image picture does not contain the plane area, judging whether the third preset direction of the image picture contains the plane area;
and if the third preset direction of the image picture contains a plane area, taking the plane area contained in the third preset direction of the image picture as the target plane area.
4. The method of claim 1, wherein playing the target video in the target plane area comprises:
acquiring the perspective shape of the target plane area;
judging whether the picture shape of the target video is matched with the perspective shape of the target plane area;
and if the picture shape of the target video is not matched with the perspective shape of the target plane area, adjusting the picture shape of the target video so as to enable the picture shape of the target video to be matched with the perspective shape of the target plane area.
5. The method according to any one of claims 1 to 4, wherein the displaying the bullet screen information to be played according to the second spatial position information comprises:
acquiring the quantity of bullet screen information generated in unit time in real time;
judging whether the quantity of the bullet screen information generated in the unit time is greater than a preset threshold value or not;
if the quantity of the bullet screen information generated in the unit time is not greater than a preset threshold value, displaying the bullet screen information to be played in the target plane area;
or if the quantity of the bullet screen information generated in the unit time is greater than a preset threshold value, respectively displaying the bullet screen information to be played in the target plane area and other plane areas, wherein the other plane areas are the plane areas except the target plane area in the image picture.
6. The method of claim 1, further comprising:
when the AR equipment is detected to move, acquiring coordinate position information of the target plane area in the moved view range;
and updating second spatial position information of the bullet screen information to be played according to the coordinate position information.
7. An apparatus for displaying barrage information, the apparatus being applied to an AR device, the apparatus comprising:
the AR equipment comprises an image acquisition module, a display module and a display module, wherein the image acquisition module is used for acquiring an image picture in the current view field range of the AR equipment, the image picture is a three-dimensional image picture, and the image picture comprises one or more plane areas;
the plane acquisition module is used for acquiring a target plane area which meets the video playing requirement in the image picture;
the playing module is used for playing a target video in the target plane area;
the determining module is used for acquiring first spatial position information of the target plane area in the image picture and determining second spatial position information of bullet screen information to be played according to the first spatial position information; the second spatial position information represents a plane area other than the target plane area in the image screen;
the display module is used for displaying the bullet screen information to be played according to the second spatial position information;
the determining module is specifically configured to determine a display plane where the target plane area is located according to a plurality of coordinate points of the target plane area within a visual field range of the AR device; determining a preset number of bullet screen planes with included angles with the display plane within a preset angle range; and determining second spatial position information of the bullet screen information to be played according to the bullet screen plane.
8. The apparatus of claim 7,
the plane acquisition module is specifically used for judging whether a first preset direction of the image picture contains a plane area;
and if the first preset direction of the image picture contains a plane area, taking the plane area contained in the first preset direction as a target plane area.
9. The apparatus of claim 8,
the plane acquisition module is further configured to determine whether a second preset direction of the image picture contains a plane area if the first preset direction of the image picture does not contain the plane area;
if the second preset direction of the image picture contains a plane area, taking the plane area contained in the second preset direction of the image picture as the target plane area;
or, if the second preset direction of the image picture does not contain the plane area, judging whether the third preset direction of the image picture contains the plane area;
and if the third preset direction of the image picture contains a plane area, taking the plane area contained in the third preset direction of the image picture as the target plane area.
10. The apparatus of claim 7,
the playing module is specifically used for acquiring the perspective shape of the target plane area;
judging whether the picture shape of the target video is matched with the perspective shape of the target plane area;
and if the picture shape of the target video is not matched with the perspective shape of the target plane area, adjusting the picture shape of the target video so as to enable the picture shape of the target video to be matched with the perspective shape of the target plane area.
11. The apparatus according to any one of claims 7 to 10,
the display module is specifically used for acquiring the quantity of the bullet screen information generated in unit time in real time;
judging whether the quantity of the bullet screen information generated in the unit time is greater than a preset threshold value or not;
if the quantity of the bullet screen information generated in the unit time is not greater than a preset threshold value, displaying the bullet screen information to be played in the target plane area;
or if the quantity of the bullet screen information generated in the unit time is greater than a preset threshold value, respectively displaying the bullet screen information to be played in the target plane area and other plane areas, wherein the other plane areas are the plane areas except the target plane area in the image picture.
12. The apparatus of claim 7, further comprising:
the updating module is used for acquiring coordinate position information of the target plane area in the moved view range when the AR equipment is detected to move;
and updating second spatial position information of the bullet screen information to be played according to the coordinate position information.
13. An AR device, which is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
the memory is used for storing a computer program;
the processor, when executing the program stored in the memory, implementing the method steps of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810185259.6A CN108347657B (en) | 2018-03-07 | 2018-03-07 | Method and device for displaying bullet screen information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810185259.6A CN108347657B (en) | 2018-03-07 | 2018-03-07 | Method and device for displaying bullet screen information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108347657A CN108347657A (en) | 2018-07-31 |
| CN108347657B true CN108347657B (en) | 2021-04-20 |
Family
ID=62956475
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810185259.6A Active CN108347657B (en) | 2018-03-07 | 2018-03-07 | Method and device for displaying bullet screen information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108347657B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108924510B (en) * | 2018-08-06 | 2020-12-22 | 百度在线网络技术（北京）有限公司 | Data processing method and device for real-time image, terminal and network equipment |
| CN112702643B (en) | 2019-10-22 | 2023-07-21 | 上海哔哩哔哩科技有限公司 | Barrage information display method and device and mobile terminal |
| CN110784733B (en) * | 2019-11-07 | 2021-06-25 | 广州虎牙科技有限公司 | Live broadcast data processing method and device, electronic equipment and readable storage medium |
| CN110719493A (en) * | 2019-11-07 | 2020-01-21 | 广州虎牙科技有限公司 | Barrage display method and device, electronic equipment and readable storage medium |
| CN110856005B (en) * | 2019-11-07 | 2021-09-21 | 广州虎牙科技有限公司 | Live stream display method and device, electronic equipment and readable storage medium |
| CN110928627B (en) * | 2019-11-22 | 2023-11-24 | 北京市商汤科技开发有限公司 | Interface display method and device, electronic equipment and storage medium |
| CN111225287A (en) * | 2019-11-27 | 2020-06-02 | 网易（杭州）网络有限公司 | Bullet screen processing method and device, electronic equipment and storage medium |
| CN113766336B (en) * | 2020-06-04 | 2023-09-22 | 腾讯科技（深圳）有限公司 | Video playing control method and device, computer equipment and storage medium |
| CN112596609A (en) * | 2020-12-25 | 2021-04-02 | 维沃移动通信有限公司 | Display processing method, display processing device and wearable equipment |
| CN112954437B (en) * | 2021-02-02 | 2022-10-28 | 深圳市慧鲤科技有限公司 | Video resource processing method and device, computer equipment and storage medium |
| CN114374882A (en) * | 2021-12-23 | 2022-04-19 | 咪咕文化科技有限公司 | Barrage information processing method and device, terminal and computer-readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106792096A (en) * | 2016-12-28 | 2017-05-31 | 苏州商信宝信息科技有限公司 | A kind of augmented reality method and its system based on barrage |
| CN106993234A (en) * | 2017-03-22 | 2017-07-28 | 北京潘达互娱科技有限公司 | Barrage display methods and device |
| CN107181976A (en) * | 2017-04-28 | 2017-09-19 | 华为技术有限公司 | A kind of barrage display methods and electronic equipment |
| CN107229880A (en) * | 2017-05-12 | 2017-10-03 | 深圳市博巨兴实业发展有限公司 | A kind of microprocessor chip with user security debugging function |
| CN107484036A (en) * | 2017-09-07 | 2017-12-15 | 深圳市迅雷网络技术有限公司 | A kind of barrage display methods and device |
| CN107656623A (en) * | 2017-10-30 | 2018-02-02 | 成都极致空觉科技有限公司 | AR systems for power transformation inspection |
| CN107683497A (en) * | 2015-06-15 | 2018-02-09 | 索尼公司 | Message processing device, information processing method and program |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9997199B2 (en) * | 2014-12-05 | 2018-06-12 | Warner Bros. Entertainment Inc. | Immersive virtual reality production and playback for storytelling content |
-
2018
- 2018-03-07 CN CN201810185259.6A patent/CN108347657B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107683497A (en) * | 2015-06-15 | 2018-02-09 | 索尼公司 | Message processing device, information processing method and program |
| CN106792096A (en) * | 2016-12-28 | 2017-05-31 | 苏州商信宝信息科技有限公司 | A kind of augmented reality method and its system based on barrage |
| CN106993234A (en) * | 2017-03-22 | 2017-07-28 | 北京潘达互娱科技有限公司 | Barrage display methods and device |
| CN107181976A (en) * | 2017-04-28 | 2017-09-19 | 华为技术有限公司 | A kind of barrage display methods and electronic equipment |
| CN107229880A (en) * | 2017-05-12 | 2017-10-03 | 深圳市博巨兴实业发展有限公司 | A kind of microprocessor chip with user security debugging function |
| CN107484036A (en) * | 2017-09-07 | 2017-12-15 | 深圳市迅雷网络技术有限公司 | A kind of barrage display methods and device |
| CN107656623A (en) * | 2017-10-30 | 2018-02-02 | 成都极致空觉科技有限公司 | AR systems for power transformation inspection |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108347657A (en) | 2018-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108347657B (en) | Method and device for displaying bullet screen information | |
| US10970915B2 (en) | Virtual viewpoint setting apparatus that sets a virtual viewpoint according to a determined common image capturing area of a plurality of image capturing apparatuses, and related setting method and storage medium | |
| US11282264B2 (en) | Virtual reality content display method and apparatus | |
| WO2020248900A1 (en) | Panoramic video processing method and apparatus, and storage medium | |
| EP2843625A1 (en) | Method for synthesizing images and electronic device thereof | |
| US11477432B2 (en) | Information processing apparatus, information processing method and storage medium | |
| CN113223130B (en) | Path roaming method, terminal equipment and computer storage medium | |
| CN114416244B (en) | Information display method and device, electronic equipment and storage medium | |
| CN111526328A (en) | Video monitoring inspection method, device, terminal and storage medium | |
| CN110286906B (en) | User interface display method and device, storage medium and mobile terminal | |
| CN113559501B (en) | Virtual unit selection method and device in game, storage medium and electronic equipment | |
| CN111078090A (en) | Display method, device, equipment and storage medium | |
| US11062422B2 (en) | Image processing apparatus, image communication system, image processing method, and recording medium | |
| CN113905211A (en) | Video patrol method, device, electronic equipment and storage medium | |
| CN114511684A (en) | Scene switching method and device, electronic equipment and storage medium | |
| WO2023197912A1 (en) | Image processing method and apparatus, device, storage medium, and program product | |
| CN113205573A (en) | Image display method and device, image processing equipment and storage medium | |
| WO2017024954A1 (en) | Method and device for image display | |
| WO2023005659A1 (en) | Image processing method and apparatus, electronic device, computer-readable storage medium, computer program, and computer program product | |
| CN113344957B (en) | Image processing method, image processing apparatus, and non-transitory storage medium | |
| CN116801027A (en) | Display device and screen projection method | |
| US10419666B1 (en) | Multiple camera panoramic images | |
| CN109472873B (en) | Three-dimensional model generation method, device and hardware device | |
| CN112465692A (en) | Image processing method, device, equipment and storage medium | |
| CN111950420A (en) | Obstacle avoidance method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |