CN112612390B - Display method and device, and storage medium - Google Patents

Display method and device, and storage medium Download PDF

Info

Publication number
CN112612390B
CN112612390B CN202011580341.2A CN202011580341A CN112612390B CN 112612390 B CN112612390 B CN 112612390B CN 202011580341 A CN202011580341 A CN 202011580341A CN 112612390 B CN112612390 B CN 112612390B
Authority
CN
China
Prior art keywords
displayed
card
action
display
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011580341.2A
Other languages
Chinese (zh)
Other versions
CN112612390A (en
Inventor
何宝通
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202011580341.2A priority Critical patent/CN112612390B/en
Publication of CN112612390A publication Critical patent/CN112612390A/en
Application granted granted Critical
Publication of CN112612390B publication Critical patent/CN112612390B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The disclosure relates to a display method and device and a storage medium. The method is applied to terminal equipment with a screen, and comprises the following steps: acquiring an action area and an action position of an operation object acting on the screen; obtaining a card to be displayed according to the content of the action area; determining the display position of the card to be displayed according to the action position; and displaying the card to be displayed in the display position in a floating manner. The display position of the card to be displayed can be changed along with the change of the action position, and the card to be displayed can be displayed at different positions of the screen, so that the card to be displayed is more flexible to display.

Description

Display method and device, and storage medium
Technical Field
The present disclosure relates to the field of information processing technologies, and in particular, to a display method and apparatus, and a storage medium.
Background
With the rapid development of terminal equipment, the functions of the terminal equipment are more and more abundant. Such as a transfer gate function on the terminal device. The function of the delivery door can intelligently analyze the content of the action area and pop up a corresponding card to be displayed on a screen, wherein the card is related to the information of the content, such as movie reviews, encyclopedias, maps, word segmentation search and the like. However, the cards to be displayed popped up by the existing transfer gate function are usually displayed in a full screen mode or in a fixed position, for example, the cards to be displayed are fixedly displayed on the bottom of the screen or on the side of the screen, which has a problem that the display mode of the cards to be displayed is fixed.
Disclosure of Invention
The disclosure provides a display method and apparatus, and a storage medium.
According to a first aspect of the embodiments of the present disclosure, there is provided a display method applied to a terminal device having a screen, including:
acquiring an action area and an action position of an operation object acting on the screen;
obtaining a card to be displayed according to the content of the action area;
determining the display position of the card to be displayed according to the action position;
and displaying the card to be displayed in the display position in a floating manner.
In some embodiments, the method further comprises:
and determining the display position of the card to be displayed according to the action position and the card to be displayed.
In some embodiments, the determining the display position of the card to be displayed according to the action position and the card to be displayed includes:
determining a first distance from the action position to the first side edge and a projection position of the action position to the second side edge based on the action position;
when the first distance is larger than or equal to the height of the card to be displayed, determining the display position based on the projection position;
and when the first distance is smaller than the height of the card to be displayed, taking the pop-up position on the second side edge as the display position, wherein the second distance from the pop-up position to the first side edge is larger than or equal to the height of the card to be displayed.
In some embodiments, the method further comprises:
and when the action area and the action position are acquired, displaying a preloaded animation on the screen in a suspension mode.
In some embodiments, the card to be displayed is a plurality of cards, the displaying the card to be displayed in the display position in a floating manner comprises:
arranging a plurality of cards to be displayed at intervals along the side edge of the screen, and displaying the arranged cards at the display position in a suspending manner;
or,
and sequentially superposing a plurality of the cards to be displayed from wide to narrow according to the width of the cards to be displayed, and displaying the superposed cards at the display position in a suspension manner.
In some embodiments, the obtaining a card to be displayed according to the content of the action region includes:
when the content is captured in the action area and is a text, acquiring the card to be displayed based on the text;
when the content is captured in the action area and is a picture, acquiring the card to be displayed based on the picture;
and when the content is not captured in the action area, capturing the content in the action area, and acquiring the card to be displayed based on the captured image.
In some embodiments, the method further comprises:
displaying an identification option box identifying the content;
when the identification option frame is detected to move from the first position to the second position, picture identification is selected to obtain the card to be displayed.
In some embodiments, the method further comprises:
acquiring action time and/or action force of the operation object acting on the screen;
and when the action time is greater than a preset time threshold and/or the action force is greater than a preset action threshold, triggering the terminal equipment to acquire the card to be displayed and the display position.
According to a second aspect of the embodiments of the present disclosure, there is provided a display device, the device including:
the first acquisition module is configured to acquire an acting area and an acting position of an operation object acting on the screen;
the second acquisition module is configured to acquire a card to be displayed according to the content of the action area;
the first determination module is configured to determine the display position of the card to be displayed according to the action position;
the first display module is configured to display the card to be displayed in a floating mode in the display position.
In some embodiments, the apparatus further comprises:
the second determining module is configured to determine the display position of the card to be displayed according to the action position and the card to be displayed.
In some embodiments, the second determining module is further configured to determine, based on the action position, a first distance from the action position to the first side and a projection position of the action position to the second side, where the screen includes the first side and the second side adjacent to the first side; when the first distance is larger than or equal to the height of the card to be displayed, determining the display position based on the projection position; and when the first distance is smaller than the height of the card to be displayed, taking the pop-up position on the second side edge as the display position, wherein the second distance from the pop-up position to the first side edge is larger than or equal to the height of the card to be displayed.
In some embodiments, the apparatus further comprises:
and the second display module is configured to display a preloaded animation in a suspension mode on the screen when the action region and the action position are acquired.
In some embodiments, the first display module is further configured to arrange a plurality of the cards to be displayed at intervals along the side edge of the screen, and display the arranged cards in a floating manner at the display position; or sequentially overlapping a plurality of cards to be displayed from wide to narrow according to the width of the cards to be displayed, and displaying the overlapped cards at the display position in a suspension manner.
In some embodiments, the second obtaining module is further configured to, when the content is captured in the action area and the content is a text, obtain the card to be displayed based on the text; when the content is captured in the action area and is a picture, acquiring the card to be displayed based on the picture; and when the content is not captured in the action area, capturing the content in the action area, and acquiring the card to be displayed based on the captured image.
In some embodiments, the apparatus further comprises:
a third display module configured to display an identification option box identifying the content;
and the selection module is configured to select picture recognition to acquire the card to be displayed when the recognition option frame is detected to move from the first position to the second position.
In some embodiments, the apparatus further comprises:
the third acquisition module is configured to acquire acting time and/or acting force of the operation object acting on the screen;
the triggering module is configured to trigger the terminal equipment to acquire the card to be displayed and the display position when the action time is greater than a preset time threshold and/or the action force is greater than a preset action threshold.
According to a third aspect of the embodiments of the present disclosure, there is provided a display device including at least: a processor and a memory for storing executable instructions operable on the processor, wherein:
the processor is configured to execute the executable instructions, and the executable instructions perform the steps of the display method provided in the first aspect.
According to a fourth aspect of embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium having stored therein computer-executable instructions that, when executed by a processor, implement the display method as provided in the first aspect above.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
in the embodiment of the disclosure, the terminal device firstly acquires the card to be displayed, then determines the display position of the card to be displayed according to the action position, and then displays the card to be displayed in the display position in a suspending manner. That is, the display position of the card to be displayed is associated with the action position of the action screen of the operation object, and the display position of the card to be displayed can be changed along with the change of the action position, but is not fixedly displayed on the screen. So, the card of waiting to demonstrate of this disclosure embodiment can show the different positions at the screen for the demonstration of waiting to demonstrate the card is more nimble, can be applicable to different display scenes.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a first flowchart illustrating a display method according to an embodiment of the disclosure.
Fig. 2 is a first schematic view of a fixed display of a card to be displayed according to an embodiment of the present disclosure.
Fig. 3 is a schematic view illustrating a card to be displayed in a fixed display manner according to the embodiment of the disclosure.
Fig. 4 is a display diagram of a card to be displayed according to an action position, which is shown in the embodiment of the disclosure.
Fig. 5a is a flowchart of a display method according to an embodiment of the disclosure.
Fig. 5b is a flowchart of a display method shown in the embodiment of the present disclosure.
Fig. 5c is a flowchart of a display method according to a fourth embodiment of the disclosure.
Fig. 6 is a first schematic diagram of a display device according to an embodiment of the disclosure.
Fig. 7 is a schematic diagram of a display device shown in the embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
Fig. 1 is a schematic flow chart of a display method shown in an embodiment of the present disclosure, and as shown in fig. 1, a method applied to a terminal device having a screen includes the following steps:
s101, acquiring an action area and an action position of an operation object acting on the screen;
s102, obtaining a card to be displayed according to the content of the action area;
s103, determining the display position of the card to be displayed according to the action position;
s104, displaying the card to be displayed in the display position in a suspension manner.
Above-mentioned terminal equipment is for being provided with the terminal equipment of screen, and this terminal equipment can be wearable electronic equipment and mobile terminal, and this mobile terminal includes cell-phone, notebook and panel computer, and this wearable electronic equipment includes intelligent wrist-watch or intelligent bracelet, and this disclosed embodiment does not do the restriction.
In the embodiment of the disclosure, the display method is suitable for a scene in which the cards to be displayed are popped up on different display interfaces of the terminal equipment. For example, a card to be shown related to the interface content is popped up on the WeChat chat interface, or a card to be shown related to the interface content is popped up on the Baidu aware interface. Wherein, being related to the interface content comprises: commodity information corresponding to the content, translation information corresponding to the content, or identification object information corresponding to the content, which is not limited in the embodiments of the present disclosure.
In step S101, the operation object acts on the screen, including: the operation object presses the screen. The operation object may be a user using the terminal device, and may also be a touch pen for touching a screen in the terminal device. The duration of the screen pressed by the operation object is greater than or equal to a duration threshold, and the duration threshold may be set according to actual conditions, for example, the duration threshold may be in a range from 1.5 seconds to 5 seconds, and the embodiment of the present disclosure is not limited.
The action position is a position where the operation object acts on the screen. For example, the action position is a pressing position where an operation object presses a screen, or a touch position where a stylus touches the screen, and the embodiments of the present disclosure are not limited.
The action region may be a region where the action position is located, for example, a region where a segment of text corresponding to the action position is located is taken as the action region, or a region where a picture corresponding to the action position is located is taken as the action region; the scope may also be a region selected on the screen during the operation of the object on the screen, for example, when the screen is pressed, two selected pointers are displayed on the screen, and by dragging the two selected pointers, the region between the two selected pointers is used as the scope.
In step S102, obtaining a card to be displayed according to the content of the action area, including: and sending the content of the action area to a server, and intelligently analyzing the content through a receiving server to obtain the card to be displayed. Wherein the intelligent analysis comprises word segmentation or intention analysis. The card to be displayed can be obtained and sent to the terminal device directly for server intelligent analysis, and can also be formed by the terminal device based on intelligent analysis result manufacturing, and the embodiment of the disclosure is not limited.
The content of the action area can comprise text and pictures. The text may include text in different formats, such as word text, wps text, or text in notepad format; the text may also be composed of numbers, words or symbols of different languages. The pictures include, but are not limited to, screenshots, photographs, or mosaic, and embodiments of the present disclosure are not limited.
The card to be displayed can be a card for displaying the content with the analysis action area, and can comprise a recommended type card for information recommendation or a participle type card for keyword analysis. For example, a recommended type of card may include: the card can display Taobao commodities in Taobao application, map navigation in Baidu map application or restaurants in popular comment application. The word segmentation type card may include: a card capable of displaying keyword translation or a card capable of displaying keyword encyclopedia interpretation, which is not limited in the embodiments of the present disclosure.
In step S103, determining a display position of the card to be displayed according to the action position includes: taking the action position as a display position; or acquiring a projection position projected by the action position to a side frame of the screen based on the action position, and taking the projection position as the display position; or, a first position of the side frame of the screen is taken as the display position, wherein the first position is different from the projection position, and the distance from the first position to the action position is within a distance threshold range. The screen may be rectangular and the screen side frame may include a screen long frame or a screen short frame.
It should be noted that the display position may change following the change of the action position. For example, when the action location is near the bottom of the screen, the presentation location is also near the bottom of the screen; when the action position is close to the top of the screen, the display position is also close to the top of the screen, and the disclosed embodiment is not limited.
In step S104, after the floating display, the user can directly enter the associated interface corresponding to the card to be displayed by clicking the card to be displayed. For example, clicking a card of the treasure washing commodity can directly jump to a treasure washing commodity detail page; and clicking the restaurant card for public comment can directly jump to the detail page of the restaurant in the public comment interface.
In the embodiment of the disclosure, the suspension display is that the card to be displayed is suspended on the interface where the content of the action area is located, and the card to be displayed can shield the interface where the content of the action area is located.
It should be noted that the width of the card to be displayed and the height of the card to be displayed may be set according to practical situations, for example, the width of the card to be displayed may be set in a range from 2 centimeters to 5 centimeters, and the height of the card to be displayed may be set in a range from 1 centimeter to 3 centimeters, which is not limited in the embodiments of the present disclosure.
Exemplarily, as shown in fig. 2 and fig. 3, a mobile phone in a picture is intelligently analyzed to obtain a plurality of different cards to be displayed, such as coupons, historical prices, or comparison of the same type, and the plurality of different cards to be displayed are fixedly displayed on a side of a terminal device, so that a problem of fixing a display mode of the cards to be displayed exists.
Based on this, the embodiment of the present disclosure proposes to obtain the card to be displayed first, determine the display position of the card to be displayed according to the action position, and display the card to be displayed in the display position in a floating manner. That is, the display position of the card to be displayed is associated with the action position of the action screen of the operation object, and the display position of the card to be displayed can be changed along with the change of the action position, but is not fixedly displayed on the screen. So, the card of waiting to demonstrate of this disclosure embodiment can show the different positions at the screen for the demonstration of waiting to demonstrate the card is more nimble, can be applicable to different display scenes.
Through verification, the display position of the card to be displayed in the terminal equipment can be changed along with the change of the action position, and is not fixedly displayed on a screen. As shown in fig. 4, the display position of the card to be displayed surrounds the active position. When the action position changes, the display position of the card to be displayed also changes.
In some embodiments, the display position of the card to be displayed is determined according to the action position and the card to be displayed.
In the embodiment of the present disclosure, acquiring the card to be displayed includes acquiring the display content of the card to be displayed, the height of the card to be displayed, and the width of the card to be displayed.
The above-mentioned show position according to action position and the card that waits to show, the card that confirms to wait to show can include: determining the display position of the card to be displayed according to the action position and the height of the card to be displayed; or determining the display position of the card to be displayed according to the action position and the width of the card to be displayed.
Wherein, according to the width of action position and waiting to show the card, confirm to wait to show the show position of card and include: when the width of the card to be displayed is larger than that of the screen, the card to be displayed can be switched from the display of the second side edge of the screen to the display of the first side edge of the screen. The shape of the screen is rectangular, the second side edge is the long side of the screen, and the first side edge is the short side of the screen.
In the embodiment of the disclosure, the height and the width of the card to be displayed are considered in the process of obtaining the display position, so that the card to be displayed can be completely displayed in the height direction or the width direction, and the condition that the card to be displayed is shielded in the height direction or the width direction is reduced.
In some embodiments, the determining the display position of the card to be displayed according to the action position and the card to be displayed includes:
determining a first distance from the action position to the first side edge and a projection position of the action position to the second side edge based on the action position;
when the first distance is larger than or equal to the height of the card to be displayed, determining the display position based on the projection position;
and when the first distance is smaller than the height of the card to be displayed, taking the pop-up position on the second side edge as the display position, wherein the second distance from the pop-up position to the first side edge is larger than or equal to the height of the card to be displayed.
The first side edge may be an edge at the bottom of the screen or an edge at the top of the screen. The second side edge is an edge of the bottom of the screen and an edge of the top of the screen. The first side edge and the second side edge are perpendicular to each other. When the screen is rectangular, the first side may be a short side of the screen, and the second side may be a long side of the screen.
The determining the display position based on the projection position includes: when the first distance is larger than or equal to the height of the cards to be displayed and one card to be displayed is arranged, taking the projection position as a display position; when the first distance is larger than the height of the cards to be displayed and the cards to be displayed are multiple, determining a third distance based on the difference between the first distance and the height of the cards to be displayed, and taking the position, from the second side edge to the projection position, of which the distance is smaller than or equal to the third distance as a display position; when the first distance is equal to the height of the cards to be displayed and the cards to be displayed are multiple, the position from the projection position on the second side edge to the position between the third side edges can be used as the display position.
When the position from the second side edge to the projection position is smaller than or equal to the third distance is taken as the display position, the display positions of the cards to be displayed can be symmetrically arranged on the two opposite sides of the projection position by taking the projection position as a center of symmetry. The third side edge and the first side edge are opposite side edges, and the third side edge and the second side edge are adjacent side edges.
In the embodiment of the disclosure, whether the card to be displayed can be shielded in the height direction or not is directly influenced by the first distance from the action position to the first side edge, so that the display position can be timely adjusted based on the first distance, the card to be displayed can be completely displayed in the height direction, and the shielded situation is reduced. For example, when the first distance is smaller than the height of the card to be displayed, if the projection position is taken as the display position, the card to be displayed is shielded in the height direction, and therefore, the second distance from the pop-up position to the first side is greater than or equal to the width of the card to be displayed, so that the pop-up position is taken as the display position, the condition that the card to be displayed is shielded can be reduced, and the experience of a user viewing the card to be displayed can be improved.
In some embodiments, the method further comprises:
and when the action area and the action position are acquired, displaying a preloaded animation on the screen in a suspension mode.
In the embodiment of the disclosure, the preloading animation is displayed on the screen in a floating manner, and the terminal equipment enters the preloading state. At this time, the terminal device is performing a preparation operation for displaying the card to be displayed in a floating manner, for example, the preparation operation may be to start a floating window function of the terminal device, establish a communication connection with the server, or set a response time of the server, and when the response time exceeds a response threshold, the card to be displayed is directly acquired based on the terminal device, which is not limited in the embodiment of the present disclosure.
It should be noted that, the terminal device according to the embodiment of the present disclosure does not execute the loading of the card to be displayed after acquiring the card to be displayed, but enters the preloading of the card to be displayed in the waiting process of acquiring the card to be displayed, so that the response speed of the terminal device for displaying the card to be displayed in a floating manner can be increased.
In the embodiment of the present disclosure, the preloaded animation may be set according to actual situations, for example, the preloaded animation may be a rotation animation of a circle surrounded by points, and may also be an animation of repeated jumping of points, which is not limited in the embodiment of the present disclosure.
In some embodiments, the card to be displayed is a plurality of cards, the displaying the card to be displayed in the display position in a floating manner comprises:
arranging a plurality of cards to be displayed at intervals along the side edge of the screen, and displaying the arranged cards at the display position in a suspending manner;
or,
and sequentially superposing a plurality of the cards to be displayed from wide to narrow according to the width of the cards to be displayed, and displaying the superposed cards at the display position in a suspension manner.
The aforesaid is arranged a plurality of in-process of waiting to demonstrate the card along the screen side interval, and the spacing distance between two adjacent waiting to demonstrate the card can set up according to the quantity of waiting to demonstrate the card. For example, the number of cards to be displayed is inversely related to the spacing distance, with a greater number of cards to be displayed corresponding to a shorter spacing distance. So, set up spacing distance according to the quantity of waiting to demonstrate the card, can be suitable for the different scene of waiting to demonstrate the card under the different conditions for terminal equipment can be better arrange and wait to demonstrate the card. Of course, the terminal device may also be set to a fixed separation distance. For example, the separation distance is in the range of 0.2 mm to 0.8 mm, and embodiments of the present disclosure are not limited.
In the embodiment of the present disclosure, when the shape of the screen is a rectangle, the side of the screen may be a long side of the screen or a short side of the screen, and the embodiment of the present disclosure is not limited.
Above-mentioned width according to waiting to demonstrate the card from wide to narrow superposes a plurality of cards of waiting to demonstrate in proper order, includes: stacking a plurality of cards to be displayed in sequence from wide to narrow by taking the center of the cards to be displayed as a stacking alignment center; or, the side edges of the screen are used as superposition alignment side edges to superpose a plurality of cards to be displayed in sequence from wide to narrow. The disclosed embodiments are not limiting.
In the embodiment of the disclosure, the card to be displayed with the widest width is positioned at the bottom layer of the stacked cards, and the card to be displayed with the narrowest width is positioned at the top layer of the stacked cards.
It should be noted that, when the cards to be displayed are multiple, the multiple cards to be displayed can be displayed at the display position in different display modes, so that the display modes of the multiple cards to be displayed are richer, and the user experience is improved.
In some embodiments, the obtaining a card to be displayed according to the content of the action region includes:
when the content is captured in the action area and is a text, acquiring the card to be displayed based on the text;
when the content is captured in the action area and is a picture, obtaining the card to be displayed based on the picture;
when the content is not captured in the action area, capturing the content in the action area, and acquiring the card to be displayed based on the captured content.
In the embodiment of the disclosure, the content can be captured in the action area through the content capturer of the terminal equipment. The captured content includes text or pictures, and the embodiments of the present disclosure are not limited.
The screenshot of the content of the action area includes: and starting a screenshot device when the content is determined not to be captured, capturing a current interface through the screenshot device, and cutting the current interface according to the action area so as to capture the content of the action area.
The obtaining of the card to be displayed based on the text includes identifying the text through a text recognition algorithm to obtain the card to be displayed. The obtaining of the card to be displayed based on the picture or the screenshot comprises identifying the picture or the screenshot through an image recognition algorithm to obtain the card to be displayed. The image Recognition algorithm and the text Recognition algorithm may both be Optical Character Recognition (OCR) algorithms.
In the embodiment of the disclosure, the terminal device can acquire the card to be displayed respectively based on the captured text or the captured picture, and also can acquire the card to be displayed through the screenshot when the card is not captured, so that the acquisition mode of the card to be displayed is more flexible, and the card to be displayed can be suitable for different capture conditions.
In some embodiments, the method further comprises:
displaying an identification option box identifying the content;
when the identification option frame is detected to move from the first position to the second position, picture identification is selected to obtain the card to be displayed.
In the embodiment of the disclosure, the terminal device displays the identification frame. The identification option box includes a text identification option box or a picture identification option box, and the embodiments of the present disclosure are not limited.
It should be noted that, when it is detected that the identification option box moves from the first position to the second position, it indicates that the current identification method may not meet the requirement, and the identification method needs to be switched. At this time, the terminal device is switched to image recognition by default to acquire the card to be displayed, so that the recognition mode of the terminal device is not selected based on the type of the content, for example, the corresponding text recognition when the content is a text or the corresponding image recognition when the content is an image, but the recognition mode can be adjusted in time according to the recognition result or the user requirement. Therefore, the identification mode of the terminal equipment is more flexible, the user requirements can be better met, and the user experience is improved.
In some embodiments, the method further comprises:
acquiring action time and/or action force of the operation object acting on the screen;
and when the action time is greater than a preset time threshold and/or the action force is greater than a preset action threshold, triggering the terminal equipment to acquire the card to be displayed and the display position.
In the embodiment of the disclosure, the acting time of the screen can be determined by a timer of the terminal device, and the acting force of the screen can be determined by the pressure sensor.
The preset time threshold and the preset action threshold may be set according to actual conditions, for example, the preset time threshold may be set in a range from 0.5 second to 2 seconds, and the action threshold may be set in a range from 0.5 n to 5 n, which is not limited in the embodiments of the present disclosure.
In the embodiment of the disclosure, whether the action time is greater than the preset time threshold value or not and whether the action force is greater than the preset action threshold value or not can be determined, whether the action object acts on the screen to trigger the acquisition of the card to be displayed and the display position in the embodiment of the disclosure or not can be determined, so that misoperation can be prevented.
To facilitate a better understanding of the present application, embodiments of the present disclosure are exemplified as follows:
the terminal equipment has a transfer gate function, and can acquire an action area and an action position of an operation object acting on a screen through the transfer gate function; obtaining a card to be displayed according to the content of the action area; determining the display position of the card to be displayed according to the action position; and finally, the card to be displayed is displayed in a display position in a suspension manner, so that the effect position of the card to be displayed following a person is displayed.
As shown in fig. 5a, the terminal device may trigger a transfer gate function 204 of the terminal device by a gesture 201 or a hover ball 202 or a sweep 203 of the current interface in the screen of the terminal device.
As shown in fig. 5b, the terminal device may capture the content of the active area through the content capturer to identify the active area, including the following steps: s301, starting a content capturer; s302, judging whether the content is captured in the action area, if so, turning to the step S303 and the step S304; if not, go to step S305; s303, the content is a picture; s304, the content is a text; s305, screenshot is conducted on the action area; s306, text recognition; and S307, identifying the picture. Therefore, the terminal equipment can acquire the cards to be displayed respectively based on the captured texts or pictures, and also can acquire the cards to be displayed through the screenshot when the cards are not captured, so that the acquisition mode of the cards to be displayed is more flexible, and the card capturing method can be suitable for different capturing conditions.
Wherein the content of the action area can be obtained through a content capturer and a picture cutter. In the process of identifying and acquiring the cards to be displayed, the content capturer and the screenshot device can transmit the content of the action area to the transmission gate through the Binder technology, so that the transmission gate can acquire the cards to be displayed based on the content of the action area.
As shown in fig. 5c, in the process of displaying the card to be displayed in a floating manner at the display position, the terminal device identification process includes: step S401, displaying an identification option frame for identifying content; s402, when the recognition option frame is detected to move from the first position to the second position, selecting picture recognition to obtain the card to be displayed. Therefore, the identification mode of the terminal equipment is not selected to be a default identification mode based on the type of the content, but can be adjusted in time according to the identification result or the user requirement, so that the identification mode of the terminal equipment is more flexible, the user requirement can be better met, and the user experience is improved.
Fig. 6 is a diagram of a display device i according to an exemplary embodiment. Referring to fig. 6, the display apparatus includes a first obtaining module 1001, a second obtaining module 1002, a first determining module 1003, and a first displaying module 1004, wherein,
a first obtaining module 1001 configured to obtain an acting region and an acting position where an operation object acts on the screen;
a second obtaining module 1002, configured to obtain a card to be displayed according to the content of the action area;
a first determining module 1003 configured to determine a display position of the card to be displayed according to the action position;
the first display module 1004 is configured to display the card to be displayed in a floating manner in the display position.
In some embodiments, the apparatus further comprises:
and the second determination module is configured to determine the display position of the card to be displayed according to the action position and the card to be displayed.
In some embodiments, the second determining module is further configured to determine, based on the action position, a first distance from the action position to the first side and a projection position of the action position to the second side, where the screen includes the first side and the second side adjacent to the first side; when the first distance is larger than or equal to the height of the card to be displayed, determining the display position based on the projection position; and when the first distance is smaller than the height of the card to be displayed, taking the pop-up position on the second side edge as the display position, wherein the second distance from the pop-up position to the first side edge is larger than or equal to the height of the card to be displayed.
In some embodiments, the apparatus further comprises:
and the second display module is configured to display a preloaded animation in a suspension mode on the screen when the action region and the action position are acquired.
In some embodiments, the first display module is further configured to arrange a plurality of the cards to be displayed at intervals along the side edge of the screen, and display the arranged cards in a floating manner at the display position; or sequentially overlapping a plurality of cards to be displayed from wide to narrow according to the width of the cards to be displayed, and displaying the overlapped cards at the display position in a suspension manner.
In some embodiments, the second obtaining module is further configured to, when the content is captured in the action area and the content is a text, obtain the card to be displayed based on the text; when the content is captured in the action area and is a picture, acquiring the card to be displayed based on the picture; and when the content is not captured in the action area, capturing the content in the action area, and acquiring the card to be displayed based on the captured image.
In some embodiments, the apparatus further comprises:
a third display module configured to display an identification option box identifying the content;
and the selecting module is configured to select picture recognition to acquire the card to be displayed when the recognition option frame is detected to move from the first position to the second position.
In some embodiments, the apparatus further comprises:
the third acquisition module is configured to acquire acting time and/or acting force of the operation object acting on the screen;
the triggering module is configured to trigger the terminal equipment to acquire the card to be displayed and the display position when the action time is greater than a preset time threshold and/or the action force is greater than a preset action threshold.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
FIG. 7 is a diagram illustrating a second display device according to an exemplary embodiment. For example, the device may be a mobile phone, a mobile computer, etc.
Referring to fig. 7, an apparatus may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.
The processing component 802 generally controls overall operation of the device, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the device. Examples of such data include instructions for any application or method operating on the device, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 may be implemented by any type or combination of volatile and non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power component 806 provides power to various components of the device. The power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for a device.
The multimedia component 808 includes a screen that provides an output interface between the device and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device is in an operational mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 814 includes one or more sensors for providing status assessment of various aspects of the device. For example, the sensor assembly 814 may detect the on/off status of the device, the relative positioning of the components, such as the display and keypad of the apparatus, the sensor assembly 814 may also detect a change in the position of the apparatus or a component of the apparatus, the presence or absence of user contact with the apparatus, the orientation or acceleration/deceleration of the apparatus, and a change in the temperature of the apparatus. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communication between the apparatus and other devices in a wired or wireless manner. The device may access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the apparatus to perform the method described above is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium having instructions therein which, when executed by a processor of a terminal device, enable the terminal device to acquire the card to be displayed and the display position method, the method comprising:
acquiring an action area and an action position of an operation object acting on the screen;
obtaining a card to be displayed according to the content of the action area;
determining the display position of the card to be displayed according to the action position;
and displaying the card to be displayed in the display position in a floating manner.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims (16)

1. A display method is applied to a terminal device with a screen, and comprises the following steps:
acquiring an action area and an action position of an operation object acting on the screen;
obtaining a card to be displayed according to the content of the action area;
determining the display position of the card to be displayed according to the action position and the size of the card to be displayed; wherein the size of the card to be displayed comprises the width of the card to be displayed or the height of the card to be displayed; and displaying the card to be displayed in the display position in a floating manner.
2. The method of claim 1, wherein the screen includes a first side and a second side adjacent to the first side, and wherein determining the display position of the card to be displayed based on the actuation position and the size of the card to be displayed comprises:
determining a first distance from the action position to the first side edge and a projection position of the action position to the second side edge based on the action position;
when the first distance is larger than or equal to the height of the card to be displayed, determining the display position based on the projection position;
and when the first distance is smaller than the height of the card to be displayed, taking the pop-up position on the second side edge as the display position, wherein the second distance from the pop-up position to the first side edge is larger than or equal to the height of the card to be displayed.
3. The method according to claim 1 or 2, characterized in that the method further comprises:
and when the action area and the action position are acquired, displaying a preloaded animation on the screen in a suspension mode.
4. The method of claim 1 or 2, wherein the cards to be displayed are plural, and the displaying the cards to be displayed in the display position in a floating manner comprises:
arranging a plurality of cards to be displayed at intervals along the side edge of the screen, and displaying the arranged cards at the display position in a suspending manner;
or,
and sequentially superposing a plurality of the cards to be displayed from wide to narrow according to the width of the cards to be displayed, and displaying the superposed cards at the display position in a suspension manner.
5. The method according to claim 1 or 2, wherein the obtaining of the card to be displayed according to the content of the action area comprises:
when the content is captured in the action area and is a text, acquiring the card to be displayed based on the text;
when the content is captured in the action area and is a picture, acquiring the card to be displayed based on the picture;
and when the content is not captured in the action area, capturing the content in the action area, and acquiring the card to be displayed based on the captured image.
6. The method according to claim 1 or 2, characterized in that the method further comprises:
displaying an identification option box identifying the content;
when the identification option frame is detected to move from the first position to the second position, picture identification is selected to obtain the card to be displayed.
7. The method according to claim 1 or 2, characterized in that the method further comprises:
acquiring action time and/or action force of the operation object on the screen;
and when the action time is greater than a preset time threshold and/or the action force is greater than a preset action threshold, triggering the terminal equipment to acquire the card to be displayed and the display position.
8. A display apparatus, applied to a terminal device having a screen, the apparatus comprising:
the first acquisition module is configured to acquire an acting area and an acting position of an operation object acting on the screen;
the second acquisition module is configured to acquire a card to be displayed according to the content of the action area;
the second determination module is used for determining the display position of the card to be displayed according to the action position and the size of the card to be displayed; wherein the size of the card to be displayed comprises the width of the card to be displayed or the height of the card to be displayed; the first display module is configured to display the card to be displayed in a floating mode in the display position.
9. The apparatus of claim 8, wherein the second determining module is further configured to determine a first distance from the action position to the first side and a projection position of the action position onto the second side based on the action position, the screen including a first side and a second side adjacent to the first side; when the first distance is larger than or equal to the height of the card to be displayed, determining the display position based on the projection position; and when the first distance is smaller than the height of the card to be displayed, taking the pop-up position on the second side edge as the display position, wherein the second distance from the pop-up position to the first side edge is larger than or equal to the height of the card to be displayed.
10. The apparatus of claim 8 or 9, further comprising:
and the second display module is configured to display a preloaded animation in a suspension mode on the screen when the action region and the action position are acquired.
11. The device according to claim 8 or 9, wherein the first display module is further configured to arrange a plurality of cards to be displayed at intervals along the side edge of the screen, and to display the arranged cards in a floating manner at the display position; or sequentially overlapping a plurality of the cards to be displayed from wide to narrow according to the width of the cards to be displayed, and displaying the overlapped cards at the display position in a suspension manner.
12. The apparatus according to claim 8 or 9, wherein the second acquiring module is further configured to, when the content is captured in the active area and the content is text, acquire the card to be displayed based on the text; when the content is captured in the action area and is a picture, obtaining the card to be displayed based on the picture; and when the content is not captured in the action area, capturing the content in the action area, and acquiring the card to be displayed based on the captured image.
13. The apparatus of claim 8 or 9, further comprising:
a third display module configured to display an identification option box identifying the content;
and the selecting module is configured to select picture recognition to acquire the card to be displayed when the recognition option frame is detected to move from the first position to the second position.
14. The apparatus of claim 8 or 9, further comprising:
the third acquisition module is configured to acquire acting time and/or acting force of the operation object acting on the screen;
the triggering module is configured to trigger the terminal equipment to acquire the card to be displayed and the display position when the action time is greater than a preset time threshold and/or the action force is greater than a preset action threshold.
15. A display device, characterized in that the device comprises at least: a processor and a memory for storing executable instructions operable on the processor, wherein:
the processor is configured to execute the executable instructions, and the executable instructions perform the steps of the display method provided in any one of the preceding claims 1 to 7.
16. A non-transitory computer-readable storage medium having stored therein computer-executable instructions that, when executed by a processor, implement the display method provided in any one of claims 1 to 7.
CN202011580341.2A 2020-12-28 2020-12-28 Display method and device, and storage medium Active CN112612390B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011580341.2A CN112612390B (en) 2020-12-28 2020-12-28 Display method and device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011580341.2A CN112612390B (en) 2020-12-28 2020-12-28 Display method and device, and storage medium

Publications (2)

Publication Number Publication Date
CN112612390A CN112612390A (en) 2021-04-06
CN112612390B true CN112612390B (en) 2022-05-06

Family

ID=75248259

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011580341.2A Active CN112612390B (en) 2020-12-28 2020-12-28 Display method and device, and storage medium

Country Status (1)

Country Link
CN (1) CN112612390B (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103677493B (en) * 2012-09-06 2018-03-23 腾讯科技(深圳)有限公司 Pop-out display methods and device
CN106886541B (en) * 2015-12-16 2020-06-30 北京搜狗科技发展有限公司 Data searching method and device for data searching
US10657527B1 (en) * 2016-07-25 2020-05-19 United Services Automobile Association (Usaa) Configurable management of ghost accounts
CN106445321A (en) * 2016-09-13 2017-02-22 宇龙计算机通信科技(深圳)有限公司 Document content display method and terminal
CN110020140B (en) * 2017-11-15 2023-02-21 腾讯科技(深圳)有限公司 Recommended content display method, device and system

Also Published As

Publication number Publication date
CN112612390A (en) 2021-04-06

Similar Documents

Publication Publication Date Title
CN105955607B (en) Content sharing method and device
US9952681B2 (en) Method and device for switching tasks using fingerprint information
US9900422B2 (en) Mobile terminal and method of controlling therefor
US11334225B2 (en) Application icon moving method and apparatus, terminal and storage medium
US10509540B2 (en) Method and device for displaying a message
CN110663016B (en) Method for displaying graphical user interface and mobile terminal
US10055087B2 (en) Mobile terminal and method of controlling the same
CN110968364B (en) Method and device for adding shortcut plugins and intelligent device
EP3128411A1 (en) Interface display method and device
EP3716029A1 (en) Interface display method, device and storage medium
CN111651216A (en) NFC card processing method and device and storage medium
JP2017525076A (en) Character identification method, apparatus, program, and recording medium
CN110321042B (en) Interface information display method and device and electronic equipment
US11016660B2 (en) Method and apparatus for responding to gesture operation and storage medium
CN106020694B (en) Electronic equipment, and method and device for dynamically adjusting selected area
CN111354444A (en) Pathological section image display method and device, electronic equipment and storage medium
CN112612390B (en) Display method and device, and storage medium
CN111092971A (en) Display method and device for displaying
CN114691000B (en) Multi-screen linkage method, device, equipment and storage medium
EP4312114A1 (en) Method and apparatus for adjusting sizes of split-screen windows, electronic device and storage medium
KR101559778B1 (en) Mobile terminal and method for controlling the same
EP4134798A1 (en) Small window exit method, electronic device and storage medium
CN116055783A (en) Video playing method and device, electronic equipment and storage medium
CN115668116A (en) Interface display method, device and storage medium
KR102214838B1 (en) Terminal and operating method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant