CN110399574A

CN110399574A - Information jump method, device and electronic device

Info

Publication number: CN110399574A
Application number: CN201810355959.5A
Authority: CN
Inventors: 熊飞
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2018-04-19
Filing date: 2018-04-19
Publication date: 2019-11-01

Abstract

The invention discloses a kind of information jump methods and device and electronic device.Wherein, this method comprises: display operation identifies on the client in the case where including two dimensional code in detecting the video pictures played on the client, wherein, for operation mark for prompting performance objective to operate, object run is to jump to page address indicated by two dimensional code；Receive the operational order for trigger action mark；According to operational order, page address is jumped to, and is shown and the displaying information in target pages indicated by page address.The present invention solves two dimensional code shown on one terminal device of scanning, and there are the higher technical problems of operating procedure complexity for the mode for jumping another terminal device execution information.

Description

Information jump method, device and electronic device

Technical field

The present invention relates to computer fields, in particular to a kind of information jump method and device and electronic device.

Background technique

Currently, during terminal device plays video, the two dimension that is embedded in the video pictures in order to obtain the video Information in code, it usually needs spectators first suspend the broadcasting of the video, then by another terminal device to embedded two dimensional code Scan operation is executed, row information of going forward side by side jumps.Shown two dimensional code, makes another terminal on one terminal device of this scanning The mode that equipment execution information jumps, there are the higher problems of operating procedure complexity.

For above-mentioned problem, currently no effective solution has been proposed.

Summary of the invention

The embodiment of the present invention provides a kind of information jump method and device and electronic device, at least to solve one end of scanning Shown two dimensional code in end equipment, the mode for jumping another terminal device execution information there are operating procedure complexity compared with High technical problem.

According to an aspect of an embodiment of the present invention, a kind of information jump method is provided, comprising: detecting in client Comprising in the case where two dimensional code, display operation is identified in the client, wherein the behaviour in the video pictures played on end It makes a check mark for prompting performance objective to operate, the object run is to jump to page address indicated by the two dimensional code；It connects Receive the operational order for triggering the operation mark；According to the operational order, jump to the page address, and show with Displaying information in target pages indicated by the page address.

According to another aspect of an embodiment of the present invention, it additionally provides a kind of information and jumps device, comprising: display unit is used In the case where in detecting the video pictures played on the client including two dimensional code, the display operation in the client Mark, wherein for the operation mark for prompting performance objective to operate, the object run is to jump to the two dimensional code meaning The page address shown；Receiving unit, for receiving the operational order for triggering the operation mark；Jump-transfer unit is used for root According to the operational order, the page address is jumped to, and is shown and the exhibition in target pages indicated by the page address Show information.

Another aspect according to an embodiment of the present invention, additionally provides a kind of electronic device, including memory, processor and deposits Store up the computer program that can be run on a memory and on a processor, wherein above-mentioned processor passes through computer program and executes Above-mentioned method.

In embodiments of the present invention, it identifies and is connecing using display operation in the terminal in playing video comprising two dimensional code The mode for executing in the case where the touch control operation of operation mark and jumping display operation is received, by being broadcast on the client detecting Comprising in the case where two dimensional code, display is for prompting the operation mark of progress skip operation on the client in the video pictures put Know；And in the case where receiving the operational order for trigger action mark, page address indicated by two dimensional code is jumped to, and Display and the displaying information in target pages indicated by page address, have reached in the video pictures of broadcasting comprising two dimensional code Client in operation mark for prompt to carry out skip operation is directly provided to spectators, and execution jumps the purpose of display, To the technical effect for realizing the related information jump procedure of simplified two dimensional code, improving user experience, due to not needing to suspend Video playing on one terminal device executes scanning to two dimensional code embedded in video pictures by another terminal device and jumps Operation solves two dimensional code shown on one terminal device of scanning, the side for jumping another terminal device execution information There are the higher technical problems of operating procedure complexity for formula.

Detailed description of the invention

The drawings described herein are used to provide a further understanding of the present invention, constitutes part of this application, this hair Bright illustrative embodiments and their description are used to explain the present invention, and are not constituted improper limitations of the present invention.In the accompanying drawings:

Fig. 1 is a kind of schematic diagram of the application environment of information jump method according to an embodiment of the present invention；

Fig. 2 is a kind of flow diagram of information jump method according to an embodiment of the present invention；

Fig. 3 is that occur the schematic diagram of two dimensional code in video pictures according to an embodiment of the present invention；

Fig. 4 is the schematic diagram of two dimensional code according to an embodiment of the present invention；

Fig. 5 is a kind of schematic diagram of information jump method according to an embodiment of the present invention；

Fig. 6 is the schematic diagram of another information jump method according to an embodiment of the present invention；

Fig. 7 is the schematic diagram of another information jump method according to an embodiment of the present invention；

Fig. 8 is the schematic diagram of gray level image according to an embodiment of the present invention；

Fig. 9 is the schematic diagram that greyscale image transitions according to an embodiment of the present invention are bianry image；

Figure 10 is the schematic diagram of two dimensional code apex angle according to an embodiment of the present invention；

Figure 11 is the structural schematic diagram that a kind of information according to an embodiment of the present invention jumps device；

Figure 12 is a kind of structural schematic diagram of optional electronic device according to an embodiment of the present invention.

Specific embodiment

In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only The embodiment of a part of the invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people The model that the present invention protects all should belong in member's every other embodiment obtained without making creative work It encloses.

It should be noted that description and claims of this specification and term " first " in above-mentioned attached drawing, " Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that using in this way Data be interchangeable under appropriate circumstances, so as to the embodiment of the present invention described herein can in addition to illustrating herein or Sequence other than those of description is implemented.In addition, term " includes " and " having " and their any deformation, it is intended that cover Cover it is non-exclusive include, for example, the process, method, system, product or equipment for containing a series of steps or units are not necessarily limited to Step or unit those of is clearly listed, but may include be not clearly listed or for these process, methods, product Or other step or units that equipment is intrinsic.

Now two dimensional code is illustrated.Two-dimensional bar code/two dimensional code (2-dimensional bar code) is with certain spy The chequered with black and white figure identifying recording layer symbol that fixed geometric figure is distributed according to certain rule in plane (on two-dimensional directional) The mode of information.

According to an aspect of an embodiment of the present invention, a kind of information jump method is provided.Optionally, above- mentioned information jump Method can be, but not limited to be applied in application environment as shown in Figure 1.As shown in Figure 1, client 102 is connect by network 104 Receive the video that server 106 is sent.The broadcasting of video can be in real time, be also possible to non real-time (for example, client 102 It is played out after buffered video or foradownloaded video).Client 102 includes two dimensional code in the video pictures for detecting broadcasting In the case of, display operation mark, wherein for the operation mark for prompting performance objective to operate, which is to jump to two Tie up page address indicated by code；Receive the operational order for triggering the operation mark；According to the operational order, before jumping to Page address is stated, and is shown and the displaying information in target pages indicated by the page address.

Optionally, in the present embodiment, above-mentioned client can include but is not limited at least one of: mobile phone, plate Computer etc..Above-mentioned network can include but is not limited to wireless network or mobile network, wherein the wireless network includes: bluetooth, nothing The network of line fidelity (Wireless Fidelity, referred to as WIFI) and other realization wireless communications.Above-mentioned server can wrap Include but be not limited at least one of: personal computer (Personal Computer, referred to as PC) and other can be used for providing The equipment of video pictures.Above-mentioned only a kind of example, the present embodiment do not do any restriction to this.

Fig. 2 is a kind of flow diagram of information jump method according to an embodiment of the present invention.As shown in Fig. 2, this method It may comprise steps of:

Step S202, in the case where in detecting the video pictures played on the client comprising two dimensional code, in client Display operation identifies on end, wherein for operation mark for prompting performance objective to operate, object run is to jump to two dimensional code meaning The page address shown；

Step S204 receives the operational order for trigger action mark；

Step S206 jumps to page address according to operational order, and shows and target pages indicated by page address In displaying information.

Optionally, in the present embodiment, above- mentioned information jump method can be, but not limited to be applied to play packet in client Video pictures and execution containing two dimensional code jump in the scene of display, such as play more matchmakers comprising that can carry out the information that information jumps In the scene of body file.Above-mentioned is only a kind of example, does not do any restriction to this in the present embodiment.

In step S202, video belonging to the video pictures that play in client be can include but is not limited to:

1) video watched online, for example, client is online by video playback website or video playing application program The video of viewing, video playback website or video playing application program can be the professional website of video playing or using journeys Sequence is also possible to website or application program that other are able to carry out video playing, in another example, client is existed by the way that platform is broadcast live The video of line live streaming；

2) video played after caching or download is (for example, client passes through video playback website, video playing application journey Sequence or downloading software caching or the video of downloading)；

3) video that client is obtained and played by other means, for example, other equipment pass through network or other companies Connect the video that mode (e.g., bluetooth) directly transmits.

Above-mentioned is the acquisition of video and the example of broadcast mode belonging to video pictures, is not appointed in the present embodiment to this What is limited.

Optionally, in the present embodiment, client can be by video playback website, video jukebox software, webpage The modes such as plug-in unit carry out the broadcasting of video pictures.Above-mentioned is only a kind of example, does not do any restriction to this in the present embodiment.

Optionally, in the present embodiment, appearance position of the two dimensional code in video pictures can be arbitrary.For example, two Peripheral position, middle position, left area, right half area of video pictures etc. can occur in dimension code.Two dimensional code is in video pictures The position of middle appearance can be fixed, and is also possible to variation, can also be that certain time is fixed, and be separately variation for a period of time 's.The variation of two-dimentional code position can be regular (for example, at the uniform velocity moving, accelerating movement, cyclically-varying), be also possible to It is irregular.The track of two dimensional code change in location is that have specific shape (straight line, oblique line, camber line etc.), is also possible to without specific Shape.The period that two dimensional code occurs in video pictures can be arbitrary.For example, process of the two dimensional code in video playing In occur always.In another example two dimensional code occurs, or disappears in video playing to when sometime putting.For another example in video When occurring special object (specific role, particular commodity) in picture, two dimensional code occurs.Two dimensional code and video pictures can be same Layer, can also be in different layers.Above-mentioned is only a kind of example, does not do any restriction to this in the present embodiment.

Optionally, in the present embodiment, two dimensional code can be identified by target image pattern.Target image pattern can To be the arbitrary image pattern for identifying two dimensional code, for example, there are three apex angles to have fixed sample in the rectangle frame of two dimensional code Formula (that is, target image pattern).In another example having fixed sample in the intermediate region of the rectangle frame of two dimensional code and at least one apex angle Formula.The fixation pattern can be with specific shape (for example, rectangle, circle), and at least two colors in particular directions Pixel is arranged according to designated ratio.

Specifically it is illustrated in conjunction with following example.As shown in figure 3, carrying out the broadcasting of video pictures in the client, broadcasting When being put into 00:30:10 (30 points and 10 seconds), there is two dimensional code in the lower right corner of video pictures.The specific structure of the two dimensional code is such as Shown in Fig. 4, two dimensional code is in rectangular configuration, has fixed pattern (fixation pattern in the upper left corner, the upper right corner and the lower left corner of two dimensional code Shown can there is no network in actual displayed by way of grid).On the symmetry axis of the fixation pattern, black and The ratio of white is fixed, and is 1:1:3:1:1.

Optionally, the video pictures played on the client be can detecte before display operation mark on the client In include two dimensional code；The two dimensional code detected is identified, two-dimensional barcode information (data symbol information) is obtained, wherein two dimension Code information is used for identified page address.

Optionally, in the present embodiment, after identifying two dimensional code, the band of position where two dimensional code can be intercepted, from And the picture of two dimensional code is generated, and use system two dimensional code recognition application interface (Application Program Interface, referred to as API) it is identified, two-dimensional barcode information (data symbol information) is parsed, to obtain two dimensional code letter Cease identified page address.

Optionally, in the present embodiment, above-mentioned resolving can execute before display operation mark, be also possible to It is executed after display operation mark, for example, it may be executed after receiving operational order.

Optionally, detect in the video pictures played on the client comprising two dimensional code to may include: fixed using second When interval to video pictures carry out screenshot；It detects in the second screenshot picture that screenshot obtains comprising one or more target images Pattern, wherein target image pattern is for identifying two dimensional code.

Optionally, in the present embodiment, carrying out screenshot to video pictures using the second fixed time interval may include: that starting is fixed When screenshot function, the fixed time interval (that is, second fixed time interval) of setting is a predetermined value (for example, 0.5s, 0.6s etc.).This is pre- Definite value can be set based on experience value, can also be set according to the performance of client, can also be set manually by user It is fixed.Above-mentioned timing screenshot function can be by video playing triggering, can also be manually opened by user.Above-mentioned timing screenshot The play area that can be video pictures in client current screen of function interception (can be determined by boundary alignment etc. The mode of video pictures position carries out screenshot), it is also possible to the current screen of client, which contains video picture Face.Above-mentioned is only a kind of example, does not do any restriction to this in the present embodiment.

Optionally, detecting in the second screenshot picture that screenshot obtains can wrap comprising one or more target image patterns It includes: the second screenshot picture is converted into gray level image；It is bianry image by greyscale image transitions；It detects in bianry image and includes One or more target image patterns.

Optionally, in the present embodiment, before identifying to the two dimensional code detected, client can be first determined whether Whether predetermined condition meets.For example, time for occurring in video pictures of same two dimensional code be more than scheduled duration (for example, 10s, 1min etc.).In another example the clarity of two dimensional code is more than predetermined threshold.Above-mentioned is only a kind of example, is not done in the present embodiment to this Any restriction.

Optionally, in the present embodiment, in detecting the video pictures played on the client comprising after two dimensional code, It can be according to position of the identification two dimensional code in video pictures.Knowledge can be fixed point otherwise and know otherwise.For example, can be with The band of position (or position) for positioning three apex angles of two dimensional code, so that it is determined that the band of position of two dimensional code.In another example Ke Yiding The band of position (or position) at position two dimensional code center and the band of position (or position) of a certain apex angle, so that it is determined that the position of two dimensional code Set region.Above-mentioned is only a kind of example, does not do any restriction to this in the present embodiment.

Specifically it is illustrated in conjunction with following example.As shown in figure 4, in three apex angles (apex angle 1-3) for identifying two dimensional code The band of position after, in conjunction with the shape (for example, rectangle) of two dimensional code, the band of position of two dimensional code can be oriented.

Optionally, display operation mark may include: displaying target window on the client on the client, wherein behaviour It makes a check mark including target window.Operation mark can also be used for prompting message comprising other, for example, operation mark is periodically dodged It is bright, the identification information of the prompting property such as hand-type, arrowhead-shaped.

Optionally, in the present embodiment, operation mark may include target window, target window shape can be rectangle, Circle, polygon etc.；The position of target window can upper one layer or the same layer in video pictures in video pictures, mesh Mark window can be covered on the band of position of two dimensional code, be also staggered with the band of position of two dimensional code；The position of target window is big It is small can be onesize with the band of position of two dimensional code, it is bigger than the band of position of two dimensional code, it is smaller than the band of position of two dimensional code etc.； The background colour of target window can be transparent, translucent, opaque etc.；The color of target window can be white, black Color, yellow etc..Above-mentioned is only a kind of example, for the shape of target window, size, background colour, color, position in the present embodiment Equal attributes do not do any restriction.

Specifically it is illustrated in conjunction with following example.As shown in figure 5, operation mark is floating layer window, the color of floating layer window For white, background colour is edematus, which is covered on the band of position of two dimensional code, than the position area of two dimensional code Domain is bigger.

Optionally, in the present embodiment, during playing video pictures on the client, operation mark is on the client Display position can change.For example, the display position variation of operation mark can be along video pictures or client Screen moves around, and is also possible to move along the diagonal line of video pictures or client screen, can also be along any track It is moved.Motion track can be it is well-regulated, for example, straight line, camber line, broken line etc., are also possible to random.Operation mark The movement of knowledge can be regular (for example, at the uniform velocity moving, accelerating movement, cyclically-varying), be also possible to irregular.

Optionally, display operation mark includes: operation during playing video pictures on the client on the client The display position of mark on the client changes with change in location of the two dimensional code in video pictures.If two-dimentional code position It moves, then the position of operation mark is also moved.The display of operation mark, which can be, relies on two dimensional code, for example, two When dimension code occurs, operation mark is shown；When two dimensional code disappears, operation mark disappears.The display of operation mark is also possible to disobey Rely two dimensional code, for example, operation mark is shown when two dimensional code occurs, operation mark is still shown.Above-mentioned is only a kind of example, Any restriction is not done in the present embodiment to this.

Specifically it is illustrated in conjunction with following example.In this example, operation mark is floating layer window.As shown in fig. 6, when 1 is carved, two dimensional code is located at position A, and floating layer window is covered on two dimensional code at this time.At the moment 2, two dimensional code is located at position B, at this time Floating layer window covers on two dimensional code.At the moment 3, two dimensional code is located at position C, at this time floating layer window still cover two dimensional code it On.

Optionally, the display position of operation mark on the client occurs with change in location of the two dimensional code in video pictures Before variation, screenshot can be carried out to video pictures using the first fixed time interval；In the first screenshot picture that detection screenshot obtains Position of the two dimensional code in the first screenshot picture.

Optionally, in the present embodiment, by screenshot as described above, identification two dimensional code and two dimensional code can be determined Location information mode, to detect position of the two dimensional code in the first screenshot picture, this will not be repeated here.

In step S204, the operational order for trigger action mark is received.Aforesaid operations instruction, which can be, passes through list Operation mark triggering is hit, the condition of triggering can include but is not limited to:

1) arbitrary-zone in single-click operation mark, may is that the region where the region clicked and operation mark There are intersections, alternatively, the area of the intersection in the region where the region clicked and operation mark is more than predetermined value；

2) arbitrary-zone in double click operation mark, the region and the region where operation mark that may is that double-click There are intersections, alternatively, the area of the intersection in the region where the region double-clicked and operation mark is more than predetermined value；

3) arbitrary-zone in single-click operation mark, pop-up are used to select to execute the selective listing of operation, click Skip operation option in operating list.

It optionally, in the present embodiment, can also include other option of operation in selective listing, for example, duplication operation Option, the duplication option of operation are used to prompt to execute the duplication operation of duplication two dimensional code or two-dimensional barcode information.

In step S206, after receiving the operational order for trigger action mark, according to the operational order, jump To page address indicated by two dimensional code, and show on the client and the displaying in target pages indicated by the page address Information.

Optionally, in the present embodiment, page address can be based on the address of http protocol or other may include Page address in two-dimensional barcode information, information included in target pages indicated by the page address may include but not It is limited to: webpage information, telephone number, E-mail address, electronic business card etc..Optionally, above-mentioned electronic business card can be specific social activity Specific user or public number business card in the network platform.Above-mentioned is only a kind of example, is not done in the present embodiment to this any It limits.

Specifically following example is combined to be illustrated the information jump method in the present embodiment.As shown in Fig. 7 upper right half, It include two dimensional code in the video pictures played on the client.It in this example, is logical comprising two dimensional code in detection video pictures The timing screenshot function of client is crossed to complete, two dimensional code by 3 have the matrixes (that is, apex angle of two dimensional code) of fixed pattern Lai Mark, operation mark are floating layer window, and the upper layer of the two dimensional code detected is located at after floating layer window creation, covers the two dimension Yard, it include news network address in two-dimensional barcode information, object run is to jump to news network address indicated by two dimensional code.

When playing video pictures on the client, the specific application in client or client is opened (for example, can be into The application program of row video playing) information turn function.After opening the function, timing screen capture module can star, timing Screenshot is carried out to the current screen of client, includes current video picture in current screen.The timing screen capture module is fixed time Every being arranged to 0.5s.

The screenshot picture that screenshot obtains is analyzed, judge in screenshot picture whether the square comprising 3 fixation patterns Shape (that is, target image pattern of certain number), the rectangle is on laterally and/or longitudinally symmetry axis, the arrangement of black and white Ratio is fixed, and is 1:1:3:1:1.It include 3 in screenshot picture since three apex angles of two dimensional code have such fixed pattern When the rectangle of a above-mentioned fixed pattern, then it can determine in screenshot picture comprising two dimensional code.That is, the video played on the client It include two dimensional code in picture.

Above-mentioned timing screenshot is executed in client background, is transparent (the imperceptible screenshot of user for a user Operation).At this point, the operation of two dimensional code occur in detection video pictures is executed inside client, suspend view without user Frequently, and barcode scanning is executed using another terminal device to operate, simplify the step of information jumps.

Comprising may further determine that position of the two dimensional code in screenshot picture after two dimensional code in detecting video pictures It sets.Client can determine the band of position of the two dimensional code in screenshot picture according to the size and location of each apex angle.Determining two Code is tieed up behind the band of position in screenshot picture, the band of position in screenshot picture can be intercepted, generates two-dimension code image.

After generating two-dimension code image, client identifies two dimensional code using system two dimensional code identification api, parses Page address indicated by two dimensional code, to obtain news network address indicated by two dimensional code.

After obtaining two-dimensional barcode information, client creates floating layer window, and the position of floating layer window and size are two dimensional code area The position in domain and size, background colour are translucent.The touch event that the floating layer window is arranged is to click, and the result of touch-control is to jump To news network address indicated by two dimensional code, the displaying information in news pages indicated by the news network address is shown.At this point, client In the video pictures shown on end as shown in Fig. 7 upper left, occurs a floating layer window on the band of position of two dimensional code.

As shown in Fig. 7 bottom left section, client detects touch event (the user click floating layer window occurred to floating layer window Mouthful) afterwards (that is, receiving the operational order for trigger action mark), skip operation is executed, is shown on the screen of client Content jumps the displaying information for news pages indicated by news network address in, as shown in Fig. 7 lower right-most portion.

It should be noted that being detected in the video pictures played on the client by the matrix of screenshot and fixed pattern Two dimensional code occur is only a kind of example, can also be detected, for example, video code flow can be monitored, be passed through by other means Two dimensional code in code stream, which identifies, there is two dimensional code to detect in video pictures.Occurs two dimension in video pictures for how to detect Yard, any restriction is not done in the present embodiment.

Through this embodiment, it identifies and is receiving using display operation in the terminal in playing video comprising two dimensional code The mode of display operation of jumping is executed in the case where the touch control operation of operation mark, by being played on the client detecting Comprising in the case where two dimensional code, display is for prompting the operation mark of progress skip operation on the client in video pictures；And In the case where receiving the operational order for trigger action mark, page address indicated by two dimensional code is jumped to, and show With the displaying information in target pages indicated by page address, and no longer it is limited by and two equipment is operable to respectively It carries out information to jump, due to not needing the video playing on one terminal device of pause, by another terminal device to video pictures In embedded two dimensional code execute scanning skip operation, realize the related information jump procedure of simplified two dimensional code, improve user The technical effect of experience.Further, by direct to spectators in the client in the video pictures of broadcasting comprising two dimensional code Operation mark (operation entry) for prompting progress skip operation is provided, the diversity of two dimensional code operation is also improved, into one Step improves user experience.

As a kind of optional scheme, display operation, which identifies, on the client includes:

Displaying target window on the client, wherein operation mark can include but is not limited to target window.

Optionally, as an alternative embodiment, target window is upper one layer of the window for being shown in video pictures (that is, floating layer window).As shown in figure 5, target window is located at upper one layer of video pictures.The position of the target window can cover On two dimensional code, specific region also may be displayed on, for example, the surrounding of video pictures, the positions such as centre of video pictures.

Optionally, as another optional embodiment, target window is the window for being shown in the same layer of video pictures Mouthful.The position of the target window can be covered on two dimensional code, also may be displayed on specific region, for example, video pictures Surrounding, the positions such as centre of video pictures.

The following example specifically combined is illustrated.In the regional location for obtaining two dimensional code, in the following manner to two dimension Code identification:

1) regional location of two dimensional code is intercepted, generates two-dimension code image；

2) it is identified using system two dimensional code identification api, parses the corresponding page address of two dimensional code.

After parsing the corresponding page address of two dimensional code, floating layer window, the window's position size are created on the client For the position size of two-dimension code area, background colour is transparent.According to the corresponding page address of the two dimensional code of parsing, in floating layer window It provides user interface (User Interface, referred to as UI) operation to show, such as clicks and jump operation.

Through this embodiment, performance objective operation is indicated by way of target window, intuitive display is easy to operate, because This, improves intuitive and operability that operation mark is shown.

During playing video pictures on the client, the display position of operation mark on the client exists with two dimensional code Change in location in video pictures changes.

Optionally, the display position of operation mark on the client occurs with change in location of the two dimensional code in video pictures Before variation, the above method further include:

S1 carries out screenshot to video pictures using the first fixed time interval；

S2 detects position of the two dimensional code in the first screenshot picture in the first screenshot picture that screenshot obtains.

Specifically it is illustrated in conjunction with following example.In this example, the display position on the client of operation mark with Change in location of the two dimensional code in video pictures changes, and operation mark is floating layer window.

In this example, using CMT (Clustering of Static-Adaptive Correspondences for Deformable Object Tracking) track algorithm creation tracking module, tracing area is two dimensional code position region, And start-up trace module timer.The initialization procedure of tracking module may comprise steps of:

1) screenshot image (screenshot image when initialization) is converted into gray level image；

If 2) image is longer or wider than 1500 pixels, (size in gray level image to 1500*1500 Pixel Dimensions is compressed Have been able to guarantee the accuracy of algorithm, and efficiency is higher).Tracing area also transforms to corresponding region；

3) (e.g., there is the two dimensional code of fixed pattern using all key feature points of FAST detector detection initial pictures Three apex angles)；

4) dividing the image into foreground and background, (e.g., prospect includes the band of position of two dimensional code, and background includes non-two dimensional code The band of position)；

5) initial moving point is created, that is, the coordinate of prospect key point.

Tracking module carries out patrolling for screenshot using the time interval (that is, first fixed time interval, for example, being 0.2s) of setting Volume, using CMT algorithm keeps track logic module, the process that tracking module tracks the band of position where two dimensional code includes following step It is rapid:

1) screenshot image (the screenshot image during tracking) is converted into gray level image；

If 2) image is longer or wider than 1500 pixels, compress in gray level image to 1500*1500 Pixel Dimensions (with creation When be consistent).

3) current location of key point is calculated using optical flow method.

4) the new position of tracing area (that is, band of position where two dimensional code) is obtained using global registration and local matching It sets.

5) the new band of position is converted into original image size corresponding region.

Two-dimension code area is updated to new position, updates the position of floating layer window.

Through this embodiment, by changing the display position of operation mark on the client, it may remind the user that client On have operation mark, avoid omission of the user to operation mark.Further, operation mark follows two dimensional code to be moved, User experience is more natural, improves user experience.Further, video pictures are carried out using timing determining two by the way of screenshot The position for tieing up code, since fixed time interval can be adjusted flexibly, and need not monitor each frame in video, reduce soft to client The occupancy of hardware resource.

As a kind of optional scheme, on the client before display operation mark, the above method further include:

S1 is detected in the video pictures played on the client comprising two dimensional code；

S2 identifies the two dimensional code detected, obtains two-dimensional barcode information, wherein two-dimensional barcode information is used for mark page Face address.

Through this embodiment, by the video pictures that play in detection client comprising two dimensional code, and to detecting Two dimensional code is identified, two-dimensional barcode information is obtained, and can detecte and identify the two dimensional code in video pictures, is jumped and is provided for information Page address information.

As a kind of optional scheme, detects in the video pictures played on the client and include: comprising two dimensional code

S1 carries out screenshot to video pictures using the second fixed time interval；

S2 is detected in the second screenshot picture that screenshot obtains comprising one or more target image patterns, wherein target Image style is for identifying two dimensional code.

Optionally, it detects in the second screenshot picture that screenshot obtains and includes: comprising one or more target image patterns

Second screenshot picture is converted to gray level image by S21；

Greyscale image transitions are bianry image by S22；

S23 is detected in bianry image comprising one or more target image patterns.

Optionally, specifying image style is the picture of at least two colors on the assigned direction in the region of designated shape Vegetarian refreshments is arranged according to designated ratio.

Specifically it is illustrated in conjunction with following example.First turn on the function that two dimensional code is identified in client or application program Energy.Start timing screen capture module, setting fixed time interval (that is, second fixed time interval, for example, being 0.5s), timing intercepts current screen Curtain generates a screenshot picture.

Whether there is two dimensional code in identification screenshot picture, obtains the band of position of two dimensional code, detailed process if any It is as follows:

It 1) the use of the cvtColor method migration in the library opencv is gray level image by screenshot picture.Gray level image after conversion As shown in Figure 8.

2) gray scale picture is degenerated for bianry image using big saliva binaryzation method.Bianry image after degeneration is as shown in Figure 9.

3) identify in bianry image whether there is two dimensional code.

There is fixed pattern there are three apex angle among two dimensional code rectangle frame, and black and white ratio in apex angle rectangle It is fixed, it is 1:1:3:1:1, as shown in Figure 10.

If three apex angles comprising fixed pattern in bianry image, can determine occur two dimensional code in video pictures, that is, It detects in video pictures comprising two dimensional code.

After detecting that video pictures include two dimensional code, position of the two dimensional code in video pictures may further determine that It sets.The findContours method that can be used in opencv image library carries out contour detecting, obtains all profiles in image.Again According to information such as the ratio of apex angle rectangle, positions, the band of position of the two dimensional code in screenshot picture is obtained.

Optionally, the second fixed time interval may be the same or different with the first fixed time interval.Optionally, fixed second When interval it is different from the first fixed time interval in the case where, the second fixed time interval can be longer than the first fixed time interval time.

Through this embodiment, it whether is determined in such a way that timing carries out screenshot to video pictures in video pictures comprising two Code is tieed up, since fixed time interval can be adjusted flexibly, and each frame in video need not be monitored, reduces and client software and hardware is provided The occupancy in source.Further, the first fixed time interval of setting is shorter than the second fixed time interval, can more effectively track the position of two dimensional code Variation is set, the efficiency that information jumps is improved.

It should be noted that for the various method embodiments described above, for simple description, therefore, it is stated as a series of Combination of actions, but those skilled in the art should understand that, the present invention is not limited by the sequence of acts described because According to the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know It knows, the embodiments described in the specification are all preferred embodiments, and related actions and modules is not necessarily of the invention It is necessary.

Through the above description of the embodiments, those skilled in the art can be understood that according to above-mentioned implementation The method of example can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but it is very much In the case of the former be more preferably embodiment.Based on this understanding, technical solution of the present invention is substantially in other words to existing The part that technology contributes can be embodied in the form of software products, which is stored in a storage In medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device (can be mobile phone, calculate Machine, server or network equipment etc.) execute method described in each embodiment of the present invention.

Other side according to an embodiment of the present invention additionally provides a kind of for implementing the letter of above- mentioned information jump method Breath jumps device, and as shown in figure 11, which includes:

1) display unit 1102, the case where for including two dimensional code in detecting the video pictures played on the client Under, display operation identifies on the client, wherein for operation mark for prompting performance objective to operate, object run is to jump to Page address indicated by two dimensional code；

2) receiving unit 1104, for receiving the operational order for being used for trigger action mark；

3) jump-transfer unit 1106, for jumping to page address according to operational order, and indicated by display and page address Target pages in displaying information.

Optionally, in the present embodiment, above- mentioned information jump device and can be, but not limited to be applied to play packet in client Video pictures and execution containing two dimensional code jump in the scene of display, such as play more matchmakers comprising that can carry out the information that information jumps In the scene of body file.Above-mentioned is only a kind of example, does not do any restriction to this in the present embodiment.

It should be noted that the display unit 1102 in the present embodiment can be used for executing the step in the present embodiment S202, the receiving unit 1104 in embodiment can be used for executing the step S204 in the present embodiment, jumping in the present embodiment Unit 1106 can be used for executing the step S206 in the present embodiment.

Herein it should be noted that above-mentioned module is identical as example and application scenarios that corresponding step is realized, but not It is limited to the present embodiment disclosure of that.It should be noted that above-mentioned module may operate in as a part of device such as Fig. 1 Shown in hardware environment, hardware realization can also be passed through by software realization.

Optionally, in the present embodiment, video belonging to the video pictures played in client can include but is not limited to:

Specifically it is illustrated in conjunction with following example.As shown in figure 3, carrying out the broadcasting of video pictures in the client, regarding When frequency is played to 00:30:10 (30 points and 10 seconds), there is two dimensional code in the lower right corner of target video.The specific knot of the two dimensional code Structure is as shown in figure 4, two dimensional code is in rectangular configuration, and having fixed pattern in the upper left corner, the upper right corner and the lower left corner of two dimensional code, (this is fixed Pattern is shown do not have network in actual displayed by way of grid).In the fixation pattern, the ratio of black and white Example is fixed, is 1:1:3:1:1.

Optionally, in the present embodiment, after identifying two dimensional code, the band of position where two dimensional code can be intercepted, from And the picture of two dimensional code is generated, and identified using system two dimensional code identification api, parse two-dimensional barcode information (data symbol Information), to obtain the page address that two-dimensional barcode information is identified.

Optionally, in the present embodiment, start timing screenshot function, the fixed time interval (that is, second fixed time interval) of setting For a predetermined value (for example, 0.5s, 0.6s etc.).The predetermined value can be set based on experience value, can also be according to client The performance at end is set, and can also be manually set by user.Above-mentioned timing screenshot function can be by video playing triggering, It can also be manually opened by user.Above-mentioned timing screenshot function interception can be video pictures in client current screen Play area (can carry out screenshot in such a way that boundary alignment etc. can determine video pictures position), be also possible to client Current screen, which contains video pictures.Above-mentioned is only a kind of example, does not do any limit to this in the present embodiment It is fixed.

Optionally, the operational order for trigger action mark is received.Aforesaid operations instruction can be by clicking the behaviour Make a check mark triggering, and the condition of triggering can include but is not limited to:

Optionally, after receiving the operational order for trigger action mark, according to the operational order, two dimension is jumped to Page address indicated by code, and show on the client and the displaying information in target pages indicated by the page address.

As a kind of optional scheme, display unit 1102 includes:

(1) first display module, for displaying target window on the client, wherein operation mark includes target window；

(2) second display modules, during playing video pictures on the client, operation mark is on the client Display position change.

The following example specifically combined is illustrated.It is right in the following manner after obtaining the band of position of two dimensional code Two dimensional code is identified:

1) band of position of two dimensional code is intercepted, generates two-dimension code image；

After parsing the corresponding page address of two dimensional code, floating layer window is created on the client, and the window's position size is The position size of two-dimension code area, background colour are transparent.According to the corresponding page address of the two dimensional code of parsing, mentioned in floating layer window It operates and shows for different UI, such as click and jump operation.

Optionally, above-mentioned apparatus further include:

Screenshot unit, for carrying out screenshot to video pictures using the first fixed time interval；

First detection unit, for detecting in the first screenshot picture that screenshot obtains two dimensional code in the first screenshot picture Position.

The following example specifically combined is illustrated.In this example, the display position of operation mark on the client with Change in location of the two dimensional code in video pictures changes, and operation mark is floating layer window.

In this example, tracking module is created using CMT track algorithm, tracing area is the position area where two dimensional code Domain.And start-up trace module timer.The initialization procedure of tracking module may comprise steps of:

1) screenshot image is converted into gray level image (screenshot image when initialization)；

4) dividing the image into foreground and background, (e.g., prospect includes the band of position of two dimensional code, and background includes non-two dimensional code The band of position).

1) screenshot image (the screenshot image during tracking) is converted into gray level image.

If 2) image is longer or wider than 1500 pixels, compress in gray level image to 1500*1500 Pixel Dimensions (with creation When be consistent)；

3) current location of key point is calculated using optical flow method；

4) the new position of tracing area (that is, two-dimension code area) is obtained using global registration and local matching；

Through this embodiment, performance objective operation is prompted by way of target window, intuitive display is easy to operate, because This, improves intuitive and operability that operation mark is shown.Further, two dimensional code is followed to be moved by operation mark Dynamic, user experience is more natural, improves user experience.Further, true in such a way that timing carries out screenshot to video pictures The position for determining two dimensional code since fixed time interval can be adjusted flexibly, and need not monitor each frame in each video, reduce pair The occupancy of client software and hardware resources.

As a kind of optional scheme, the device further include:

Second detection unit, for detecting in the video pictures played on the client comprising two dimensional code；

Recognition unit obtains two-dimensional barcode information, wherein two-dimensional barcode information for identifying to the two dimensional code detected For identified page address.

Optionally, second detection unit includes:

(1) screen capture module, for carrying out screenshot to video pictures using the second fixed time interval；

(2) detection module, for detecting in the second screenshot picture that screenshot obtains comprising one or more target images Pattern, wherein target image pattern is for identifying two dimensional code.

Optionally, detection module includes:

(1) first transform subblock, for the second screenshot picture to be converted to gray level image；

(2) second transform subblocks, for being bianry image by greyscale image transitions；

(3) detection sub-module, for detecting in bianry image comprising one or more target image patterns.

It is illustrated in conjunction with specific example.First turn on the function that two dimensional code is identified in client or application program. Start timing screen capture module, setting fixed time interval (that is, second fixed time interval, for example, being 0.5s), it is raw that timing intercepts current screen At a screenshot picture.

Whether there is two dimensional code in identification screenshot picture, obtains the band of position of two dimensional code, detailed process if any It is as follows

3) identify in bianry image whether there is two dimensional code.

Due to having fixed pattern there are three apex angle among two dimensional code rectangle frame, and black and white in apex angle rectangle Ratio is fixed, and is 1:1:3:1:1, as shown in Figure 10.

After detecting that two dimensional code occur in video pictures, position of the two dimensional code in video pictures may further determine that It sets.The findContours method that can be used in opencv image library carries out contour detecting, obtains all profiles in image.Again According to information such as the ratio of apex angle rectangle, positions, the band of position of the two dimensional code in screenshot picture is obtained.

Optionally, the second fixed time interval may be the same or different with the first fixed time interval.Optionally, the second timing Interval can be longer than the first fixed time interval time.

Through this embodiment, by the video pictures that play in detection client comprising two dimensional code, and to detecting Two dimensional code is identified, two-dimensional barcode information is obtained, and can detecte and identify the two dimensional code in video pictures, is jumped and is provided for information Page address information.Further, determined in video pictures in such a way that timing carries out screenshot to video pictures whether include Two dimensional code since fixed time interval can be adjusted flexibly, and need not monitor each frame in video, reduce to client software and hardware The occupancy of resource.Further, the first fixed time interval of setting is shorter than the second fixed time interval, can more effectively track two dimensional code Change in location improves the efficiency that information jumps.

Another aspect according to an embodiment of the present invention, additionally provides a kind of storage medium, and meter is stored in the storage medium Calculation machine program, wherein the computer program is arranged to execute the step in any of the above-described embodiment of the method when operation.

Optionally, in the present embodiment, above-mentioned storage medium can be set to store by executing based on following steps Calculation machine program:

S1 is shown on the client in the case where in detecting the video pictures played on the client comprising two dimensional code Show operation mark, wherein for operation mark for prompting performance objective to operate, object run is to jump to page indicated by two dimensional code Face address；

S2 receives the operational order for trigger action mark；

S3 jumps to page address according to operational order, and shows and the exhibition in target pages indicated by page address Show information.

Displaying target window on the client, wherein operation mark includes target window.

Second screenshot picture is converted to gray level image by S1；

Greyscale image transitions are bianry image by S2；

S3 is detected in bianry image comprising one or more target image patterns.

Optionally, storage medium is also configured to store for executing step included in the method in above-described embodiment Computer program, this is repeated no more in the present embodiment.

Optionally, in the present embodiment, those of ordinary skill in the art will appreciate that in the various methods of above-described embodiment All or part of the steps be that the relevant hardware of terminal device can be instructed to complete by program, the program can store in In one computer readable storage medium, storage medium may include: flash disk, read-only memory (Read-Only Memory, ROM), random access device (Random Access Memory, RAM), disk or CD etc..

Another aspect according to an embodiment of the present invention additionally provides a kind of for implementing the electricity of above- mentioned information jump method Sub-device, as shown in figure 12, which includes, including processor 1202 and memory 1204, deposits in the memory 1204 Computer program is contained, which is arranged to execute in any of the above-described embodiment of the method by computer program Step.

Optionally, in the present embodiment, above-mentioned electronic device can be located in multiple network equipments of computer network At least one network equipment.

Optionally, in the present embodiment, above-mentioned processor can be set to execute following steps by computer program:

S2 receives the operational order for trigger action mark；

Optionally, it will appreciated by the skilled person that structure shown in Figure 12 is only to illustrate, electronic device can also To be smart phone (such as Android phone, iOS mobile phone), tablet computer, palm PC and mobile internet device The terminal devices such as (Mobile Internet Devices, MID), PAD.Figure 12 it does not make to the structure of above-mentioned electronic device At restriction.For example, electronic device may also include than shown in Figure 12 more perhaps less component (such as network interface) or With the configuration different from shown in Figure 12.

Wherein, memory 1204 can be used for storing software program and module, as the information in the embodiment of the present invention jumps Corresponding program instruction/the module of method and apparatus, the software program that processor 1202 is stored in memory 1204 by operation And module realizes above-mentioned information jump method thereby executing various function application and data processing.Memory 1204 It may include high speed random access memory, can also include nonvolatile memory, such as one or more magnetic storage device dodges It deposits or other non-volatile solid state memories.In some instances, memory 1204 can further comprise relative to processor 1202 remotely located memories, these remote memories can pass through network connection to terminal.The example of above-mentioned network includes But be not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.

Optionally, in the present embodiment, above-mentioned electronic device further includes transmitting device 1210, which is used for Data are received or sent via a network.Above-mentioned network specific example may include cable network and wireless network.One In a example, transmitting device 1210 include network adapter (Network Interface Controller, referred to as NIC), can be connected by cable with other network equipments with router so as to be communicated with internet or local area network.In In one example, transmitting device 1210 is radio frequency (Radio Frequency, referred to as RF) module, is used to pass through wireless parties Formula is communicated with internet.

Optionally, in the present embodiment, above-mentioned electronic device further include: user interface 1206 and display 1208, wherein For aforementioned display device 1208 for showing video pictures and operation mark, above-mentioned user interface 1206 operates corresponding behaviour for obtaining It instructs, wherein aforesaid operations can include but is not limited to: contact action, clicking operation, voice input operation etc..

The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.

If the integrated unit in above-described embodiment is realized in the form of SFU software functional unit and as independent product When selling or using, it can store in above-mentioned computer-readable storage medium.Based on this understanding, skill of the invention Substantially all or part of the part that contributes to existing technology or the technical solution can be with soft in other words for art scheme The form of part product embodies, which is stored in a storage medium, including some instructions are used so that one Platform or multiple stage computers equipment (can be personal computer, server or network equipment etc.) execute each embodiment institute of the present invention State all or part of the steps of method.

In the above embodiment of the invention, it all emphasizes particularly on different fields to the description of each embodiment, does not have in some embodiment The part of detailed description, reference can be made to the related descriptions of other embodiments.

In several embodiments provided herein, it should be understood that disclosed client, it can be by others side Formula is realized.Wherein, the apparatus embodiments described above are merely exemplary, such as the division of the unit, and only one Kind of logical function partition, there may be another division manner in actual implementation, for example, multiple units or components can combine or It is desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or discussed it is mutual it Between coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or communication link of unit or module It connects, can be electrical or other forms.

The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.

It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of software functional units.

The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.

Claims

1. a kind of information jump method characterized by comprising

In the case where including two dimensional code in detecting the video pictures played on the client, behaviour is shown in the client It makes a check mark, wherein the operation mark is for prompting performance objective to operate, and the object run is jumps to the two dimensional code institute The page address of instruction；

Receive the operational order for triggering the operation mark；

According to the operational order, the page address is jumped to, and is shown and target pages indicated by the page address In displaying information.

2. the method according to claim 1, wherein showing that the operation mark includes: in the client

The displaying target window in the client, wherein the operation mark includes the target window.

3. according to the method described in claim 2, it is characterized in that,

The target window is upper one layer of the window for being shown in the video pictures；Alternatively,

The target window is the window being shown in the video pictures same layer.

4. the method according to claim 1, wherein showing that the operation mark includes: in the client

During playing the video pictures in the client, display position of the operation mark in the client It sets and changes with change in location of the two dimensional code in the video pictures.

5. according to the method described in claim 4, it is characterized in that, display position of the operation mark in the client With the two dimensional code before the change in location in the video pictures changes, the method also includes:

Screenshot is carried out to the video pictures using the first fixed time interval；

Position of the two dimensional code in the first screenshot picture described in the first screenshot picture that detection screenshot obtains.

6. the method according to any one of claims 1 to 5, which is characterized in that show the behaviour in the client Before making a check mark, the method also includes:

It detects in the video pictures played in the client comprising the two dimensional code；

The two dimensional code detected is identified, two-dimensional barcode information is obtained, wherein the two-dimensional barcode information is for identifying institute State page address.

7. method according to claim 1, which is characterized in that detect the video played in the client Include: comprising the two dimensional code in picture

Screenshot is carried out to the video pictures using the second fixed time interval；

It detects in the second screenshot picture that screenshot obtains comprising one or more target image patterns, wherein the target figure Decent formula is for identifying two dimensional code.

8. being wrapped in the second screenshot picture that screenshot obtains the method according to the description of claim 7 is characterized in that detecting Include: containing one or more target image patterns

The second screenshot picture is converted into gray level image；

It is bianry image by the greyscale image transitions；

It detects in the bianry image comprising one or more target image patterns.

9. the method according to the description of claim 7 is characterized in that the target image pattern is in the region of designated shape Assigned direction on, the pixel of at least two colors is arranged according to designated ratio.

10. a kind of information jumps device characterized by comprising

Display unit, in the case where for including two dimensional code in detecting the video pictures played on the client, described Display operation identifies in client, wherein for the operation mark for prompting performance objective to operate, the object run is to jump To page address indicated by the two dimensional code；

Receiving unit, for receiving the operational order for triggering the operation mark；

Jump-transfer unit for jumping to the page address according to the operational order, and is shown signified with the page address Displaying information in the target pages shown.

11. device according to claim 10, which is characterized in that the display unit includes:

First display module, for the displaying target window in the client, wherein the operation mark includes the target Window；And

Second display module, during for playing the video pictures in the client, the operation mark is in institute The display position stated in client changes with change in location of the two dimensional code in the video pictures.

12. device according to claim 11, which is characterized in that described device further include:

Screenshot unit, for carrying out screenshot to the video pictures using the first fixed time interval；

First detection unit, for detecting two dimensional code described in the first screenshot picture that screenshot obtains in first screenshot Position in picture.

13. device according to any one of claims 10 to 12, which is characterized in that described device further include:

Second detection unit, for detecting in the video pictures played in the client comprising the two dimensional code；

Recognition unit obtains two-dimensional barcode information, wherein the two dimensional code for identifying to the two dimensional code detected Information is for identifying the page address；

Wherein, the second detection unit includes: screen capture module, for being carried out using the second fixed time interval to the video pictures Screenshot；Detection module, for detecting in the second screenshot picture that screenshot obtains comprising one or more target image patterns, In, the target image pattern is for identifying two dimensional code.

14. device according to claim 13, which is characterized in that the detection module includes:

First transform subblock, for the second screenshot picture to be converted to gray level image；

Second transform subblock, for being bianry image by the greyscale image transitions；

Detection sub-module, for detecting in the bianry image comprising one or more target image patterns.

15. a kind of electronic device, including memory and processor, which is characterized in that be stored with computer journey in the memory Sequence, the processor are arranged to execute side described in any one of claim 1 to 9 by the computer program Method.