CN107077754A - The method of display device and control display device - Google Patents

The method of display device and control display device Download PDF

Info

Publication number
CN107077754A
CN107077754A CN201580059684.5A CN201580059684A CN107077754A CN 107077754 A CN107077754 A CN 107077754A CN 201580059684 A CN201580059684 A CN 201580059684A CN 107077754 A CN107077754 A CN 107077754A
Authority
CN
China
Prior art keywords
stroke
area
information
processing unit
graphics processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201580059684.5A
Other languages
Chinese (zh)
Other versions
CN107077754B (en
Inventor
金政范
安相俊
朴奉壎
崔秀濂
崔俊铉
朴赞敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of CN107077754A publication Critical patent/CN107077754A/en
Application granted granted Critical
Publication of CN107077754B publication Critical patent/CN107077754B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/20Drawing from basic elements, e.g. lines or circles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/20Drawing from basic elements, e.g. lines or circles
    • G06T11/203Drawing of straight lines or curves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/005General purpose rendering architectures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/30Clipping

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Geometry (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Generation (AREA)

Abstract

The invention provides a kind of display device.Display device includes:Graphics processing unit, it draws stroke;Display, its display includes the image of drawn stroke;And processor, when repainting event on image, processor identification repaints area, and the spatial cue that the stroke that area includes is repainted for rendering is provided and arrives graphics processing unit, wherein, graphics processing unit is based on spatial cue, and point of use pel repaints the stroke that area includes to render.

Description

The method of display device and control display device
Technical field
The apparatus and method consistent with the disclosure are related to display device and the method for controlling display device, and more specifically Ground, is directed to use with graphics processing unit to render the display device of stroke and control the method for the display device.
Background technology
According to the development of electronic technology, develop and extended various display devices, such as TV (TV), mobile electricity Words, laptop computer and tablet PC (PC).The increase used according to display device, the need for user is to various functions Increase.Therefore, the need in order to meet user, many effort have been made in manufacturer, to have sequentially activated Product with non-existent New function in correlation technique.
Especially, touch-sensing technology is applied to nearest display device, has been able to pass through so as to obtain user Various documents or figure are created and edited using its finger or an entering stroke.Therefore, user is created by inputting many lines Build document or making figure, and there occurs during document is created the situation of edit object (such as go/picture/text).
In this case, display device should make the zone void occupied by each object, to repaint and the region Intersecting line.Here, in the case of being intersected each other in the region of edit object and a large amount of strokes, display device needs the plenty of time To render all strokes so that produce delay and performance is deteriorated.
Fig. 1 (a) shows this example.When showing user by the entering stroke 11-1 of touch-screen 10 and 12, user is defeated Enter the edit commands for stroke 11-1 to be moved to other positions, stroke 11-2 is moved to by display device according to user command Then correspondence position repaints stroke.
In this case, due to a large amount of strokes that the region 20 occupied by stroke 11-2 includes and intersected each other 11-2 and 12 is redrawn, so needing the plenty of time so that performance is deteriorated.
Overcome performance degradation in the case of in order to occur in the event that repaints, it may be considered that using in order to largely render figure Member (such as point or triangle) and the method for graphics processing unit (GPU) optimized.Here, pel is the substantially single of configuration stroke Member, pel represents point, triangle etc., and a triangle primitives have three summits, and pel has a summit.
Meanwhile, in order to practically express the writing pressure of finger or pen, usually using by by substantial amounts of circle each other The method for connecting to be drawn.The size of circle is determined depending on finger or pressure, area, speed of pen input etc., and It can represent the texture image of a texture by being filled in circle and represent various types of pattern textures.Fig. 1 (b) shows Gone out the example rendered based on round stroke as described above, and as shown in Fig. 1 (b) right figure, some circles be connected to each other with Just the stroke as shown in Fig. 1 (b) left figure is drawn.
Generally, when using GPU graphings, targeted graphical to be drawn is divided into triangle, and triangle is passed It is sent to GPU.The figure for being divided into triangle is referred to as grid.In order to render circle in a grid formation, shown in such as Fig. 1 (c), if circle by Dry triangle sets into.That is, for example, as shown in Fig. 1 (b) right figure, in a round purport of multiple circles of configuration stroke In the case where being rendered using GPU, the circle is configured in a grid formation using some triangle primitives.In such case Under, it should using the triangle of predetermined quantity or more, smoothly to draw circle.
Therefore, when rendering bowlder by GPU according to prior art, smoothly drawing circle needs a large amount of summits.However, when top During point quantity increase, the amount increase of the memory used, and GPU data volume will be sent to from CPU (CPU) Also increase.Therefore, it should which the amount of calculation handled in GPU also increases, so as to cause to be difficult to obtain optimum performance by GPU.
Meanwhile, receive the pel and defeated on screen of specific quantity (for example, quantity of the pel of one stroke of configuration) What a series of processes for going out certain amount of pel were referred to as GPU renders pipeline.A processing base of pipeline is rendered due to performing Cost and time are needed on this, and in the case where rendering identical input, pipeline is rendered in performance and power consumption using as small as possible Aspect is favourable.
In the related art, performed generally in an object unit and render pipeline, and in the case where rendering stroke, Pipeline is rendered generally for (such as round) execution one of each pel, or one is performed for each stroke and renders pipeline.So And, it is such as of the prior art performed for each pel or each stroke one render pipeline in the case of, it is a large amount of when rendering During short stroke (such as letter or sentence), it should which execution largely renders pipeline, this performance for causing display device and power are asked Topic.
The content of the invention
Technical problem
, can be with low-power and high-performance wash with watercolours present disclose provides one kind when using graphics processing unit to render stroke Contaminate the display device of stroke, and the method for controlling the display device.
Technical solution
According to an aspect of this disclosure, a kind of display device includes:Graphics processing unit, it draws stroke;Display, Its display includes the image of drawn stroke;And processor, when repainting event on the image, processor is known Area is not repainted, and the spatial cue that the stroke that area includes is repainted for rendering is provided to graphics process list Member, wherein, graphics processing unit is based on spatial cue, and point of use pel repaints the stroke that area includes to render.
Spatial cue can include being used for the transitional information by being converted into cutting out space than repainting the broader region in area.
Graphics processing unit can will repaint area based on transitional information and be converted into cutting out space, and using configuration The point pel for cutting out the stroke that space includes of conversion repaints the stroke that area includes to render.
Processor can based on configuration repaint the stroke that area includes multiple pels radius in maximum half Footpath, calculates transitional information.
Transitional information includes following matrix:
Wherein w represents to repaint the width in area, and h is the height for repainting area, and r is maximum radius.
Spatial cue can include reverse conversion information, and it is used to repainting area to the ratio for having been converted into cutting out space wide Region carry out reverse conversion, and processor can use configuration to repaint multiple pels of the stroke that area includes Maximum radius in radius, calculates reverse conversion information.
Reverse conversion information can include following viewport information:
(- r ,-r, w+2r, h+2r)
Wherein w represents to repaint the width in area, and h is the height for repainting area, and r is maximum radius.
Display device can also include the touch input for receiving the stroke of input, and wherein spatial cue includes repainting area The depth information of each and style information in the multiple strokes included, the pen inputted whenever change by touch input During the pattern of picture, processor changes and distributes depth information.
Graphics processing unit can render the pen for repainting and having same pattern information in the stroke that area includes simultaneously Draw.
Graphics processing unit can be according to depth information, and rendering to repaint has different patterns in the stroke that area includes Intersection point between the stroke of information.
Graphics processing unit can use the depth that its depth information includes in the stroke with different style informations The relatively low stroke of value, renders the intersection point between the stroke with different style informations.
According to another aspect of the disclosure, a kind of method that control includes the display device of graphics processing unit includes: When repainting event on the image including stroke, identification repaints area;It will be used to render and repaint area Zhong Bao The spatial cue of the stroke included, which is provided, arrives graphics processing unit;And by graphics processing unit, based on spatial cue, point of use Pel repaints the stroke that area includes to render.
Spatial cue can include being used for the transitional information by being converted into cutting out space than repainting the broader region in area.
Rendering may include:Area will be repainted based on transitional information to be converted into cutting out space, and changed using configuration Cut out the stroke that space includes point pel repaint the stroke that area includes to render.
Offer can include:Maximum in the radius for multiple pels for repainting the stroke that area includes based on configuration Radius, calculates transitional information.
Transitional information includes following matrix:
Wherein w represents to repaint the width in area, and h is the height for repainting area, and r is maximum radius.
Spatial cue can include reverse conversion information, and it is used to repaint area more to the ratio for having been converted into cutting out space Wide region carries out reverse conversion, and provides and can include:The multiple points for the stroke that area includes are repainted using configuration Maximum radius in the radius of pel, calculates reverse conversion information.
Reverse conversion information can include following viewport information:(- r ,-r, w+2r, h+2r)
Wherein w represents to repaint the width in area, and h is the height for repainting area, and r is maximum radius.
Display device can also include the touch input for receiving inputted stroke, control the method for display device can be with Including:Change when the pattern of the stroke inputted by touch input changes and distribution depth information, will in step is provided The depth information and style information for repainting the stroke that area includes are provided to graphics processing unit as spatial cue.
In rendering step, the pen for repainting and there is same pattern information in the stroke that area includes can be rendered simultaneously Draw.
In rendering step, it can render and repaint in the stroke that area includes with not same according to depth information Intersection point between the stroke of formula information.
In rendering step, the depth that its depth information includes in the stroke with different style informations can be used The relatively low stroke of value, renders the intersection point between the stroke with different style informations.
Beneficial effect
The various exemplaries of the disclosure as described above, the stroke that can improve display device renders performance And consumed power can be reduced.
Brief description of the drawings
Fig. 1 is for describing the view according to the problem of prior art and background technology.
Fig. 2 is the block diagram of the configuration for the display device for showing the exemplary according to the disclosure.
Fig. 3 is the block diagram of the configuration for the display device for showing another exemplary according to the disclosure.
Fig. 4 is explanatory the problem of showing to occur when point of use pel is to render stroke.
Fig. 5 is the method for rendering stroke for describing the point of use pel according to the exemplary of the disclosure View.
Fig. 6 to Fig. 7 is for describing to be believed according to the pattern of the use stroke of another exemplary of the disclosure Cease with depth information to render the explanatory of the method for stroke.
Fig. 8 is for describing being used when point of use pel is to render stroke according to the exemplary of the disclosure The explanatory of the method for depth information.
Fig. 9 is the flow chart for the method for showing the control display device according to the exemplary of the disclosure.
Figure 10 is the stream for the method that stroke is rendered by display device for showing the exemplary according to the disclosure Cheng Tu.
Figure 11 is the flow for the method for showing the control display device according to another exemplary of the disclosure Figure.
Embodiment
When the detailed description for determining the known technology related to the disclosure may unnecessarily obscure the main points of the disclosure When, the detailed description of the known technology will be omitted.In addition, the term "~er (or~or) " of the component used in following description It is only used for easily carrying out disclosure.Therefore, these terms are in itself and without the implication or effect being distinguished from each other.
Fig. 2 is the block diagram of the configuration for the display device for showing the exemplary according to the disclosure.As shown in Fig. 2 Display device 100 includes display 110, graphics processing unit (GPU) 120 and processor 130.Here, display device 100 can be with Realized by various types of electronic installations, such as TV (TV), smart phone, tablet personal computer (PC), numeral conversion Device, laptop computer, monitor, BBS, electronic watch and significantly display.
Display 110 shows various images.Especially, display 110 can show what is rendered by graphics processing unit 120 Stroke.Here, the stroke for the line that the image (for example, text or drawing) created as user includes may mean that from one End is joined seamlessly to a line unit of the other end.For example, stroke can be a stroke of digital or character, the one of configuration diagram Individual row etc., but not limited to this.
Meanwhile, display 110 may be implemented as including various display panels, such as liquid crystal display (LCD), You Jifa Optical diode (OLED), plasma display (PDP) etc., may be realized with the touch-screen form including touch panel.
Processor 130 controls the overall operation of display device 100.Especially, when show on display 110 and including When repainting event on the image of stroke, processor 130, which can be recognized, repaints area, and spatial cue is provided To graphics processing unit, the spatial cue is used to render the stroke that area includes that repaints recognized.
Here, it is at least one of event for repainting the image including stroke to repaint event, for example, depositing In the case of user's edit commands of the text shown on for display 110 or the subregion of drawing or some stroke, May occur the stroke included for correspondence editing area repaints event.
However, repainting the generation not limited to this of event.For example, in the file and picture existed for editing or painting In the case of imaged refresh command, it is also possible to repaint event.In the disclosure, the type of event is repainted It is unrestricted.
When repainting event generation as described above, processor 130 can be recognized to be performed again to image wherein Draw the region (repainting area) of operation.Here, it is wherein to figure depending on the event that repaints to repaint area As the region that the stroke included is repainted, it can be the editing area for example depending on user's edit commands to repaint area, But not limited to this.Here, editing area can have quadrangle form, such as bounding box.
Spatial cue can be provided and arrive graphics processing unit 120 by processor 130, and the spatial cue is used to render to paint again The stroke that area processed includes.In this case, according to the exemplary of the disclosure, spatial cue can include:Turn Information is changed, it is used to be converted into cutting out space than repainting the broader region in area;Reverse conversion information, it is used to have turned Change into cut out space ratio repaint the broader space reverse conversion in area into its size and repaint area's size identical show Show area;Information relevant with the pel for configuring stroke etc..
Specifically, in order that rendering stroke with graphics processing unit, procedure below is performed:The pel of stroke will be configured All summits, which are transformed into, is cut out in space, and the pel cut out outside space is positioned to shear;It only will be located into and cut out space Interior pel reverse conversion is into display space.In the process, processor 130 calculates or obtained graphics processing unit and renders pen Spatial cue needed for drawing, and spatial cue is provided to graphics processing unit 120.
Therefore, graphics processing unit 120 can use the spatial cue provided from processor 130 to render stroke.
Especially, according to the exemplary of the disclosure, processor 130 can will configure the respective point of correspondence stroke The coordinate information and radius information of pel and above-mentioned transitional information and reverse conversion information, which are provided, arrives graphics processing unit 120, to cause graphics processing unit 120 can be rendered with point of use pel to repaint the stroke that area includes, and figure Processing unit 120 can be based on the spatial cue provided from processor 130, and point of use pel repaints area and included to render Stroke.
As noted previously, as rendering stroke by using a pel, a summit can represent a circle, therefore and base Compared in the method for the circle of grid rendering configurations stroke, less amount of summit can be used to represent stroke.Therefore, processing data Amount reduce so that high-performance stroke, which is rendered, becomes possibility.
Meanwhile, according to the exemplary of the disclosure, processor 130 can will be used as the transitional information of spatial cue Graphics processing unit 120 is provided, the transitional information is used to be converted into cutting than the broader region in area that repaints recognized Cut out space.This is to prevent from painting again to render by the conventional method point of use pel of rendering primitives in graphics processing unit During the stroke that area processed includes, it may occur however that stroke disconnect phenomenon.Stroke, which is described, hereinafter with reference to Fig. 4 disconnects the detailed of phenomenon Content.
In detail, processor 130 can repaint the radius of multiple pels of the stroke that area includes based on configuration In maximum radius, calculate transitional information and reverse conversion information, and the transitional information calculated and reverse conversion information are carried It is supplied to graphics processing unit 120.
For example, when the width for repainting area is w, the height for repainting area is h, and configuration repaints area Zhong Bao When maximum radius in the radius of multiple pels of the stroke included is r, processor 130 can calculate transitional information (such as with The matrix of lower equation 1) and provide the transitional information calculated to graphics processing unit 120.
[equation 1]
It is general cut out space be wherein x, y and z axes each have -1 to 1 scope space.It therefore, it can by this Matrix will be converted into cutting out space than repainting the broader region in area.
Meanwhile, as described above, during it will be converted into cutting out space than repainting the broader region in area, being positioned at Cut out the pel outside space to be tailored, this is referred to as cutting out.Therefore, graphics processing unit 120 will again using above-mentioned matrix Draw area to be converted into cutting out space, then during reverse conversion, using only cutting out the point pel existed in space again Draw in area and render stroke.
Simultaneously as than cut out space it is broader repaint area and be converted into cut out space, cut out space having changed In the case of by reverse conversion same as before, it may occur however that repaint the feelings that the stroke rendered in area becomes more shorter than actual stroke Condition.Therefore, processor 130 can use the exemplary maximum radius r as described above according to the disclosure, will be following Reverse conversion information represented by equation 2 provides to graphics processing unit 120 to correct such case.
[equation 2] (- r ,-r, w+2r, h+2r)
Therefore, graphics processing unit 120 carrys out reverse conversion using reverse conversion information and cuts out space, to repaint The point pel cut out and existed in space is rendered in area, thus it can be prevented that what is rendered stroke by using a pel and may occur The stroke for repainting area disconnects phenomenon.
Fig. 3 is the block diagram of the configuration for the display device for showing another exemplary according to the disclosure.According to Fig. 3, display device 200 can include display 210, graphics processing unit 220, processor 230, touch input 240 and storage Device 250.Fig. 3 display 210, graphics processing unit 220 and processor 230 can perform the display described by Fig. 2 110th, the institute of graphics processing unit 120 and processor 130 is functional and operates.Therefore, it will be omitted and by figure when describing Fig. 3 The overlapping description of the part identical part of 2 descriptions.
Touch input 240 receives the touch input of user.Especially, touch input 240 can receive user and use finger Or the stroke of input unit (for example, pen) input.As set forth above, it is possible under control of a processor 230, on the display 210 The stroke that display is inputted by touch input 240.
Therefore, touch input 240 can include touch panel.In which case it is possible to use various schemes are (such as electric Resistance scheme, capacitive scheme, surface acoustic wave (SAW) scheme, infrared scheme, optical plan and electromagnetic induction scheme) it is used as touch surface The touch-sensing scheme of plate.In addition, touch input 240 can with the separate configuration of display 210, or in the form of touch-screen with Display 210 is integratedly configured.
Meanwhile, according to the exemplary of the disclosure, processor 230 can be multiple by repaint that area includes The style information of each and depth information in stroke are provided as spatial cue arrives graphics processing unit 220.
Here, as the information relevant with the pattern of the input unit for drawing stroke, style information can include face Color information, type information of pen etc..Here, selection can be rendered by the stroke of entering stroke establishment document or drawn picture and answered With the various pens provided, even if physically mutually the same, pen also becomes different from each other, or pen is physically each other not Together, cause the type of pen may be different from each other.
Meanwhile, according to the exemplary of the disclosure, whenever the pattern of entering stroke is changed and is given to During correspondence stroke, thus it is possible to vary be used as the depth information for the information for representing entering stroke sequence.
Specifically, when by touch input 240 input special style a stroke when, processor 230 can will currently Depth value is assigned to correspondence stroke, and then when the pattern of stroke does not change, identical depth value can be assigned to each pen Draw.When the pattern of entering stroke changes, processor 230 can change depth value and the depth value of change is assigned into its sample The stroke that formula changes.As described above, processor 230 can by depth value with the multiple strokes inputted by touch input 240 Each matched, and be stored in the depth value of matching as depth information in memory 250.In addition, processor 230 can be matched the pattern of the multiple strokes inputted by touch input 240 with corresponding stroke, and by the pattern of matching It is stored in as style information in memory 250.
Then, when repainting event on the image of the multiple strokes shown on including display 21, processing Device 230, which can be recognized, repaints area, and will be stored in depth information and style information in memory 250 with again Draw the relevant depth information of the stroke that includes of area and style information provides and arrives graphics processing unit.
Therefore, graphics processing unit 220 can render to repaint simultaneously has same pattern in the stroke that area includes The stroke of information.In detail, graphics processing unit 220 can render pipeline to render with same pattern information by one Stroke.In this case, graphics processing unit 220 can be rendered according to depth information and repaint the stroke that area includes In have different style informations stroke between intersection point.
For example, in first stroke of the user by the input pattern a of touch input 240, changing the pattern of pen to input sample Formula b the second stroke, is then changed to pattern a to input the 3rd stroke by the pattern of pen again, to cause first to the 3rd In the case that picture intersects each other, 100 depth value can be assigned to pattern a the first stroke by processor 230, and by first The style information and depth information of stroke are stored in memory 250.Then, because the pattern of the second stroke changes, so place The depth value 99 of change can be assigned to the second stroke by reason device 230, and by the style information and depth information of the second stroke It is stored in memory 250.Because the pattern of the 3rd stroke that finally enters from the pattern b of the second stroke is changed into pattern a, therefore Depth value can be changed into 98 by processor 230, and the depth value for 98 is assigned into the 3rd stroke, and by style information and depth Degree information is stored in memory 250.
Then, when repainting event in the image district including the first to the 3rd stroke, processor 230 can be by There is provided about the style information and depth information of the first to the 3rd stroke as spatial cue to graphics processing unit 220.
Therefore, graphics processing unit 220 can render the first stroke with same pattern information a and the 3rd simultaneously Draw, then the rendering style b the second stroke again.Graphics processing unit 220 can also render the second stroke, and the is then rendered simultaneously Unicursal and the 3rd stroke.
In this case, when graphics processing unit 220 is rendered with the first stroke of different style informations and second During intersection point between picture, because the depth value (99) of the second stroke is less than the depth value (100) of the first stroke, therefore graphics process Unit 220 can use the second stroke to render the intersection point between the first stroke and the second stroke.
In addition, when graphics processing unit 220 is rendered between the second stroke and the 3rd stroke with different style informations During intersection point, graphics processing unit 220 can use the 3rd stroke with relatively low depth value to render the second stroke and the 3rd Intersection point between picture.
As described above, according to the exemplary of the disclosure, rendering pipeline by one while rendering with identical The stroke of style information, it is possible thereby to reduce the number of times of the reproduction pipeline of execution.In addition, having depending on depth information to render Intersection point between the stroke of different style informations, can also be accurate even if thus rendering the stroke with same pattern information simultaneously Really represent the order for the stroke that user is inputted.
Meanwhile, when the event that repaints occurs, except repaint style information and depth information that area includes it Outside, processor 230 can will configure the coordinate information and radius information of each point pel of correspondence stroke and above-mentioned conversion is believed Breath and reverse conversion information are provided as spatial cue arrives graphics processing unit 220, to allow graphics processing unit 220 to make With as above to render repainting the stroke that area includes by the point pel described in Fig. 2.
Therefore, even if repainting area Zhong Bao when graphics processing unit 220 is rendered according to style information and depth information During the multiple strokes included, graphics processing unit 220 can also point of use pel render multiple strokes.As described above, according to this Disclosed exemplary, when the point of use pel of graphics processing unit 220 is to render stroke, is used together depth information Detailed content will be described in detail below by Fig. 8.
Meanwhile, painted again in style information of the graphics processing unit 220 according to by Fig. 3 and depth information to render In the case of the exemplary for multiple strokes that area processed includes, graphics processing unit 220 not necessarily uses point diagram Member renders corresponding stroke.
For example, following exemplary embodiment will be possible:Except the pattern for repainting the stroke that area includes is believed Outside breath and depth information, processor 230 will configure the vertex information of all triangle primitives of stroke, for that will repaint Area is converted to the transitional information of cutting out area and for cutting out the reverse conversion information conduct that area carries out reverse conversion to having changed Spatial cue, which is provided, arrives graphics processing unit 220, and graphics processing unit 220 is based on the pattern for repainting the stroke that area includes Information and depth information, stroke is rendered using triangle primitives.
Memory 250 can store the various programs and data of the operation for display device 200 wherein.In addition, depositing Reservoir 250 can also carry out the interim storage function of the data generated during the operation of display device 200.
Especially, memory 250 can store various spatial cues wherein.For example, memory 250 can be deposited wherein Storage:Each pel for the stroke that configuration is inputted by touch input 240 vertex information (particularly the coordinate information of each point pel and Radius information), for will repaint area or be converted into cutting out the transitional information in space, use than repainting the broader region in area In by it is switched cut out space reverse conversion into viewing area (specifically, repainting area) reverse conversion information, indicate it is logical Cross depth information, the Yi Jiduo for the related multiple strokes sequences of depth that touch input 240 is inputted and matched to corresponding stroke The style information of individual stroke.
In addition, memory 250 can store the various program modules of the operation for above-mentioned display device 200 wherein. For example, memory 250 can include:Document creation module, it can input and edit stroke to create including text or figure Image document;User interface (UI) module, it is used to interact between display device 200 and user;Stroke renders mould Block, it is used for the behaviour that processor 230 and graphics processing unit 220 are performed according to the various exemplaries of the above-mentioned disclosure Make etc..Therefore, processor 230 can read the various modules stored in memory 250, so as to according to the various of the above-mentioned disclosure Exemplary performs the operation of display device 200.
Simultaneously, although situations below is described above by example:When processor 130 or 230 provides spatial cue When, graphics processing unit 120 or 220 actively renders stroke using spatial cue, but this be merely for convenience and purposes of illustration Example, disclosure not limited to this.That is, graphics processing unit 120 or 220 can be under the control of processor 130 or 230 Stroke is rendered using spatial cue.
Hereinafter, the point of use of exemplary according to the disclosure will be more fully described by Fig. 4 to Fig. 5 Pel is come the method that renders stroke.Fig. 4 is illustrative the problem of showing to occur when point of use pel is to render stroke View.Specifically, Fig. 4 left figure shows a kind of state, wherein in the case where image is shown on display screen 400, by What is occurred in the subregion 420 of the image including a stroke 410 repaint event, and point of use pel is performed again Drawing modification, and Fig. 4 right figure is the enlarged drawing for repainting area 420.
Bag in area 420 is repainted that is, being rendered in graphics processing unit by conventional method point of use pel In the case of the stroke included, the stroke breaking part 421 in the outside of area 420 may be generated and repainted as shown in Fig. 4 right figure With 422.This problem occurs, OpenGL, OpenGL ES etc. due to OpenGL, OpenGL ES etc. performance specification It is standard 3D figures API (API) used in graphics processing unit described below.
In order that rendering such as triangle primitives with the graphics processing unit in performance specification or putting the pel of pel, need All summits for configuring pel are converted into cutting out space.Here, it is that wherein x, y and z axes each have -1 to 1 to cut out space Scope space.Cut out that to be located at the pel cut out outside space after space be on a display screen due to being converted into pel The part do not seen, therefore graphics processing unit will be located into the pel cut out outside space for the purpose effectively rendered and cuts Cut out, and this process is referred to as cutting out.
When cutting out pel according to performance specification as described above, in the case of triangle primitives, only it is positioned at and cuts Cut out the part outside space to be sheared, and therefore, it can render the part cut out and with triangle existed in space.
However, in the case of a pel, when the location of the core of point is being cut out outside space, being arranged in render process Except a pel in itself.As described above, generation needs the point pel for exporting but not rendering on a display screen so that occur stroke and disconnect Phenomenon.
In more detail, cut out in the location of the core of a pel outside space and some point pels are due to large radius And in the case of being positioned at and cutting out in space, performed according to general performance specification render when, even if these pels need It is included in rendering, also eliminates them in render process.That is, the phenomenon of elimination point pel is sent out in render process The raw part represented on the border for repainting area, such as Fig. 4 right figures by reference numeral 421 and 422 so that stroke is counted as Seemingly it is disconnected.
In order to solve this problem, it can be calculated according to the processor 130 or 230 of the disclosure:For configuration to be painted again The point pel of the stroke included in area processed is converted into cutting out the transitional information in space and for being cut out switched in space Including point pel reverse conversion be the reverse conversion information that repaints area, it is display 110 or 210 that this, which repaints area, One region, it is different from the transitional information depending on general performance specification and reverse conversion information, and by the conversion calculated Information and reverse conversion information, which are provided, arrives graphics processing unit 120 or 220.Fig. 5 is for describing according to the exemplary of the disclosure The point of use pel of embodiment renders the view of the method for stroke.
Fig. 5 (a), which is shown, is repainting the screen of the upper left extreme coordinates based on whole display 110 or 210 in area 510 For (x, y), repaint area width and height be respectively w and h in the case of, configuration repaint the pen that area 510 includes The multiple pels drawn.As described above, area will be being repainted be converted into cutting out the situation in space depending on general performance specification Under, the point pel 511 and 512 for being positioned at the boundary for repainting area 510 may be excluded in drawing process.
Therefore, according to the exemplary of the disclosure, processor 130 or 230 can be by the position of respective point pel Mobile (- x ,-y), and position after the movement of respective point pel is provided to graphics processing unit 120 or 220, so as to relatively Change configuration and repaint position of the respective point pel for the stroke that area 510 includes in area is repainted.
In addition, processor 130 or 230 can recognize that composition repaints multiple pels of the stroke that area 510 includes Radius in maximum radius, and the matrix as represented by above equation 1 as transitional information can be calculated, and in institute In the case that the maximum radius of identification is, for example, r, the matrix calculated is provided and arrives graphics processing unit 120 or 220.
Therefore, when graphics processing unit 120 or 220 uses the positional information and matrix of provided respective point pel, incite somebody to action When repainting area 510 and being converted into cutting out space, shown in such as Fig. 5 (b), it will be changed than repainting the broader region 520 in area 510 Into cutting out space 550.Here, reference picture 5 (b) is as can be seen that transfer process is performed as so that being repainted including being positioned at All pels of the point pel 511 and 512 of the boundary in area 510, which are positioned at, to be cut out in space 550.
That is, when that will repaint area by transition matrix and be converted into cutting out space, conversion is performed, to cause one The central point for being partly comprised in all pels repainted in area is present in and cut out in space, therefore the point pel omitted disappears Lose.
Simultaneously as being changed than actually repainting the broader region in area by the matrix as represented by above equation 1 Into space is cut out, graphics processing unit is arrived reverse conversion information being provided by the conventional method depending on above-mentioned performance specification In the case of, display size is less than to the stroke of actual size.
Therefore, according to the exemplary of the disclosure, processor 130 or 230 can use above-mentioned repaint The width w and height h and maximum radius r in area 510, calculate reverse conversion information represented by above equation 2, and by institute The reverse conversion information of calculating, which is provided, arrives graphics processing unit 120 or 220, to correct this problem.Therefore, graphics process is worked as When unit 120 or 220 uses the provided reverse conversion information to carry out reverse conversion and cut out space, area 510 can repainted In render the full sized stroke of its size.
Wrapped by being corrected according to the exemplary of the disclosure in the viewport information described in traditional performance specification The parameter included, obtains above-mentioned reverse conversion information.Therefore, performed as using the corresponding parametric values included in reverse conversion information The method detailed of inverse conversion, can use the method according to traditional performance specification.However, due to it and the disclosure main points without Close, therefore its detailed description will be omitted.
Simultaneously, although describe procedure below in above-mentioned Fig. 5 description:When processor 130 or 230 provides corresponding point diagram When the mobile location information and transitional information of member, graphics processing unit 120 or 220 will repaint area and be converted into cutting out space; Then when processor 130 or 230 provides reverse conversion information, reverse conversion is carried out to cutting out space and to render repaints area In the stroke that includes, this is only to aid in understanding the example for rendering stroke process, disclosure not limited to this.
That is, when the event that repaints occurs, processor 130 or 230 can by graphics processing unit 120 or The 220 all data rendered needed for stroke, which are provided, arrives graphics processing unit 120 or 220, and the data such as repaint area Zhong Bao Mobile location information, transitional information and the reverse conversion information of the respective point pel included, graphics processing unit 120 or 220 is then Can rendering order and render stroke according to processor 130 or 230.
Fig. 6 to Fig. 7 is for describing to be believed according to the pattern of the use stroke of another exemplary of the disclosure Cease with depth information to render the explanatory of the method for stroke.Fig. 6 is to be used to compare and describe according to prior art and this The explanatory of the method for rendering stroke of disclosed exemplary.
In detail, Fig. 6 (a) shows situations below:User by touch input 240 sequentially input the first stroke (under Text is referred to as s1), the second stroke (hereinafter referred to as s2) and the 3rd stroke (hereinafter referred to as s3).In this case, user S1 and s3 are inputted using the pen of identical " pencil " pattern, and is inputted using the pen of " pen " pattern different with s3 from s1 There is intersection point between s2, and s1, s2 and s3.
In using the method according to the graphics processing unit of prior art to render stroke, for each stroke, pass through Render pipeline to render stroke using one.Therefore, when repainting event in the area including s1, s2 and s3, such as Fig. 6 (b) shown in, the strokes sequence inputted with user, graphics processing unit is performed first after starting to render and renders pipeline to render S1, performs second and renders pipeline to render s2, and execution the 3rd renders pipeline to render s3.
However, in the case where there are a large amount of short strokes in repainting area (such as feelings of the sentence of editor user's input Condition), when performing one to each stroke by the method according to correlation technique and rendering pipeline to render stroke, perform a large amount of Render pipeline so that penalty and consume a large amount of power.
In order to solve this problem, according to the exemplary of the disclosure, 220 pairs of graphics processing unit has identical The stroke of pattern performs identical and renders pipeline to render stroke.
In detail, when changing the pattern of the stroke inputted by touch input 240, processor 230 can change depth Spend information and depth information is assigned to corresponding stroke, and the depth information for being assigned to corresponding stroke is stored in memory In 250.For example, as shown in Fig. 6 (a), when sequentially inputting s1, s2 and s3 while pattern is being changed, processor 230 can be with Current depth value " 100 " is assigned to the s1 of " pencil " pattern of initial input, and by " 100 " storage in memory.By A pattern in the s2 subsequently input is changed to " pen " from " pencil ", and processor 230 can change depth value, is distributed " 99 " And by " 99 " storage in memory;Because a pattern is changed to " pencil " from " pen " again in s3, processor 230 can To distribute the depth value of " 98 " as changing, and by " 98 " storage in memory.
In addition, processor 230 can be matched a pattern for corresponding stroke with corresponding stroke, and by the pen of matching Pattern is stored in memory 250 as style information.For example, processor 230 can be matched " pencil " with s1 and s3, And " pen " is matched with s2, and a pattern for matching is stored as style information.
Then, when repainting event again in the viewing area including s1, s2 and s3, processor 230 can be with The style information of each and depth information that repaint in s1, s2 and s3 that area includes are provided and arrive graphics processing unit 220。
Therefore, as shown in Fig. 6 (c), no matter the sequence of the stroke of user's input, graphics processing unit 220 can be Execution first renders pipeline after rendering beginning, to render the s1 and s3 of the same pattern information with " pen " simultaneously, and And execution second renders pipeline to render the s2 of " pencil " pattern.
In this case, due to there is intersection point, it is necessary to which the point of intersection between corresponding stroke is represented between s1, s2 and s3 The list entries of stroke with different patterns.Therefore, in this case, graphics processing unit 220 can be believed according to depth Breath, renders and repaints intersection point between the stroke in the stroke that area includes with different style informations.
In detail, graphics processing unit 220 can be used has lowest depth in the stroke with different style informations The stroke of information, to render the intersection point between the stroke with different style informations.
Fig. 7 shows graphics processing unit 220 and rendered using depth information the friendship between the stroke with different patterns Point, so as to the example of the sequence that represents the stroke that user is inputted, although no matter the stroke that the user as shown in Fig. 6 (c) inputs Sequence and render the stroke with same pattern simultaneously.
As described above, the respective depth information of s1, s2 and s3 is respectively 100,99 and 98.Therefore, with reference to by reference numeral The enlarged drawing in 710 regions represented, it can be seen that graphics processing unit 220, which is used, has relatively low depth information in s1 and s2 S2 is rendered in s2 to render the intersection point 712 between s1 and s2 using the s3 with relatively low depth information in s2 and s3 The 711 of intersection point between s3.
As described above, according to the exemplary embodiment of the invention described above, even if the stroke with identical form of a stroke or a combination of strokes formula is by one The individual pipeline that renders is rendered, and the sequence of the stroke of user's input can still use the depth information of stroke to represent, so as to subtract The electric current that consumes less and stroke can be rendered exactly.
Meanwhile, although describing situations below by way of example above:Whenever the stroke inputted by touch input 240 When pattern changes, depth value is gradually reduced, disclosure not limited to this.For example, when changing stroke pattern, distribution gradually increases The exemplary of depth value also will be possible.In which case it is possible to use the stroke with advanced angle value To render the intersection point between the stroke with different patterns.
Fig. 8 is for describing being used when point of use pel is to render stroke according to the exemplary of the disclosure The explanatory of the method for depth information.Here, according to the exemplary of the disclosure, whenever the pattern of entering stroke Can be the depth value changed as the depth information of instruction entering stroke sequence when being changed and being endowed correspondence stroke (for example, natural number).
When identify repaint area when, the processor 230 of display device 200 can will configure repainting of being recognized The positional information and depth information of the respective point pel for the stroke that area includes, which are provided, arrives graphics processing unit 220.For example, with Put that the x-axis and y-axis coordinate of any point pel for repainting the stroke that area includes are (x+x0, y+y0) and its depth value is d0 In the case of, processor 230 may be in the form of such as (x0, y0, d0) by the positional information and depth information of corresponding points pel Graphics processing unit 220 is provided.
That is, the coordinate for repainting area's left upper end in the region of whole display 210 is the situation of (x, y) Under, the position of the respective point pel repainted in area can be moved (- x ,-y) by processor 230, then by the seat after movement Scale value provides graphics processing unit 220 together with the depth value of respective point pel.
For example, being respectively w and h, repainting area for (x, y), width and height repainting the coordinate of area's left upper end The point pel included is based on whole display 210 with the case of depth value n (minimum value) to f (maximum), when in depth Represent that the coordinate for repainting the respective point pel included in area moves (- x ,-y) to represent on three dimensions on degree axle When repainting area, it can be expressed as shown in Figure 8, and processor 230 will can be configured as described in Figure 8 The positional information and depth information for repainting all pels of the stroke that area includes are provided to graphics processing unit 220.
Meanwhile, processor 230 can be by for the transitional information for repainting area and be converted into cutting out space to be provided to figure Shape processing unit 220.In detail, processor 230 can recognize that configuration repaints all pels of the stroke that area includes Radius in maximum radius, and transitional information is calculated based on the maximum radius that is recognized.
For example, as in the example of fig. 8, multiple pels for repainting the stroke that area includes are configured recognizing In the case that maximum radius in radius is r, processor 230 can calculate the matrix represented by equation 3 below, and by institute The matrix of calculating provides as transitional information and arrives graphics processing unit 220.
[equation 3]
Therefore, graphics processing unit 220 can use the positional information and depth of the respective point pel provided from processor 230 The transition matrix of information (for example, D coordinates value) and above equation 3 is spent, the area that repaints as shown in Figure 8 is included All pels be converted into cutting out space.
In detail, in the examples described above, any pel included in area is repainted has for (x0, y0, d0) In the case of positional information and depth information, that is to say, that in mobile x and y coordinates value be (x0, y0) and depth value is d0's In the case of, correspondence pel can be converted into cutting out sky by graphics processing unit 220 by the detailed calculating as shown in equation 4 below Between.
[equation 4]
With reference to above equation 4 as can be seen that when a pel is from when repainting area and being converted into cutting out space, in reflection depth Calculating is performed in the state of information.As described above, using the point for including depth information and transition matrix depending on above equation 3 The coordinate value of pel, will repaint area and is converted into cutting out space, even if to cause when graphics processing unit 220 is believed according to pattern Breath and depth information are rendered when repainting multiple strokes that area includes, and graphics processing unit 220 can also point of use pel To render multiple strokes.
In this case, because the matrix represented by above equation 3 also will repaint the broader region in area than Fig. 8 It is converted into cutting out space, therefore is positioned at and repaints the point pel of area's boundary and be converted into be positioned at and cut out in space, and And cut out in subsequent treatment in the point for cutting out the conversion outside space (because it includes depth axle, therefore it is three dimensions) Pel.
Simultaneously as the matrix as represented by above equation 3 will be converted into cutting out than actually repainting broader area of area Space, therefore cut out in graphics processing unit 220 according to above-mentioned general performance Normalization rule reverse conversion information come reverse conversion In the case of space, display size is less than to the stroke of actual size.
Therefore, in order to correct this problem, according to the exemplary of the disclosure, processor 230 can be used That states repaints the width w and height h and maximum radius r in area, calculates the reverse conversion letter represented by above equation 2 Breath, and the reverse conversion information calculated is provided to graphics processing unit 220.Therefore, when graphics processing unit 220 is used When reverse conversion information as represented by above equation 2 carrys out reverse conversion and cuts out space, it can be rendered in area 510 is repainted The full sized stroke of its size.
Equation 5 below is represented for by the matrix represented by above equation 3, using anti-represented by above equation 2 Carry out the example that reverse conversion has been converted into cutting out the detailed calculating for putting pel in space to transitional information.
[equation 5]
As described above, according to the exemplary of the disclosure, by correcting the viewport described in traditional performance specification The parameter that information includes obtains the reverse conversion information of above equation 2, and the relevant parameter that includes of above equation 2 (- r ,-r) indicates the coordinate value of viewport left upper end, and its (w+2r, h+2r) represents the width and height of viewport respectively.
For example, graphics processing unit 220 can use the parameter that the viewport information of above equation 2 includes, calculate such as The reverse conversion matrix of the most left matrix of above equation 5, and calculate cutting out spatially in calculated reverse conversion matrix Point pel coordinate value to perform reverse conversion.
However, the corresponding parametric values included using the reverse conversion information of above equation 2 by graphics processing unit 220 Lai The method detailed not limited to this of reverse conversion is performed, and as set forth above, it is possible to uses the method according to traditional performance specification.
As described above, according to the different exemplaries of the disclosure, point of use pel renders stroke, to cause The quantity on the summit handled by graphics processing unit is reduced, and performs the quantity for rendering pipeline rendered to identical quantity stroke Reduce.It therefore, it can shorten render time and the electric current of consumption can be reduced, to allow to perform high-performance stroke wash with watercolours Dye.
In addition, as described above, (maximum radius of point of use pel turns to change using transition matrix and reverse conversion matrix Change matrix and reverse conversion matrix) stroke is rendered, it may repaint the pen that area's boundary occurs to allow to prevent that Draw and disconnect phenomenon, rendered even if the stroke with identical pattern renders pipeline by one, use the depth information of stroke so that The sequence for the stroke that user is inputted can be represented.
Fig. 9 is to show to include the aobvious of graphics processing unit 120 or 220 according to the control of the exemplary of the disclosure The flow chart of the method for showing device 100 or 200.According to Fig. 9, when repainting event on the image including stroke, The identification of display device 100 or 200 repaints area (S910), and by for render recognized repaint what area included The spatial cue of stroke, which is provided, arrives graphics processing unit 120 or 220 (S920).
Here, spatial cue can include at least one of following:Configuration repaints the point for the stroke that area includes The positional information of pel, for that will be converted into cutting out the transitional information in space, for than repainting the broader region in area The ratio for being converted into cutting out space repaints reverse conversion information and entering stroke that the broader region in area carries out reverse conversion Style information and depth information.
In detail, display device 100 or 200 can repaint multiple pels of the stroke that area includes based on configuration Radius in maximum radius, calculate transitional information and reverse conversion information, and by the transitional information calculated and reverse conversion Information, which is provided, arrives graphics processing unit 120 or 220.
For example, when the width for repainting area is w, the height for repainting area is h, and configuration repaints area Zhong Bao When maximum radius in the radius of multiple pels of the stroke included is r, display device 100 or 200 can be calculated by with first-class Matrix represented by formula 1 calculates the viewport information represented by above equation 2 as transitional information, and by turning for being calculated Change information and viewport information provides and arrives graphics processing unit 120 or 220.Here, viewport information be used for reverse conversion by with The reverse conversion information for cutting out space that upper equation 1 is changed.
Meanwhile, according to the exemplary of the disclosure, display device 100 or 200 also includes receiving entering stroke Touch input, and depth information can be assigned to the stroke inputted by touch input and storage depth information.Tool Body, when the pattern of the stroke inputted by touch input changes, display device 100 or 200 can change and distribute depth Information is spent, and the depth information distributed can be matched with corresponding stroke and store distributed depth information. In addition, display device 100 or 200 can store the style information of the corresponding stroke inputted by touch input.
Therefore, when repainting event on the image including stroke, display device 100 or 200 can be recognized Repaint area (S910), and using the depth information and style information that repaint the stroke that area includes that are recognized as Spatial cue, which is provided, arrives graphics processing unit 120 or 220 (S920).
As described above, when providing various spatial cues to graphics processing unit 120 or 220, the He of graphics processing unit 120 220 can render the stroke (S930) for repainting area and including based on spatial cue point of use pel.In detail, at figure Reason unit 120 or 220 can will repaint area based on transitional information and be converted into cutting out space, and switched using configuring The point pel for cutting out the stroke that space includes repaints the stroke that area includes to render.
For example, graphics processing unit 120 or 220 can use the transition matrix information as represented by above equation 1 to compare The broader region in area is repainted to be converted into cutting out space, and using the viewport information as represented by above equation 2 to having turned The space of cutting out changed carries out reverse conversion, and the stroke that area includes is repainted to render.
In addition, graphics processing unit 120 or 220 can be based on depth information and style information, point of use pel is rendered Repaint the stroke that area includes.In detail, graphics processing unit 120 or 220 can simultaneously render and repaint area Zhong Bao There is the stroke of same pattern information in the stroke included.In addition, graphics processing unit 120 or 220 can be according to depth information, wash with watercolours Dye repaints intersection point between the stroke in the stroke that area includes with different style informations.In detail, graphics processing unit 120 or 220 can use the relatively low stroke of the depth value that its depth information includes in the stroke with different style informations, To render the intersection point between the stroke with different style informations.
Figure 10 is the stream for the method that stroke is rendered by display device for showing the exemplary according to the disclosure Cheng Tu.According to Figure 10, when due to repaint the generation of event and receive repaint request when, display device 100 or 200 can Area (S1010) is repainted to recognize.Herein, the left upper end for repainting area recognized coordinate in whole display In the case of being respectively w and h in screen for (x, y) and the width for repainting area recognized and height, display device 100 Or 200 will configure the position movement (- x ,-y) for the corresponding circle (i.e. respective point pel) for repainting the stroke that area includes (S1020)。
Then, display device 100 or 200 finds the radius that configuration repaints multiple pels of the stroke that area includes In maximum radius (S1030), and calculated using the maximum radius found and to be converted into cutting out for area will to be repainted The transition matrix (S1040) in space.In this case, transition matrix can be represented by above equation 1.In addition, display device 100 or 200 can use find the maximum radius found calculate be used for it is switched cut out space carry out reverse conversion Viewport (S1050).In this case, viewport can be represented by above equation 2.
Therefore, display device 100 or 200 can render graphics processing unit 120 or 200 all information needed for stroke Graphics processing unit 120 or 200 (S1060) is provided, these information include:Indicate that configuration repaints the stroke that area includes Positional information, the transition matrix calculated, the viewport that is calculated of position movement (- x ,-y) of point pel etc., and to figure Shape processing unit 120 or 220, which is given, renders order (S1070).
Figure 11 is to show to include the aobvious of graphics processing unit according to the control of another exemplary of the disclosure The flow chart of the method for showing device.According to Figure 11, display device 100 or 200 includes touch input, and works as by touch input When carrying out entering stroke, depth information can be assigned to entering stroke and storage depth information.
In detail, when the pattern of entering stroke changes, display device 100 or 200 can change and distribute depth information, And the depth information distributed can be matched with corresponding stroke and store distributed depth information (S1110). In addition, display device 100 or 200 can be by the style information of the stroke inputted by touch input and the progress of corresponding stroke Match somebody with somebody and store the style information.
Then, when the event that repaints occurs, display device 100 or 200, which can be recognized, repaints area (S1120), And depth information and the pattern letter for the stroke for including repainting in the depth information and style information that are stored in area Breath, which is provided, arrives graphics processing unit 120 or 220 (S1130).
Therefore, graphics processing unit 120 or 220 can use depth information and style information to be repainted to render in area Including stroke.In this case, graphics processing unit 120 or 220 can use triangle primitives, point pel etc. Various pels render stroke.
In detail, graphics processing unit 120 or 220 can render to repaint simultaneously has phase in the stroke that area includes With the stroke of style information.In addition, graphics processing unit 120 or 220 can be rendered according to depth information and repaint area Zhong Bao Intersection point between stroke with different style informations in the stroke included.In detail, graphics processing unit 120 or 220 can be used The relatively low stroke of its depth information includes in the stroke with different style informations depth value, is rendered with different patterns Intersection point between the stroke of information.
Hereinbefore, according to exemplary, the processor 130 or 230 of display device 100 or 200 can be performed Pass through the operation of the display devices 100 or 200 described of Fig. 9 to 11.
According to the various exemplaries of the disclosure as described above, the stroke rendering of display device can be improved Can, and the power of consumption can be reduced.
Meanwhile, according to the operation of the display apparatus processes device of above-mentioned various exemplaries or control display device Method can be created as software and install in a display device.
For example, the non-transitory computer-readable medium of storage program can be fitted into, the program performs control display The method of device, this method includes:When repainting event on shown image, identification repaints area;It will use In render repaint the stroke that area includes spatial cue provide arrive graphics processing unit;And pass through graphics process list Member, based on spatial cue, point of use pel repaints the stroke that area includes to render.
Here, non-transitory computer-readable medium be not wherein data storage continue a bit of time medium it is (all Such as register, cache memory, memory), and refer to data storage and can semi-permanently be read by device wherein The medium taken.Specifically, by above-mentioned various middlewares or program storage and computer-readable Jie of nonvolatile can be arranged on In matter, such as CD (CD), digital universal disc (DVD), hard disk, Blu-ray disc, USB (USB), storage card, read-only deposit Reservoir (ROM) etc..
The spirit of the disclosure is hereinbefore schematically described.It will be understood by those skilled in the art that not departing from the disclosure Essential feature in the case of, various modifications and change can be carried out.In addition, the exemplary of the disclosure does not limit this Disclosed spirit, but the spirit of the description disclosure, the scope of the present disclosure are not limited by exemplary.Therefore, originally Scope of disclosure should be explained by following claims, and will explain that institute's spiritedness is equal to the following right in the range of the disclosure It is required that.

Claims (15)

1. a kind of display device, including:
Graphics processing unit, is rendered to stroke;
Display, display includes the image of rendered stroke;And
Processor, when repainting event in described image, identification repaints area, and will be used to rendering described heavy The new spatial cue for drawing the stroke that area includes, which is provided, arrives the graphics processing unit,
Wherein, the graphics processing unit is based on the spatial cue, and point of use pel described repaints area Zhong Bao to render The stroke included.
2. display device according to claim 1, wherein, the spatial cue includes being used to that area will to be repainted than described Broader region is converted into cutting out the transitional information in space.
3. display device according to claim 2, wherein, the graphics processing unit is based on the transitional information will be described Repaint area and be converted into cutting out space, and the point diagram configured using the stroke cut out space and included to being changed Member described repaints the stroke that area includes to render.
4. display device according to claim 2, wherein, the processor to described based on repainting what area included Maximum radius in the radius for the multiple pels that stroke is configured, calculates the transitional information.
5. display device according to claim 4, wherein the transitional information includes following matrix:
Wherein, w represents the width for repainting area, and h is the height for repainting area, and r is the maximum radius.
6. display device according to claim 2, wherein, the spatial cue includes being used for having been converted into described cut out The reverse conversion information that the broader region in area carries out reverse conversion is repainted described in the ratio in space, and
The processor is used in the radius of the multiple pels configured to the stroke for repainting area and including Maximum radius, calculates the reverse conversion information.
7. display device according to claim 6, wherein, the reverse conversion information includes following viewport information:
(- r ,-r, w+2r, h+2r)
Wherein, w represents the width for repainting area, and h is the height for repainting area, and r is the maximum radius.
8. display device according to claim 1, includes the touch input of the stroke of reception input,
Wherein, the spatial cue include the depth information of each repainted in multiple strokes that area includes and Style information, and
When changing the pattern of the stroke inputted by the touch input, the processor changes and distributes the depth Information.
9. display device according to claim 8, wherein, the graphics processing unit is rendered simultaneously described repaints area There is the stroke of same pattern information in the stroke included.
10. display device according to claim 9, wherein, the graphics processing unit is rendered described according to depth information Repaint the intersection point between the stroke with different style informations in the stroke that area includes.
11. display device according to claim 10, wherein, the graphics processing unit is used with described not same The relatively low stroke of depth value in the stroke of formula information included by depth information, renders the stroke with the different style informations Between the intersection point.
12. a kind of control to include the method for the display device of graphics processing unit, including:
When repainting event on the image including stroke, identification repaints area;
It will be provided for rendering the spatial cue for repainting the paintbrush that area includes to the graphics processing unit;And
By the graphics processing unit, based on the spatial cue, point of use pel described repaints area Zhong Bao to render The stroke included.
13. it is according to claim 12 control display device method, wherein, the spatial cue include be used for will be than institute State and repaint the transitional information that the broader region in area is converted into cutting out space.
14. it is according to claim 13 control display device method, wherein it is described render including:
The area that repaints is converted into cutting out space based on the transitional information;And
Described repaint in area is rendered using to cutting out of the being changed point pel that the stroke included in space configured Including stroke.
15. the method for control display device according to claim 13, wherein, the offer includes:Based on to described heavy Maximum radius in the radius for the multiple pels that the stroke that new drafting area includes is configured, calculates the transitional information.
CN201580059684.5A 2014-11-07 2015-11-09 Display apparatus and method of controlling the same Active CN107077754B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201462076726P 2014-11-07 2014-11-07
US62/076,726 2014-11-07
PCT/KR2015/011965 WO2016072811A1 (en) 2014-11-07 2015-11-09 Display device and method of controlling display device

Publications (2)

Publication Number Publication Date
CN107077754A true CN107077754A (en) 2017-08-18
CN107077754B CN107077754B (en) 2020-10-16

Family

ID=55909446

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580059684.5A Active CN107077754B (en) 2014-11-07 2015-11-09 Display apparatus and method of controlling the same

Country Status (5)

Country Link
US (1) US10331331B2 (en)
EP (1) EP3217360B1 (en)
KR (1) KR101913212B1 (en)
CN (1) CN107077754B (en)
WO (1) WO2016072811A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112434632A (en) * 2020-12-01 2021-03-02 康佳集团股份有限公司 Pattern recognition method, intelligent terminal and storage medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10234964B2 (en) * 2016-12-19 2019-03-19 Wacom Co., Ltd. Image processing apparatus
US10388055B2 (en) * 2017-06-02 2019-08-20 Apple Inc. Rendering animated user input strokes
CN112614209B (en) * 2020-12-30 2024-02-20 凌云光技术股份有限公司 Element redrawing method and system during flow chart refreshing

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030161014A1 (en) * 2002-01-07 2003-08-28 Hiroaki Tobita Image editing apparatus, image editing method, storage medium, and computer program
US6967664B1 (en) * 2000-04-20 2005-11-22 Ati International Srl Method and apparatus for primitive processing in a graphics system
US7847798B1 (en) * 2006-10-24 2010-12-07 Adobe Systems Incorporated Clipping and culling artwork using a graphics processing unit
WO2012001781A1 (en) * 2010-06-30 2012-01-05 富士通株式会社 Drawing apparatus and drawing program
CN103473123A (en) * 2013-08-27 2013-12-25 西安邮电大学 GPU (graphics processing unit) -based real-time writing brush ink diffusion module parallel implementation method
CN103810742A (en) * 2012-11-05 2014-05-21 正谓有限公司 Image rendering method and system

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3833483B2 (en) 2001-03-06 2006-10-11 インターナショナル・ビジネス・マシーンズ・コーポレーション Image display system, image data transmission apparatus, display image data transmission method, differential transfer method, program, and storage medium
WO2002015004A2 (en) 2000-08-14 2002-02-21 Transvirtual Technologies, Inc. Portable operating environment for information devices
US6707473B2 (en) 2001-08-01 2004-03-16 Microsoft Corporation Dynamic rendering of ink strokes with transparency
US6952214B2 (en) 2002-07-12 2005-10-04 Sun Microsystems, Inc. Method for context switching a graphics accelerator comprising multiple rendering pipelines
JP2005135415A (en) 2003-10-28 2005-05-26 Samsung Electronics Co Ltd Graphic decoder including command based graphic output accelerating function, graphic output accelerating method therefor, and image reproducing apparatus
US7961194B2 (en) 2003-11-19 2011-06-14 Lucid Information Technology, Ltd. Method of controlling in real time the switching of modes of parallel operation of a multi-mode parallel graphics processing subsystem embodied within a host computing system
US8239749B2 (en) 2004-06-25 2012-08-07 Apple Inc. Procedurally expressing graphic objects for web pages
US7830372B2 (en) 2004-08-30 2010-11-09 Qnx Software Systems Gmbh & Co. Kg Method and system for providing transparent access to hardware graphic layers
KR100679019B1 (en) 2004-11-02 2007-02-05 삼성전자주식회사 Method and apparatus for accumulative vector drawing using buffering
US7548244B2 (en) 2005-01-12 2009-06-16 Sony Computer Entertainment Inc. Interactive debugging and monitoring of shader programs executing on a graphics processor
US8212840B2 (en) 2006-10-23 2012-07-03 Qualcomm Incorporated 3-D clipping in a graphics processing unit
US8269792B2 (en) * 2006-11-21 2012-09-18 Qualcomm Incorporated Efficient scissoring for graphics application
US8274516B2 (en) 2008-08-04 2012-09-25 Microsoft Corporation GPU scene composition and animation
GB0818278D0 (en) 2008-10-06 2008-11-12 Advanced Risc Mach Ltd Graphics processing systems
ITRM20110199A1 (en) * 2011-04-19 2012-10-20 Mavi Sud S R L METHOD OF PREPARATION OF COMPLEXES OF CHITIN AND ACTIVE AND COMPLEX PRINCIPLES SO OBTAINED.
US9619853B2 (en) 2012-08-09 2017-04-11 Qualcomm Incorporated GPU-accelerated path rendering
US9383840B2 (en) 2013-04-22 2016-07-05 Samsung Display Co., Ltd. Method and apparatus to reduce display lag using image overlay

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6967664B1 (en) * 2000-04-20 2005-11-22 Ati International Srl Method and apparatus for primitive processing in a graphics system
US20030161014A1 (en) * 2002-01-07 2003-08-28 Hiroaki Tobita Image editing apparatus, image editing method, storage medium, and computer program
US7847798B1 (en) * 2006-10-24 2010-12-07 Adobe Systems Incorporated Clipping and culling artwork using a graphics processing unit
WO2012001781A1 (en) * 2010-06-30 2012-01-05 富士通株式会社 Drawing apparatus and drawing program
CN103810742A (en) * 2012-11-05 2014-05-21 正谓有限公司 Image rendering method and system
CN103473123A (en) * 2013-08-27 2013-12-25 西安邮电大学 GPU (graphics processing unit) -based real-time writing brush ink diffusion module parallel implementation method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112434632A (en) * 2020-12-01 2021-03-02 康佳集团股份有限公司 Pattern recognition method, intelligent terminal and storage medium
CN112434632B (en) * 2020-12-01 2024-05-28 康佳集团股份有限公司 Pattern recognition method, intelligent terminal and storage medium

Also Published As

Publication number Publication date
WO2016072811A1 (en) 2016-05-12
KR20170066483A (en) 2017-06-14
KR101913212B1 (en) 2018-12-28
US20170336939A1 (en) 2017-11-23
EP3217360A1 (en) 2017-09-13
US10331331B2 (en) 2019-06-25
CN107077754B (en) 2020-10-16
EP3217360A4 (en) 2018-03-14
EP3217360B1 (en) 2022-04-20

Similar Documents

Publication Publication Date Title
US8860675B2 (en) Drawing aid system for multi-touch devices
US8914259B2 (en) Passive associativity in three-dimensional (3D) modeling
US10275910B2 (en) Ink space coordinate system for a digital ink stroke
KR102393295B1 (en) Apparatus and method for styling a content
US9922014B2 (en) Method and apparatus for making contents through writing input on touch screen
CN107077754A (en) The method of display device and control display device
JP2015504565A (en) Drawing control method, apparatus, and mobile terminal
WO2011159461A2 (en) Ink rendering
WO2018222248A1 (en) Method and device for detecting planes and/or quadtrees for use as a virtual substrate
US8542207B1 (en) Pencil eraser gesture and gesture recognition method for touch-enabled user interfaces
CN103677828A (en) Coverage drawing method, drawing engine and terminal equipment
CN105022580A (en) Image display system
US20200372208A1 (en) Enhanced digital ink erasing
CN102568253A (en) Method and device used for displaying geometrical characteristic of graph in electronic whiteboard
CN108628455B (en) Virtual sand painting drawing method based on touch screen gesture recognition
US8334869B1 (en) Method and apparatus for modeling 3-D shapes from a user drawn curve
CN107957847A (en) A kind of touch track display methods, device, equipment and storage medium
CN105786373A (en) Touch track display method and electronic device
WO2012074521A1 (en) Reshaping interfaces using content-preserving warps
CN103176731A (en) Method and device for determining ending of handwriting input
US10380784B2 (en) Electronic apparatus for mapping texture image and generating blending image
CN103997634B (en) User terminal and its method for showing image
US20240143158A1 (en) Electronic whiteboard system and operation method thereof
CN106462327A (en) User interface with quantum curves and quantum arcs
KR101803770B1 (en) Electronic apparatus and method for rendering thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant