WO2009024990A1

WO2009024990A1 - System of processing portions of video stream data

Info

Publication number: WO2009024990A1
Application number: PCT/IN2007/000355
Authority: WO
Inventors: Yogesh Chunilal Rathod
Original assignee: Yogesh Chunilal Rathod
Priority date: 2007-08-20
Filing date: 2007-08-20
Publication date: 2009-02-26

Abstract

The present invention relates to system and method of processing including searching, matching, automatic identification, selection and actions on one or more image portion(s) of image frame(s) of digitized video data and video stream data for the purpose of enabling object handling including searching, matching, automatic identification, selection(s), associate action(s), remote action(s) and two or multi way communication and collaboration; and based on that exemplary Universal Live Commerce services, platform and networks which provides advance visual and live interactive e-commerce including (marketing, bids, auctions and e-tailing), visual and live search & match making, visual and live advertising and showcasing, visual and live security system, visual and live learning and training system, visual and live presentation system, visual automation, visual and live entertainment & games, visual and live information access, extended visual and live communication utility, visual and live data entry and processing facilitates silent or direct or zero stock commerce.

Description

System of processing portions of video stream data

INVENTORNAME : Yogesh Chunilal Rathod

CITIZENSHIP : Indian

RESIDENCE : 1502/A, Mahavir Residency,

L B S Marg, Near Balrajeshwar Mandir, Mulund (W), Mumbai 400080 Maharashtra, India

CROSS-REFERENCE TO RELATED APPLICATIONS Not Applicable

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT (5) Not Applicable

REFERENCE TO SEQUENCE LISTING, A TABLE, OR A COMPUTER PROGRAM LISTING COMPACT DISC APPENDIX Not Applicable

COPYRIGHTS INFORMATION

(10) A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.

(15) FIELD OF INVENTION

The present invention relates to system and method of processing including searching, matching, automatic identification, selection and actions on one or more image portion(s) of image frame(s) of digitized video data and video stream data for the purpose of enabling object handling including searching, matching,

(20) automatic identification, selection(s), associate action(s), remote action(s) and two or multi way communication and collaboration; and based on that exemplary Universal Live Commerce services, platform and networks which provides advance visual and live interactive e-commerce including (marketing, bids, auctions and e- tailing), visual and live search & match making, visual and live advertising and

(25) showcasing, visual and live security system, visual and live learning and training system, visual and live presentation system, visual and live automation, visual and live entertainment & games, visual and live information access, extended visual and live communication utility, visual and live data entry and processing facilitates silent or direct or zero stock commerce.

BACKGROUND OF THE INVENTION

The rapid growth in information technology and the emergence of the Internet and World Wide Web over the last several years have changed the ways and means of communication and E-commerce in broader aspect. Electronic Commerce is exactly analogous to a marketplace on the Internet. Electronic Commerce consists primarily

(5) of the distributing, buying, selling, marketing and servicing of products or services over electronic systems such as the Internet and other computer networks. The information technology industry might see it as an electronic business application aimed at commercial transactions; in this context, it can involve electronic funds transfer, supply chain management, e-marketing, online marketing, online transaction

(10) processing, electronic data interchange (EDI), automated inventory management systems, and automated data collection systems. The major limitation of the current system of e-commerce technology or practice is that the buyer is unable to see the actual product. Even if the buyer is shown the photograph of the product he cannot appreciate the features of the product since such facility is not available. He cannot

(15) see the product in action. In fact this is difficult in view of the high cost of infrastructure involved and the impracticability involved.

Unfortunately, end users are often overwhelmed. They spend most of their time searching, navigating & sorting through the data, spending less time interpreting, and even less time actually doing something about what they find.

(20) Video commerce is transacting from a video using Internet (IP) communications. The video can be downloaded and played or streamed to the viewer. Either way the video contains clickable links which can open up a web page or a transaction process. A typical video commerce application would involve a video which contains a number of clickable objects so that the viewer can click on any of those objects for further

(25) information or to purchase them. Video commerce can take place over any Internet-enabled communications device - a Personal Computer, laptop, digital projector, PDA, a mobile phone, a smart phone. Video commerce content delivery system have been developed specifically for providing video interaction in a secondary window that in turn maybe displayed on any secondary device to avoid disruption to a primary video display. Future devices designed specifically for video commerce have been developed that enable interaction on a secondary wireless display.

Due to increase in internet access speed, low cost of mass storage, network cameras, (5) RFID tags, reader and physical location identification technology, visual or live e- commerce is now practically possible and acceptable.

An e-tailer is a retailer that primarily uses the Internet as a medium for customers to shop for the goods or services provided. A pure play e-tailer uses the Internet as its primary means of retailing. A brick and mortar e-tailer uses the Internet to push its (10) good or service but also has the traditional physical storefront available to customers. In case the retailer would like to set up live e-commerce, the cost of infrastructure is very high.

Current search engine does not provide visual and physical availability of products search.

(15) Future success of silent e-commerce and zero stock commerce and direct e- commerce (without intermediary) is only possible when the user can visually see the product and buy products directly without any human intervention or intermediary.

Prior art devices described in the relevant patent literature for capturing one or more objects in a scene typically include a camera device of known location or trajectory, a

(20) scene including one or more calibrated target objects, and at least one object of interest (see U.S. Pat. No. 5,699,444 of Sythonics Incorporated). Most prior art devices are used for capture of video data regarding an object operate in a controlled setting, oftentimes in studios or sound stages, and are articulated along a known or pre-selected path (circular or linear). Thus, the information recorded by the device

(25) can be more easily interpreted and displayed given the strong correlation between the perspective of the camera and the known objects in the scene.

Similarly, U.S. Pat. No. 5,627,915 entitled "Pattern Recognition System Employing Unlike Templates to Detect Objects Having Distinctive Features in a Video Field," issued May 6, 1997 to Rosser et al. and assigned to Princeton Video Image, Inc. of Princeton, NJ., discloses a method for rapidly and efficiently identifying landmarks and objects using a plurality of templates that are sequentially created and inserted into live video fields and compared to a prior template(s) in order to successively identify possible distinctive feature candidates of a live video scene and also

(5) eliminate falsely identified features. The process disclosed by Rosser et al. is repeated in order to preliminarily identify two or three landmarks of the target object the locations of these "landmarks" of the target object and finally said landmarks are compared to a geometric model to further verify if the object has been correctly identified by process of elimination. The methodology lends itself to laboratory

(10) verification against pre-recorded videotape to ascertain accuracy before applying said system to actual targeting of said live objects. This system also requires specific templates of real world features and does not operate on unknown video data with its inherent variability of lighting, scene composition, weather effects, and placement variation from said templates to actual conditions in the field.

(15) In summary, the inventors have found that in the prior art related to the problem of accurately identifying and classifying objects appearing in a video data most all efforts utilize complex processing, illuminated scenes, continual tuning of a single filter and/or systematic comparison of aspects of an unknown object with a variety of shapes stored in memory. The inventors propose a system that efficiently and

(20) accurately retrieves and catalogs information distilled from vast amounts of video data so that object classification type(s), locations, and bitmaps depicting the actual condition of the objects (when originally recorded) are available to an operator for review, comparison, or further processing to reveal even more detail about each objects.

(25) U.S. Pat. No. 7,092,548 entitled "Method and apparatus for identifying objects depicted in a video stream" , discloses a system wherein rapidly analyzing frame(s) of digitized video data which may include objects of interest randomly distributed throughout the video data and wherein said objects are susceptible to detection, classification, and ultimately identification by filtering said video data for certain differentiable characteristics of said objects. When used in conjunction with navigational or positional inputs, such as GPS, an

(30) output from the inventive systems indicates the identity of each object, calculates object location, classifies each object by type, extracts legible text appearing on a surface of the object (if any), and stores a visual representation of the object in a form dictated by the end user/operator of the system. It does not have the capability to employ any accurate location identification devices (up to centimeter or millimeters) like RFID location identification device such as RFID radar & Identification chip Tags like RFID tags

(5) on each object(S) and other accurate location identification devices & tags and can not automatically or without human intervention identify individual or multiple item(s) in a video stream or accurately identify location of each products or objects or person or any logical part of one or more video streams. Furthermore the selected one or more image portion or part of video stream(s) cannot be used for one or more

(10) action or group of actions or series of actions or step by step actions or remote action(s) and two way or multi-way communication and collaboration. OBJECT OF THE INVENTION

An object of the invention being able to handle objects. Objects include any physical things such as products, goods etc. and live objects such as cattle, persons etc. (15) entities such products, goods, persons, animals, etc. Handling objects means searching, matching, automatic identification, selection(s), associate action(s) and two or multi way communication and collaboration.

Another significant object of the present invention live and visual e-commerce and (20) e-auctions.

Yet another object of the invention is to enable live and visual e-tailing and offline retailing.

Yet another object of the present invention is to provide visual search and match facility to users to make easy for them to search the availability of products and then buy offline. (25) Users can physically search and visually pinpointing the object(s) via alert system.

Another significant object of the present invention is to facilitate salient commerce and zero stock commerce.

Another significant object of the present invention is to provide many benefits to sellers of products and services. It saves sellers time, money and energy. High cost of infrastructure, inventory, marketing and advertising cost, management cost and online marketing cost. Yet another major object of the present invention is to make direct commerce possible without any cost of intermediary.

(5) Another main object of the present invention is to facilitates visual or live advertising platform (e.g. Jewelry or diamond necklace, cars, furniture and others) visual design lookups from multiple source and then buy physically

Another main object of the present invention is to provide many benefits to users or buyers for searching and matching of products, comparing products with many (10) parameters, availability of products, visual view of products, fast and easy e- commerce experience.

Yet another major object of the present invention is to use system for entertainment and games.

Yet another major object of the present invention is to access information visually.

Yet another major object of the present invention is to make two-way (15) communication or collaboration via selected logical image portion(s) of video stream data.

Yet another object of the invention is to enable maintain visual and live security system such as on a military installations

Yet another object of the invention is to enable guarding the goods such as on a (20) Jewelry exhibition.

Yet another object of the invention is to enable visual and live learning and training system.

Yet another object of the invention is to enable visual, live and interactive presentation of any product.

Yet another object of the invention is to enable visual automation i.e. interactive remote action(s) over physical object(s) via selecting associate object's image portion of video stream data. DETAIL DESCRIPTION OF THE INVENTION

The present invention mainly relates to video stream processing including searching, matching, automatic identification, selection and actions on one or more image portion(s) of image frame(s) of digitized video data and video stream data for the purpose of enabling object handling including searching, matching,

(5) automatic identification, selection(s), associate action(s) and two or multi way communication and collaboration; and based on that exemplary Universal or enterprise Live Commerce services, platform and networks which provides advance visual and live e-commerce including (marketing, bids, auctions and e-tailing), visual search & match making, visual advertising and showcasing, visual

(10) entertainment & games, visual and live security system, visual and live learning and training system, visual and live presentation system, visual and live automation system, visual information access, extended visual communication utility, visual data entry and processing facilitates silent or direct or zero stock commerce is described.

(15) The system comprising of an imaging device(s), computing and storage system, identification chip tag(s), location identification device(s). Preferably RFID tags are used on all products or objects, RFID location identification devices preferably RFID radar or other location identification devices provides live, updated and accurate movable or fix multiple products or objects' location identification data,

(20) System gets Live or updated or converted or filtered video stream or image(s) from network camera or web cam or any other camera or imaging devices. The present invention may be implemented in a single microprocessor apparatus, within a single computer having multiple processors, among several locally-networked processors (i.e., an intranet), or via a global network of processors (i.e., the Internet

(25) and similar).The generated video stream data is then converted into preferably flash video stream format or other suitable format, whereby said generated video stream data and image frame(s) with real-time and updated physical location information and metadata of one or more product(s) or object(s) stored locally or in one or more servers or databases and sent or distributed the same to one or more end

(30) user(s) or video viewers. In background mode live flash stream video is playing while in foreground preferably action script or other scripting languages are used for associate metadata request from server(s) and databases with current updated location information of one or more products and view data on selected part or portion of flash video stream via dynamic mapping logic with physical view and provides one or more action(s) or group of action(s) on any logical identified and selected part or portion of video stream or image frames(s).User can visually search

(5) & match, identify and select one or more image portions of each video stream or image frame(s) data and take one or more action(s) on one or more image portion(s) of image frame(s) of digitized video data and video stream data for the purpose of enabling object handling including searching, matching, automatic identification, selection(s), associate action(s) and two or multi way communication

(10) and collaboration.

The system can identify one or more logical image portion(s) of physical object(s) such as products, items, goods and live entities including human, animals, birds and live plants.

The system generated video streams or image frame(s) of digitized video data are (15) real time or near real time, live, updated, converted, filtered, dynamic, existing, prerecorded, series of still images, single image, a digitized version of an original analog image sequence or any formats including flash and usage any imaging device(s) including any movable or fixed mega pixel, multi pixel and high definition network camera or web camera or any other imaging device or camera

(20) and system work with any location identification device(s) includes RFID location identification devices preferably RFID tags, RFID reader and RFID radar.

Video server administrator inputs metadata of each image portion(s) pertaining to any product. Metadata may be in the form of multimedia, text, a file, animation, an image and associated audio & videos clips. Each Video stream data or image

(25) frame(s) of digitized 25) video data with location identification information and associated metadata are stored or sent or distributed directly or via one or more video stream server(s) or database(s) or local networks or local PC or via peer to peer or via external storage devices such as CD, DVD etc to one or more video stream data users or viewers.

(30) Said system visually highlights different status and search results of one or more image portion(s) of video stream data and system provides one or more action(s) including printing with metadata, edit associate data, drag and drop for group actions and two or multi way communication and collaboration between video server administrator(s) and client user(s) over selected one or more logical portion(s) or object(s) of image frame(s) of digitized video data or video stream data.

System uses each time mapping logic for dynamically mapping physical location(s) (5) of each CAM'S one or more products location(s) with video stream while playing, moving, pausing, frame by frame changes of image(s), full screen, and zooming, scrolling and objects location changes are made.

Based on present invention we give description of Live Commerce system. The said system comprises of mainly: 1) Live Commerce Controller (LCC), 2) Live

(10) Commerce Buyers (LCB), 3) Live Commerce Sellers (LCS) and 4) Live Commerce Suppliers (LCP).

Live commerce Controller (LCC) is central controlling and monitoring authority which provides various services and applications including Online Portal Management, Registration and Directories of Sellers (LCS), Buyers (LCB) &

(15) Suppliers (LCP), each CAM's video stream online activation setup and distribution codes, Taxonomy or category wise products inventory databases, Search & match making Engine, Multiple Payment systems, centralize Hit statistics and analysis, Ranks & Weights of Sellers (LCS), Stores, CAMS and products, Sellers (LCS) wise sales & commission Reports, Lock and Unlock stores or CAM or product for

(20) censorship and control, Notification Service, Users preferences and comments database, Namespace service, Advertising database, Live commerce & E-commerce applications Downloads and service subscriptions, Standards and Video & web hosting services for online distributions of one or more LCS's one or more video streams to one or more LCB and provides all other services required for LC network.

Centralize LCC administrators can use global explorer for multiple CAMS video view (25) management for lock and unlock stores, CAMS and products, multiple products searching, matching, viewing, communicating, date wise and location wise products analysis like hits, sales, complaints, commission, orders pending, special request and any group actions. Each Live Commerce Buyers (LCB), Live Commerce Sellers (LCS) and Live Commerce Suppliers (LCP) register with Live Commerce Controller and can thereafter LCB can start using all LC networks' CAMS. User can search and bookmarks LC stores, CAMS and products (location wise, field wise and product

(5) wise and taxonomy wise). User can visually search products, read product details including price, discount, reviews, ranks and (5) hits, consult with sales persons online, compare products and buy them.

Each registered LCB can select one or more video stream part or product and read products review, add to cart or buy, bookmark the products and communicate (10) associate sales people for further information, read reviews, Hits and ranks, give comments and rank, compare products with same store or with other stores, bid the products and take any action or group of actions on one or more selected parts or image portion on each video stream.

LCB can use tree style explorer for multiple CAMS video view management for (15) multiple products searching, matching, book marking, viewing, buying, comparing, communicating, reviewing products and any group actions. LCB can send purchase orders for one or more products of one or more stores to LCC and one or more LCB and LCP via LCC.

Each LCS must register each LC store and CAMS with LCC. Thereafter LCS (20) configures, setup and customize one or more CAMS with the help of LC scripting codes. A Live commerce system comprising: one or more RFID Tags on each physical products or object or live person, RFED physical location identification device or any other location identification device, RFID Reader, Network Camera or Web CAM or other types of camera as per LC standards. Each of or one or more

(25) installed Network Camera or Web CAM or other camera captures video stream or image frame(s) in any formats and converts preferably to Flash video stream and sent or distribute each updated or live video stream with Products physical Location identification data and Products metadata including (multimedia, text, files, animation, images and audio & videos) directly or via one or more LCC video stream

(30) servers or LCS one or more servers or 3rd party hosted one or more servers or via peer to peer or any offline storage devices to one or more LCB. LCS can enter product details in live mode on RFID Tags and Servers' Products databases. LCS can use explorer for multiple CAMS video view management for multiple products searching, matching, viewing, visually products metadata entry, communicating, editing products metadata, date wise and location wise products analysis like hits, sales, bides, stocks, supplier, orders pending and any group

(5) actions.

LCS can visually see products hits, sales and other details of each product of any stores and analysis them for better marketing and sales process. LCB can view multiple CAMS of multiple stores via tabbed interface. LCB can zoom or scroll video for close and easy view.

(10) LCS can select one or more video parts or products for individual visual products sales analysis like hits, sales, bides, stocks, supplier, orders pending, communicate with related buyers, check emails, support request, read reviews, ranks and comments, products popularity or discontinue products and take any action or group of actions on one or more selected parts or image portion on each video stream.

(15) LCS can send purchase orders of one or more LCB for one or more products from one or more stores to one or more LCP.

LCS can setup and register one or more LC stores and one or more CAMS of each LC store with LCC.

LCS can edit one or more stores' one or more CAMS' one or more products details (20) visually.

LCS can collaborate with one or more other LCS for products sales collaboration. Optionally the LCS may be distributed CAM's live video or updated video only when the arrangement of the products changes physically or any additions are made in products.

(25) Each registered LCP can use explorer for multiple stores' multiple CAMS video view management for multiple products & store searching, matching, viewing video, products purchase order management, supply management, pending orders management, accounting, commission management and any group actions.

LCC and each registered channel nodes including LCS, LCB and LCP can search and matches one or more LC stores' one or more Video CAMS for one or more products as per (30) one or more criteria or parameters like category, location, price range, brand, rank and visually search, match and compare the products wherein video view highlights visually all matched products.

LCS, LCB and LCP can view one or more taxonomy wise or category wise CAMS Video view from one or more LC stores (LCT).

LCC and each registered channel nodes including LCS, LCB and LCP can full screen, large view, zoom in, zoom out, scroll and customize one or more video view of one or (5) more stores.

LCS, LCB and LCP can make payment transaction in the form of cash, credit card and demand draft and any other suitable methods via LCC payment system or gateways for centralize accounting, metering and commission calculation.

LCC and LCS, LCB and LCP can use full features E-Commerce applications and 3rd party (10) services for purchase and sales order management, Customer Relationship Management (CRM), accounting, communication, payments.

LCS, LCB and LCP being trusted and identified includes one or more individual, team or association, collaboration of one or more pre-identified individuals and one or more entities including but not limited to organization, manufacturers, retailers, malls, stores, (15) shops, marketing agencies, advertisers, e-commerce sites or portals, corporation, producers, professional bodies, social bodies, governmental bodies and enterprises or an entity that exists as a particular and discrete unit.

LC system uses mapping logic for dynamically mapping physical location(s) of each CAM'S one or more products location(s) with video stream while playing, moving, (20) pausing, resizing, image(s) frame by frame changes, full screen, zooming, one or two or three dimensional rotating, sliding, flipping, dragging, spinning, scrolling and objects location changes are made.

Live Commerce system works on online, offline, Peer to Peer mode and provides multiple users, multiple visual styles, multiple administration levels, multiple localization & (25) globalization, multiple platform & device support, multi tasking, multiple versions

(universal, enterprise & customized versions), multiple clients (rich, thin or smart clients) functionalities and operates with all devices including computers, laptops, smart devices, mobile, kiosk & in-store kiosks, multi touch screen such as interactive walls and tabletops, digital projector, any digital display system, digital theatre system(DTS), other video capable devices , live commerce customize device(s) includes any imaging device(s), Identification chip Tags, centimeter accurate location identification device(s) like RFID radar and processing, storage and display device(s) & hardware with live commerce (5) applications and services, automation & embedded systems, IPTV, set-top-box, smart computers (tablet PC, Microsoft surface pc) & laptops, voice enabled technology, remote control selection system and useful for Business to Business(B2B), Business to Customer(B2C), Customer to Business(C2B), Customer to Customer(C2C), E- commerce, online and offline retailing, silent commerce, direct commerce and zero stock commerce.

(10) LC services and one or more live CAMS' Video stream binds with 3rd party portals or services via web services and integrate with applications, multimedia, virtual tours, virtual world, games, visual & interactive technology, digital maps (location based service), Voice enabled technology, multi AI agents, automation (robotics like robotic hands, sensors and embedded systems), and e-commerce and enterprise platform or services. ]

(15) LC system & Method can implement enterprise wide or universally, the same logic and technology to devise and apply new dimensions to all existing business practices not limits to advance visual or live interactive e-commerce, marketing, bids, auctions, e- tailingj visual search & match making, visual advertising and showcasing, visual and live security system, visual and live learning and training system, visual and live presentation

]

(20) system, visual automation, visual entertainment & games, visual information access, extended visual communication utility, visual data entry and comparison, silent commerce, direct commerce, zero stock commerce.

System to preferably use Microsoft DOTNET, web services, SQL server, Microsoft Silverlight, Flash Video Stream, Flash Video stream player and Action scripts, Adobe Flex and other flash authoring tools, Convert to Flash Video Tools, AJAX and JavaFx (25) technologies for development of applications, framework, network and services.

Motivations for Live commerce is to facilitates introducing new products and services, physical availability of products, take advantage of brand name, enter the global market place, react to pressure from competitors, meet customers' demand, increase sales, reduce transaction costs, reduce customer support costs and potential benefits for business are world-wide reach, any hour of the day, any day of the year, find and retain new customers, eliminate intermediaries, turn customers into "free employees" who

(5) perform correct order data entry, reduce credit and collections expenses and marketing benefits are low cost and global marketing channel, update product catalogs in realtime, deliver personalized shopping experience provider customer support like order tracking, extensive self-service information, individual dialog via e-mail and potential benefits for customers are from the comfort of home or office, any hour of the day, any

(10) day of the year, access to worldwide choices, access to information on competitors pricing and thereby enabling the sellers to become cost competitive, access to extensive marketing information on products of interest, online test of digital products (e.g., music), immediate download of digital products and personalized services (giving up some privacy in favor of personal services) like no waiting lines, no salesperson, use of

(15) intelligent agents to facilitate the preparation of the order, balance of bargaining power is shifting from sellers to consumers. Sellers and buyers both can save time, money and energy.

BRIEF DESCRIPTION OF THE DRAWINGS

However those skilled in the art will appreciate that the techniques taught in this (20) invention can be used in a variety of other situations.

Further aspects of the present invention will become apparent from the following description which is given by way of example only and with reference to the accompanying drawings in which:

FIG. 1 shows a logical block diagram of Live Commerce Framework, part of the present (25) invention;

FIG. 2 shows a logical block diagram of exemplary Live Commerce Buyers (LCB) interface, part of the present invention; FIG. 3 shows a logical block diagram of exemplary Live Commerce Sellers (LCS) interface part of the present invention;

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1 illustrates a logical block diagram of Live Commerce Framework and all the involved parties i.e. Live Commerce Controller (LCC), Live Commerce Buyers (LCB), Live Commerce Sellers (LCS), Live Commerce Suppliers (LCP) providing broad view of (5) working & interaction with interrelation map of all the involved parties.

FIG. 1 shows a logical block diagram of Live Commerce Framework providing broad view of working of Live Commerce network & its functionality.

(IA) shows a host computer, in the form of web server containing a cluster of servers for (IB) hosting database e.g. MS SQL Server communicate via protocol e.g. HTTP using business logic which are in the form of web services e.g. DOT.Net web services. It shows

(10) the broad overview of the functionality of Live commerce Controller (LCC) which include Online Portal Management, Registration, Lock-Unlock, Notifications, Search and Match Engine, Payments, Peer to Peer co-ordination & discovery, Namespace, Live commerce & E-commerce Applications Downloads, and Video distribution & web hosting services and Sellers, Buyers, Suppliers, CAMS, Products, Hit statistics, Ranks &

(15) Weights, Users preferences, Comments & Reviews and Advertising inventory databases and CAM setup codes, Commission & Sales Reports.

(1C) illustrates a logical block diagram of part of LC providing broad view of working of LCS. It illustrates a host computer and installed web browser applications and flash plug ins for access of Live Commerce online portal or applications, for LCS, in the form

(20) of local or web server containing a cluster of servers for hosting database e.g. (ID) MS SQL Server which store one or more store(s) one or more CAMS with related one or more products location and metadata information and provide services to the LCB via protocol e.g. HTTP using business logic which are in the form of web services e.g. DOT.Net web service for providing products location information and selective metadata

(25) and communicate to the all related parties i.e. LCC, LCB, LCP & other 3^rd parties. (IE) illustrates a exemplary Toy Store shelf of sample kids toy products and RFID tags on each toys, (IF) is imaging device or network camera or web cam or other camera over it which take real time video and converts to preferably flash video stream and sent it directly to LCB via LCC or LCS local or web server or 3ed party server for distribution of one or more video stream to one or more LCB.

(IG) illustrates a RFID physical location identification device e.g. RFID radar or any other location identification devices for dynamically note down the current physical location of one or more products or object and update the database of products for current location information. (IH) illustrates a RFID reader for read and write RFID (5) tags for inventory management and other purposes.

(II) illustrates a logical block diagram of part of LC providing broad view of working of LCB. It illustrates a host computer and installed web browser applications and flash plug ins for access of Live Commerce online portal or applications, for LCB, in the form of local or web server containing a cluster of servers for hosting database e.g. (IJ) MS SQL Server which store requested one or more stores one or more CAMS related (10) one or more products location and metadata information and send one or more purchase orders to one or more LCS or LCP directly or via LCC.

(IK) illustrates a logical block diagram of part of LC providing broad view of working of LCP. It illustrates a host computer and installed web browser applications and flash plug ins for access of Live Commerce online portal or applications, for LCP, in the form of local or web server containing a cluster of servers for hosting database e.g. MS SQL (15) Server which stores purchase orders from one or more LCB directly or via one or more LCS or LCC.

FIG. 2 shows a logical block diagram of exemplary Live Commerce Buyers (LCB) interface part of the present invention;

(2A) illustrates the Explorer part of Live commerce Buyers (LCB) interface which lists (20) the in-depth details related to the Live commerce Buyers (LCB) that show the list of all stores & its CAMS with details in tree format. The explorer tree represents Locations followed by Fields followed by Stores followed by CAMS. The explorer tree facilitates selection and invocation of multiple category of multiple stores multiple video stream CAMS and view related multiple products. Contextual 3rd click menu on explorer provides details and actions on it. (2B) illustrates the video stream cam view part of (25) interface. User can select one or more category wise (2G) stores from one or more locations or fields. Each store has one or more Video CAM for one or more categories. Tabbed interfaces (2G)(2H)(2I) provides easy navigation and switching of CAMS of various categories of stores.(2B) video view area displays live or updated or downloaded video or image frames or still image view. User can view video in full screen or scrollable or 3 dimensional format, Zoom In & Zoom Out and customized the view of

(5) each CAM. User can select one or more products or objects or image portion or logical part of video, tool tip or child window provides in-depth information about products or object or part of video and action menu or list of actions on it like selection(s), bookmarks, add to cart, compare, consult guide or salesperson etc. and two way live communication or collaboration, visual search and all drag and drop action(s). User can

(10) (2E) bookmark, add to cart, read details, rank, review, hit statistics, compare, sort one or more products from one or more categories stores, connect via one or more communication utilities (2F) like chat, email, VOIP, messenger with related one or more sales person for further information and queries.(2C) provides details of stores, CAMs and selected one or more products.

(15) (2D) illustrates the bookmark explorer of the interface which facilitates bookmark of one or more stores, CAMs and products for future need. User can create as many folders as they want as per their customized needs.

(2J) illustrates the search engine for LCB. User can search one or more stores one or more CAMs and one or more products of each CAMs. Advance search facilitates taxonomy or category wise searches like field, location and other parameters e.g. price (20) range, brand, one or more attributes of products.

(2E) System provides full features e-commerce applications to enterprises for multiple products orders management, products pending status, accounting, communication tools and utilities, products comparative analysis tools.

FIG. 3 shows a logical block diagram of Live Commerce Sellers (LCS), interface part of (25) the present invention;

(3A) illustrates the Explorer part of Live commerce Sellers (LCS) interface which lists the in-depth details related to the Live commerce Sellers (LCS) that show the list of all stores of particular LCS & their CAMS with details in tree format. The explorer tree represents Locations followed by Fields followed by Stores followed by CAMS. The explorer tree facilitates selection and invocation of multiple category of multiple stores multiple video stream CAMS and view related multiple products. Contextual 3ed click menu on explorer provides details and actions on it. (3B) illustrates the video stream cam view part of interface. Seller can select one or more category wise (3G) stores of

(5) one or more locations or fields. Each store has one or more Video CAM for one or more categories. Tabbed interfaces (3G)(3H)(3I) provides easy navigation and switching of CAMS of various categories of stores.(3B) video view area displays live or updated or downloaded video or image frames or still image view. Seller (LCS) can view video in full screen or scrollable or 3 dimensional format, Zoom In & Zoom out

(10) and customized the view of each CAM. LCS administrator can select one or more products or objects or image portion or logical part of video; tool tip or child window provides in-depth information about products or object or part of video and action menu or list of actions on it. LCS administrator or system user can (3E) edit live stores and CAMs details, visually edit each product details, live two way communication and

(15) collaboration with others, visually analysis of one or more products area or date wise Hits, Sales, Buyers order details, Products popularity, Pending Orders, Bids, Inventory of Stocks. LCS can setup one or more new stores and one or more CAMs of each store connect via one or more communication utilities (3F) like chat, email, VOIP, messenger with related one or more LCB to provide supports or further information and

(20) answers. (3C) provides details of stores, CAMs and selected one or more products.

(3D) illustrates the Prospective Customers List and explorer of the interface which facilitates maintains one or more prospective customers and their details for follow-up and communication. LCS administrator can create as many folders as they want as per their customized needs.

(31) illustrates the search engine for LCS. LCS system user can search one or more (25) stores one or more CAMs and one or more products of each CAMs. Advance search facilitates taxonomy or category wise searches like field, location and other parameters e.g. price range, brand, one or more attributes of products.

(3E) System provides full features e-commerce applications for supplier management, customer relationship management, sales management, accounting, communication tools and utilities, web services.

Claims

I claim:

1. A system and method of processing including searching, matching, automatic identification(s), selection(s) and action(s) on one or more image portion(s) of image frame(s) of digitized video data and video stream data for the purpose of enabling object handling including searching, matching, automatic identification, selection(s), highlighting, associate action(s) , remote action(s) and two or multi way

(5) communication and collaboration; the system comprising of imaging device(s), computing and storage devices, identification chip tag(s), location identification device(s) whereby the system receives plurality of image frames in an imaging device whereby said plurality of image frames are generated by at least one imaging device and the system receives plurality of real-time and up-dated physical location information of

(10) one or more logical object(s) wherein said plurality of physical location information are generated by at least one location identification device; the system receives plurality of metadata of one or more logical object(s) whereby said plurality of metadata are inputted by user stored in each identification chip tag(s) and one or more database(s); whereby said plurality of generated image frames with real-time and updated physical location information and metadata of one or more object(s) stored in one or more servers and sent or distributed the same to one or more end user(s) as per requested parameters.

2. The system and method of claim 1 wherein said system identifies one or more logical image portion(s) of image frame(s) of digitized video data and video stream data of fixed

(5) or movable physical object(s) including products, items, goods and live entities including human, animals, birds and live plants and each physical object(s) or live entities has one or more identification chip tag(s) including RFID tags or any other tags.

3. The system and method of claim 1 wherein said image portion(s) of image frame(s) of digitized video data and video stream data can be seen in two-dimensional and three-

(10) dimensional view(s).

4. The system and method of claim 1 wherein said video streams or image frame(s) of digitized video data are real time or near real time, live, on demand, updated, converted, filtered, processed, dynamic, existing, pre-recorded, pre-loaded, series of still images, single image, merging and splitting of image frame(s) and video stream(s) or any formats

(15) including flash or a digitized version of an original analog image sequence.

5. The system and method of claim 1 wherein said imaging device including any movable (with pan, tilt, zoom functionality) or fixed mega pixel, multi pixel and high definition network camera or web camera or any other imaging device(s) or camera(s).

6. The system and method of claim 1 wherein said location identification device includes any (20) location identification devices preferably RFID tags, RFID reader and RFID radar.

7. The system and method of claim 1 wherein said location identification device identifies and plots the positions of RFID tags in ID, 2D and 3D space in real time.

8. The system and method of claim 1 wherein said metadata of each image portion(s) including hyperlink, multimedia, text including details, file, XML, graphics, animation,

(25) images and audio & videos.

9. The system and method of claim 1 wherein said image frame(s) of video stream or of digitized video data presentation has the capability to be merged with web services and interactive animation, runtime customization, HTML, DHTML, XML, embedded programming & scripting languages, multiple layers, graphics, images, visual system, text, multimedia, voice technology, hyperlinks, file, audio, video and interactive programmable controls & components including ToolTip, Tab, Toolbar, Popup, Grid, Menu, Calendar, (5) Button, Input, Navigation, transparent, List, Database, Resizing & Graphical User interface.

10. The system and method of claim 1 wherein said image frame(s) of digitized video data or video stream data with location identification information and associate metadata are store or synchronization or sent or distributed or published directly or via one or more video

(10) stream server(s) or database(s) or local networks or local PC or via peer to peer or via external storage devices including CD, DVD, plug and play hard drive & flash drive to one or more video stream data users or viewers.

11. The system and method of claim 1 wherein said one or more portion(s) or object(s) of image frame(s) of digitized video data or video stream data are searchable with the help of (15) real time location information and associated metadata and search results and status are visually highlighted.

12. The system and method of claim 1 wherein said individual or multiple logical portion(s) or object(s) of image frame(s) of digitized video data or video stream data are automatically or manually identified.

13. The system and method of claim 1 wherein said one or more logical portion(s) or object(s) (20) of image frame(s) of digitized video data or video stream data are selected for further processing including one or more manual or automatic action(s), step by step action(s), event and triggered based manual or automatic action(s), remote action(s), two way & multi way, communication, collaboration and highlighting or pinpointing and multiple users can simultaneously and concurrently download, present or view, play and can take (25) multiple selections and actions on multiple video stream's one or more image portion(s).

14. The system and method of claim 1 and 12 wherein said system provides one or more automatic or manual action(s) including printing with metadata, searching, matching, highlighting, alerting, edit associate data, display status & metadata including hyperlink, multimedia, text including details, file, XML, graphics, animation, images and audio & videos, save and bookmark image(s) or image portions(s), image frame(s) processing, drag and drop for group actions, selective action(s), remote action(s) and two or multi way communication and collaboration between video server administrator(s) and client user(s) over selected one or more logical portion(s) or object(s) of image frame(s) of digitized (5) video data or video stream data.

15. The system and method of claim 1 wherein said system each time uses mapping logic for dynamically mapping physical location(s) of each CAM'S one or more products location(s) with video stream while playing, moving, pausing, resizing, image(s) frame by frame changes, full screen, zooming, one or two or three dimensional rotating, sliding, flipping,

(10) dragging, spinning, scrolling and objects location changes are made.

16. A system, method and business method of automatically or manually identifying plurality of image portion or object or individual items like product or any logical part from plurality of real time or near real time or updated or dynamic or existing video streams or frame(s) of digitized video data and user can select one or more identified image portion or group of

(15) image portions on each video stream and take one or more actions or group of actions or series of actions or step by step actions on each image portion and two or multi way communication and collaboration with associate remote video distributor administrators and sync data or request data or metadata comprising; RFID Tags on each individual items or products or physical and live objects like person or animals, any RFID physical location

(20) identification device or other location identification devices and RFID Reader and imaging device including movable or fixed Network Camera or Web CAM or any other imaging device or camera, and the steps of: receiving a plurality of image frame(s) of digitized video data from image processing device(s) preferably network camera or web cam or any other camera or imaging device wherein said plurality of image frame(s) are generated by

(25) at least one imaging device; each of or one or more installed Network Camera or Web CAM or other camera captures video in any formats and converts preferably to flash video stream and sent or distribute each updated or live or converted or filtered or on demand video stream or image(s) or three dimensional multimedia with Products physical Location identification data and Products metadata including (hyperlink, graphic, multimedia, text,

(30) file, animation, images and audio & videos) directly or via one or more LCC video stream servers or LCS one or more servers or 3rd party hosted one or more servers or via peer to peer or via offline with external devices including CD,DVD to one or more LCB; each LCB can search match and invoke one or more video stream from one or more LCB stores' one or more CAM; each video view dynamically mapped with each products or objects physical location and each video view associate data dynamically presents on each view's selected image portion(s); each background video view's selected image portions' associate action or group of actions or series of actions or step by step actions execute (5) automatically or manually preferably via flash action script when use click particular location or part of live or updated video stream's one or more image portion(s).

17. A Live commerce system as per claim 1 and 15 wherein the Live Commerce Controller (LCC) acting as a central unique controller services and governing, administering, monitoring and controlling which provides following services like Online Portal

(10) Management, Registration, Lock-Unlock, Notifications, Search and match Engine,

Payments, Peer to Peer co-ordination and discovery, Namespace, Live commerce & E- commerce Applications Downloads, and Video distribution & web hosting services and Sellers, Buyers, Suppliers, Products, Hit statistics, Ranks & Weights, Users preferences, comments & reviews, Advertising databases and CAM setup codes, Commission & Sales (15) Reports.

18. A Live commerce system as per claim 1 and 15 wherein plurality of pre-identified role active LCC channel nodes has to registered with LCC for unique identification and trust including:

1. plurality of Live Commerce Sellers (LCS) (20) 2. plurality of Live Commerce Buyers (LCB) 3. plurality of Live Commerce Suppliers (LCP)

19. A Live commerce system as per claim 1 and 15 wherein centralize LCC can use global explorer for multiple CAMS video view management for lock and unlock stores, CAMS and products, multiple products searching, matching, viewing, communicating, date wise

(25) and location wise products analysis like hits, sales, complaints, commission, orders pending, special request and any group actions.

20. A Live commerce system as per claim 1 and 15 wherein each registered LCB can use explorer for multiple CAMS video view management for multiple products searching, matching, book marking, viewing, buying, comparing, communicating, and reviewing products and any group actions.

21. A Live commerce system as per claim 1 and 15 wherein each registered LCB can select one or more video stream part or product and read products review, add to cart or buy, bookmark the products and communicate associate sales people for further information, read reviews, Hits and ranks, give comments and rank, compare products with same store

(5) or with other stores, bid the products and take any action or group of actions on one or more selected parts or image portion on each video stream.

22. A Live commerce system as per claim 1 and 15 wherein each registered LCB can drag and drop one or more video stream part or product and take action(s) or group of action(s) like add to cart, compare, bookmark and consult for more details.

23. A Live commerce system as per claim 1 and 15 wherein each registered LCB can send (10) purchase orders for one or more products of one or more stores to LCC and one or more

LCS and LCP via LCC.

24. A Live commerce system as per claim 1 and 15 wherein each registered LCS can use explorer for multiple CAMS video view management for multiple products searching, matching, viewing, visually products metadata entry, communicating, editing products

(15) metadata, date wise and location wise products analysis like hits, sales, bides, stocks, supplier, orders pending and any group actions.

25. A Live commerce system as per claim 1 and 15 wherein each registered LCS can select one or more video parts or products for individual visual products sales analysis like hits, sales, bids, stocks, orders pending, communicate with buyers, check emails, support request, read

(20) reviews, rank and comment, find out products popularity or discontinue products and take any action or group of actions on one or more selected parts or image portion on each video stream.

26. A Live commerce system as per claim 1 and 15 wherein one or more registered LCS can send purchase orders of one or more LCB for one or more products from one or more

(25) stores to one or more LCP.

27. A Live commerce system as per claim 1 and 15 wherein each registered LCS can setup and register one or more LC stores and one or more CAMS of each LC store with LCC.

28. A Live commerce system as per claim 1 and 15 wherein each registered LCS can edit products detail by selecting on the image portion(s)

29. A Live commerce system as per claim 1 and 15 wherein each registered LCS can collaborate with one or more other LCS for products sales collaboration.

30. A Live commerce system as per claim 1 and 15 wherein optionally each CAMS' live video (5) or updated video stream distribute to LCB only when physical changes or addition are made to products.

31. A Live commerce system as per claim 1 and 15 wherein each registered LCP can use explorer for multiple stores' multiple CAMS video view management for multiple products & store searching, matching, viewing video, products purchase order management, supply

(10) management, pending orders management, accounting, commission management and any group actions.

32. A Live commerce system as per claim 1 and 15 wherein LCC and each registered channel nodes including LCS, LCB and LCP can search and match one or more LC stores' one or more Video CAMS for one or more products as per one or more criteria or parameters like

(15) category, location, price range, brand, rank and visually search, match and compare the products wherein video view highlights visually all matched products or search result.

33. A Live commerce system as per claim 1 and 15 wherein each registered channel nodes including LCS, LCB and LCP can invoke CAMS via unique hyperlink or view one or more taxonomy wise or category wise CAMS Video view from one or more LC stores (LCT).

34. A Live commerce system as per claim 1 and 15 wherein LCC and each registered channel (20) nodes including LCS, LCB and LCP can use foil screen, large view, zoom in, zoom out, scroll and customize view of one or more video stream or image(s) view from one or more stores' one or more CAM.

35. A Live commerce system as per claim 1 and 15 wherein LCC and each registered channel nodes including LCS, LCB and LCP can print foil video stream or image(s) view or one or more image portion(s) of video stream with metadata.

36. A Live commerce system as per claim 1 and 15 wherein LCC and each registered channel nodes including LCS, LCB and LCP can two-way or multi-way communicate or collaborate via selected logical image portion(s) of video stream data.

37. A Live commerce system as per claim 1 and 15 wherein each registered channel nodes (5) including LCS, LCB and LCP can make payment transaction in the form of cash, credit card and demand draft and any other suitable methods via LCC payment system or gateways for centralize accounting, metering and commission calculation.

38. A Live commerce system as per claim 1 and 15 wherein LCC and each registered channel (10) nodes including LCS, LCB and LCP can use foil features E-Commerce applications and

3rd party services for purchase and sales order management, Customer Relationship Management (CRM), accounting, communication, payments.

39. A Live commerce system as per claim 1 and 15 wherein LC uses mapping logic for dynamically mapping physical location(s) of each CAM'S one or more products location(s)

(15) with video stream while playing, moving, pausing, resizing, image(s) frame by frame changes, foil screen, zooming, one or two or three dimensional rotating, sliding, flipping, dragging, spinning, scrolling and objects location changes are made.

40. A Live commerce system as per claim 1 and 15 wherein each registered channel nodes including LCS, LCB and LCP being trusted and identified includes one or more individual,

(20) team or association, collaboration of one or more pre-identifϊed individuals and one or more entities including but not limited to organization, manufacturers, retailers, malls, stores, shops, marketing agencies, advertisers, e-commerce sites or portals, corporation, producers, professional bodies, social bodies, governmental bodies and enterprises or an entity that exists as a particular and discrete unit.

41. A Live commerce system as per claim 1 and 15 wherein LC system works on online, (25) offline, Peer to Peer mode and provides multiple users, multiple visual styles, multiple administration levels, multiple localization & globalization, multiple platform & device support, multi tasking, multiple versions (universal, enterprise & customized versions), multiple clients (rich, thin or smart clients) functionalities and operates with all digital devices.

42. Live commerce system as per claim 1 and 15 wherein LC services and one or more live CAMS' Video stream binds with 3rd party portals or services via web services and integrate with applications, multimedia, virtual tours, virtual world, games, visual &

(5) interactive technology, digital maps (location based service), Voice enabled technology, multi AI agents, automation (robotics like robotic hands, sensors and embedded systems), and e-commerce and enterprise platform or services.

43. The scalability feature as per claim 1 and 15 endorse the LC system & Method can implement enterprise wide or universally, the same logic and technology to devise and

(10) apply new dimensions to all existing business practices not limits to advance visual or live interactive e-commerce, marketing, bids, auctions, e-tailing, visual search & match making, visual advertising and showcasing, visual and live security system, visual and live learning and training system, visual and live presentation system, visual automation, visual entertainment & games, visual information access, extended visual communication utility,

(15) visual data entry and comparison, silent commerce, direct commerce, zero stock commerce.