{"id":65810,"date":"2022-01-26T15:26:44","date_gmt":"2022-01-26T15:26:44","guid":{"rendered":"https:\/\/aijourn.com\/?p=65810"},"modified":"2024-04-02T15:45:45","modified_gmt":"2024-04-02T15:45:45","slug":"knowledge-as-a-service-kaas-in-2022","status":"publish","type":"post","link":"https:\/\/aijourn.com\/knowledge-as-a-service-kaas-in-2022\/","title":{"rendered":"Knowledge-As-A-Service (KaaS) In 2022"},"content":{"rendered":"\n<p>Knowledge graphs hit the <a href=\"https:\/\/allegrograph.com\/gartner-hype-cycle-for-ai-knowledge-graphs\/\">peak<\/a> of their Gartner hype cycle in 2020. And much as KG teams celebrated the rise to prominence, \u201chype\u201d carries an implicit risk. What if the touted promise never emerges? After all, network-based databases (including graph DBs) have been in use since the 1960s, just largely confined to academic settings. What\u2019s working for graph adoption today?<br><br>For starters, what do we mean by the \u201cknowledge\u201d in knowledge-as-a-service?<br><br>In common parlance, knowledge has come to be known as <strong>information<\/strong> <strong>and context<\/strong>. This is one of the roots of the term \u201cknowledge graph.\u201d While a graph is simply a database structure composed of nodes (entities) and edges (relationships), knowledge graphs are populated to provide information and context.\u00a0<\/p>\n\n\n\n<p>To jump to the present day, knowledge-as-a-service has grown an ecosystem of players providing services at a range of layers.\u00a0<\/p>\n\n\n\n<p>Build your own knowledge graph:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Layer one knowledge-as-a-service: graph database management systems<\/li><li>Layer two knowledge-as-a-service: graph analytics and extraction; query languages and processing engines<\/li><li>Layer three knowledge-as-a-service: visualization and analysis tools; integrations with BI tools<\/li><\/ul>\n\n\n\n<p>Utilize an existing knowledge graph:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Full service knowledge-as-a-service: knowledge graph APIs, visual search and integrations<\/li><\/ul>\n\n\n\n<p>It\u2019s also worth noting that these two categories aren\u2019t mutually exclusive. Plenty of companies seed, enrich, or update knowledge graphs they\u2019ve built with existing external knowledge graphs. Additionally, existing knowledge graphs are a particularly well suited format for giving machine learning models context; machine learning models that can in turn help augment or populate internal knowledge graphs with additional (custom) fields.&nbsp;<\/p>\n\n\n\n<p>Whether building, utilizing an external service or pursuing a hybrid approach, there are two high-level issues that most knowledge projects must wrangle with. The first involves the fact that meaningful knowledge graphs are often of considerable scale. This is the issue of price (and correspondingly process) for fact accumulation. The next involves the actionable output: how do we get existing knowledge in front of the right person at the right time (knowledge workflows)?\u00a0<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The Cost of Fact Accumulation<\/h2>\n\n\n\n<p>As mentioned previously, knowledge graphs have been utilized in academic and research settings for a number of decades (beginning in the <a href=\"http:\/\/knowledgegraph.today\/paper.html\">1970\u2019s<\/a>). While this has been useful for sketching out the theoretical strengths and weaknesses of this form of data modeling, few academic knowledge graphs were of any size to be useful in commercial settings.&nbsp;<\/p>\n\n\n\n<p>As our ability to quickly store and retrieve data increased exponentially, several enterprise knowledge base companies attempted to build databases of a size useful for a wide range of enterprise applications. In the early 1980\u2019s, a long term project called Cyc was compiled. The aim: create a knowledge base large enough to remedy the issue of AI systems with an initial promise that falters due to a lack of ongoing data sources. Cyc was able to compile around 21M fields manually (and at a great cost).\u00a0<\/p>\n\n\n\n<p>In the 1990s and with the proliferation of the internet, (unstructured) data was no longer an issue, with exponential data growth each and every year. But unstructured web data doesn\u2019t equate to useful information (let alone \u201cknowledge\u201d \u2013 particularly on topics of enterprise interest). Metaweb attempted to remedy this through crowdsourcing knowledge. Building off of Wikipedia, they were able to increase Cyc\u2019s field count 100x before being acquired and folded into Google.\u00a0<\/p>\n\n\n\n<p>Together these two enterprise-focused projects exemplified both the promise of enterprise knowledge graphs, and the shortcoming of manual fact accumulation. Because there\u2019s a relatively hard cap on how quickly humans can curate answers, there\u2019s a hard floor on how low you can drop the price of manual fact accumulation. You need more people or more time, both of which mean more money.<br><br>Today the internet has grown significantly. And we do have examples of massive knowledge bases compiled by humans (IMDB, Yelp). But they tend to need to be about topics that are of widespread interest and shared knowledge. Another dead end for large-scale manual knowledge graphs of enterprise use. So how do we go about structuring enterprise knowledge efficiently today?&nbsp;<\/p>\n\n\n\n<p>Powerful web crawlers, natural language processing, and machine vision with machine learning computations on top have managed to massively increase the size of enterprise-use knowledge bases for a fraction of the price. A huge range of useful enterprise data is available online as well as in the news. It simply needs to be structured.&nbsp;<\/p>\n\n\n\n<p>Among general use knowledge graphs, <a href=\"https:\/\/www.gdeltproject.org\/\">GDELT<\/a> and <a href=\"https:\/\/www.diffbot.com\">Diffbot<\/a> provide the largest coverage areas. Where GDELT automates the organization of facts from worldwide newspapers, Diffbot crawls the entire web and pulls out entities and facts.&nbsp;<\/p>\n\n\n\n<p>Natural language processing pushed to layers one through three listed earlier in this article also enable enterprises to pick and choose where to source their knowledge graphs from. The following sources are commonly parsed into enterprise knowledge graphs:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Firmographic data<\/li><li>Technographic data<\/li><li>Internal documents<\/li><li>News or social media mentions<\/li><li>Product catalogs<\/li><li>Review data<\/li><li>Real world events<\/li><li>Customer data<\/li><li>Prospect data<\/li><li>Investigative data<\/li><li>Supply chain data<\/li><li>Among others<\/li><\/ul>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/oqu46SetSFZQpDoQ6A2QPMYqO-Li0OM1oEQ4K6r9VsiSjUgXq30m7ki-T9THeJv7E0Gt5zACeaXQFgFCsGthWo4antc0WEuapP6V07iyYFoFkoJUbEpCKfEatgKU1UVwd2-YE4pO\" alt=\"\"\/><figcaption>Image <a href=\"https:\/\/blog.diffbot.com\/the-economics-of-building-knowledge-bases\/\">Source<\/a><\/figcaption><\/figure><\/div>\n\n\n\n<p>While a work-in-progress in many hard problem areas, AI has proven to be the first step change in the cost per fact accumulation in modern times. For example, looking at Diffbot \u2013 largest commercial Knowledge Graph provider \u2013 cost <a href=\"https:\/\/blog.diffbot.com\/the-economics-of-building-knowledge-bases\/\">per fact accumulation<\/a> <a href=\"https:\/\/www.heikopaulheim.com\/docs\/iswc_bluesky_cost2018.pdf\">compared to<\/a> Cyc or Freebase shows an improvement of roughly x2500.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">From Knowledge Graphs to Knowledge Workflows<\/h2>\n\n\n\n<p>One of the main issues that persists even after organizations have well populated and topical knowledge graphs is that of not thinking in terms of knowledge workflows. Similarly to some of the often touted <a href=\"https:\/\/www.bbvaopenmind.com\/en\/technology\/digital-world\/data-lake-an-opportunity-or-a-dream-for-big-data\/\">downsides<\/a> of data lakes, knowledge graphs can fall prey to accumulating huge amounts of information that doesn\u2019t get in front of the right team members at the right time.&nbsp;<\/p>\n\n\n\n<p>Like any other data store, the accumulation of a \u201clarger\u201d knowledge graph can be more of a liability than an asset.&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Data becomes stale<\/li><li>Data \u201cislands\u201d emerge<\/li><li>No understanding of overall data structure<\/li><li>Messy data provenance<\/li><\/ul>\n\n\n\n<p>The real benefits of knowledge graphs surface when high volume and velocity data can be structured in an automated way to solve data gathering issues for discrete teams.<br><br>While many unique use cases have not been explored by major knowledge graph providers, strengths of present knowledge graph architectures include the following:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Graph databases are flexible, containing many different entity types<\/li><li>Graph databases are centered around relationships between entities (linked data providing context)&nbsp;<\/li><li>Unlike relational databases which may require complex joins to retrieve linked data, graphs offer performance benefits<\/li><li>New fact types can be added \u201con the fly\u201d as the world they\u2019re representing changes<\/li><li>Each entity has a universal identifier (disambiguation)<\/li><li>Data provenance providing explainability to each constituent fact<\/li><li>High expressivity for modeling complex domains<\/li><\/ul>\n\n\n\n<p>While knowledge graphs power major services we depend on (Netflix, Spotify, Google search, etc.), for most organizations successful implementations of knowledge-as-a-service involves pairing specific KG strengths with specific needs. The largest portion of future knowledge-as-a-service promise involves freeing workers from specific drudgeries related to&nbsp; fact accumulation and trend spotting in their role. And that\u2019s a win that\u2019s well underway!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Knowledge graphs hit the peak of their Gartner hype cycle in 2020. And much as KG teams celebrated the rise to prominence, \u201chype\u201d carries an implicit risk. What if the touted promise never emerges? After all, network-based databases (including graph DBs) have been in use since the 1960s, just largely confined to academic settings. What\u2019s &hellip;<\/p>\n","protected":false},"author":299,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","footnotes":""},"categories":[1307,181],"tags":[],"ppma_author":[671],"class_list":["post-65810","post","type-post","status-publish","format-standard","hentry","category-education","category-future-of-ai","author-merillcook"],"authors":[{"term_id":671,"user_id":299,"is_guest":0,"slug":"merillcook","display_name":"Merrill Cook","avatar_url":{"url":"https:\/\/aijourn.com\/wp-content\/uploads\/2023\/02\/Merill-Cook-Headshot.png","url2x":"https:\/\/aijourn.com\/wp-content\/uploads\/2023\/02\/Merill-Cook-Headshot.png"},"last_name":"Cook","first_name":"Merrill","job_title":"","user_url":"https:\/\/www.arist.co\/","description":"Merrill Cook is the director of brand and content marketing at Arist, a microlearning company that delivers learning within the flow of work. Previously of Diffbot,  one of three NA companies to crawl the entire web and provider of the world's largest commercial knowledge graph."}],"_links":{"self":[{"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/posts\/65810","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/users\/299"}],"replies":[{"embeddable":true,"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/comments?post=65810"}],"version-history":[{"count":1,"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/posts\/65810\/revisions"}],"predecessor-version":[{"id":65812,"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/posts\/65810\/revisions\/65812"}],"wp:attachment":[{"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/media?parent=65810"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/categories?post=65810"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/tags?post=65810"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/aijourn.com\/wp-json\/wp\/v2\/ppma_author?post=65810"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}