Cognitive Computing Authors: Pat Romanski, Yeshim Deniz, Liz McMillan, Elizabeth White, Jason Bloomberg

Related Topics: @CloudExpo, Microservices Expo, Cognitive Computing

@CloudExpo: Article

Enterprise Search in a Hybrid Cloud Computing Model

Information management in a big data world

Enterprise Search: The data generated and stored by enterprises are growing, here are some simple statistics.

  • Ninety percent of data volume generated today was produced in the last two years
  • By 2020, the Digital Universe will be 44 times as large as it was in 2009.
  • 35 zettabytes by 2020. That's 35 trillion gigabytes.

These figures are truly astronomical but they are real considering the amount of content generated by the various devices, digital media, social networking and other sources.

However, what is the usefulness of such vast quantities of data unless users can search them in a manner that will be useful to the information needs of the enterprise.

Hence the Enterprise Search strategy for the large enterprises assumed significance a lot earlier.

Characteristics of Enterprise Search Strategy
Enterprise Search needs are very different from Content search as used by Google and other search engines, where the contents of the website have been crawled, indexed and searched. Here the matching of text strings to the content of a website plays a dominant factor in search results. The following are the ways in which the enterprise search needs differ:

  • Enterprise Searches will be meaningful only if they follow a taxonomy or hierarchy in the way the business is organized. For example, any searches about vendors will only make sense if the particular region, business unit and product line that is of interest is taken into consideration. Otherwise the user may see lot of redundant data.
  • Enterprise Searches need to consider both structured and unstructured content. While most of the Internet search engines do work on the unstructured data, enterprise searches definitely need to consider a huge volume of data inside the:
    • ECM Repositories (Enterprise Content Management)
    • Microsoft Office
    • Relational Databases
    • SAP and Other ERP Applications
    • Legacy / Mainframe applications
    • Other Unstructured Contents of the new era
  • The relevance of enterprise search needs to be highly accurate unlike a regular Internet search since the wrong results may hinder the enterprise productivity. Remember warehouse personnel finding the details of a part based on a search on a vendor name, any wrong result will greatly affect the productivity. The ranking algorithms for enterprise search have to be highly optimized.
  • Security is another important aspect of enterprise search strategy. Most application systems within an enterprise are built with authorization and fine-grained access strategy, which means a crawler-based enterprise search approach should not simply bring all the relevant hits, rather it should go by the authorization of the searcher and bring only the relevant details that can be viewed by the searcher.
  • More than a full text search: A typical Internet search is all about a full text search of the web pages. However, enterprise search needs to infer lot more information is available in the back-end systems by joining the data between them. For example, is someone is searching about a child part, the user may expect to see the parent part details also. In which case the enterprise search needs to use the taxonomy data stored in the ERP databases and bring the results.

Enterprise Search and Hybrid Cloud
Based on the above, it's evident that Enterprise Search plays an important role in future enterprises. Also the Hybrid Cloud Model provides a perfect platform for hosting an Enterprise Search application, with the following components:

  • Enterprise Search Connectors: These consist of several connectors to enterprise content management, ERP and databases; this can be SaaS-based connectivity Services that allow the enterprises to connect to the repositories of their interest.
  • Crawl / Parse and Index: This is a highly time-consuming process of extracting meaningful search parameters and taxonomies from the enterprise repositories and indexing them as part of the Enterprise Search metadata. This metadata can be kept on the Cloud platform and the crawl process can be implemented using optimized processes like HPC (High Performance Computing).
  • Search Results Display: These are ideally implemented as part of web portals with rich user interfaces and facilitate the searching of enterprise content. These also implement a high level of security in terms of authentication and authorization. These can be web-based elastic web applications that can scale up and scale down depending on the user search needs.
  • Legacy Enterprise Repositories (Structured Content): These are the real enterprise data that will be hyperlinked from the metadata available over the Cloud. These data may or may not move to the Cloud based on the organization's needs.
  • Enterprise Repositories (Unstructured Content): While this can remain inside the boundaries of the data center, the amount of volume expected on this makes it ideal to be hosted on Cloud Elastic Storage so that the large volumes of the unstructured content is stored and utilized on an on-demand basis.

The following diagram explains how a Hybrid Cloud Model can be perceived and utilized to implement the Enterprise Search Strategy.

With the information explosion, the petabyte enterprise needs search capabilities within the organization. Cloud provides a perfect platform toward that. The growth in unstructured content further iterates the need for a Cloud platform. As evident from this discussion, this could be a starting point for organizations towards enterprise search on a hybrid cloud model.

More Stories By Srinivasan Sundara Rajan

Highly passionate about utilizing Digital Technologies to enable next generation enterprise. Believes in enterprise transformation through the Natives (Cloud Native & Mobile Native).

IoT & Smart Cities Stories
Codete accelerates their clients growth through technological expertise and experience. Codite team works with organizations to meet the challenges that digitalization presents. Their clients include digital start-ups as well as established enterprises in the IT industry. To stay competitive in a highly innovative IT industry, strong R&D departments and bold spin-off initiatives is a must. Codete Data Science and Software Architects teams help corporate clients to stay up to date with the mod...
There are many examples of disruption in consumer space – Uber disrupting the cab industry, Airbnb disrupting the hospitality industry and so on; but have you wondered who is disrupting support and operations? AISERA helps make businesses and customers successful by offering consumer-like user experience for support and operations. We have built the world’s first AI-driven IT / HR / Cloud / Customer Support and Operations solution.
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
Druva is the global leader in Cloud Data Protection and Management, delivering the industry's first data management-as-a-service solution that aggregates data from endpoints, servers and cloud applications and leverages the public cloud to offer a single pane of glass to enable data protection, governance and intelligence-dramatically increasing the availability and visibility of business critical information, while reducing the risk, cost and complexity of managing and protecting it. Druva's...
BMC has unmatched experience in IT management, supporting 92 of the Forbes Global 100, and earning recognition as an ITSM Gartner Magic Quadrant Leader for five years running. Our solutions offer speed, agility, and efficiency to tackle business challenges in the areas of service management, automation, operations, and the mainframe.
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, compared the Jevons Paradox to modern-day enterprise IT, examin...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
DSR is a supplier of project management, consultancy services and IT solutions that increase effectiveness of a company's operations in the production sector. The company combines in-depth knowledge of international companies with expert knowledge utilising IT tools that support manufacturing and distribution processes. DSR ensures optimization and integration of internal processes which is necessary for companies to grow rapidly. The rapid growth is possible thanks, to specialized services an...
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
Scala Hosting is trusted by 50 000 customers from 120 countries and hosting 700 000+ websites. The company has local presence in the United States and Europe and runs an internal R&D department which focuses on changing the status quo in the web hosting industry. Imagine every website owner running their online business on a fully managed cloud VPS platform at an affordable price that's very close to the price of shared hosting. The efforts of the R&D department in the last 3 years made that pos...