The Datastack.

The Datastack Framework from Nebuli

The Datastack® framework sets the process needed for Nebuli to gather the data it requires for generating its Memory Blocks, then converge additional services where required and construct the intelligence output for customers and developers.

The concept.

The “Data Stack” concept is a popular, unofficial term used in Big-Data sectors, which involves collecting and managing large amounts of data from varied sources in one place to provide meaningful business insights and analytics.

But, there is a problem…

The above Data Stack concept is fast becoming outdated in the new digital transformation era – with an increasing number of industries converging into newer, more diverse, and more dynamic alignments than ever before.

This trend is the foundation of the new and emerging digital ecosystems.

Digital ecosystems involve more than just data. Hence, we created our own Datastack framework as the new standard supporting teams and organisations entering this growing emerging market.

Designed for emerging digital ecosystems.

Digital ecosystems are the pivotal step for teams and organisations in uncovering new business opportunities, as well as hidden augmented intelligence capabilities that can dramatically transform their output across markets.

We developed the Datastack and its convergence framework to achieve just that.

We created Nebuli’s  Datastack framework on the same principle of unifying data silos in one channel, except, we also converge several other layers of integrated services, such as software, UI/UX and data security, in the same channel.

Working with your ecosystem.

The Datastack is fundamental for defining and enhancing your existing digital ecosystem, where we analyse your current workflows, data models, SaaS/PaaS/system integrations and critical pain points.

The Datastack is, indeed, the framework behind our human-centric design and development methodology.

Nebuli Customer's Current Digital Ecosystem

The Datastack advantage.

Through the Datastack, Nebuli combines what is traditionally seen as separate services of data security, compression, modelling, classification, segmentation and knowledge discovery.

With all of the converged services within the framework, the Datastack can be integrated into existing applications, software packages and websites with ease as a single API-powered service package.

The Datastack Framework Structure (Layers) from Nebuli

Datastack service layers.

In order for Nebuli to generate an efficient and most relevant augmented intelligence ecosystem for individual teams, each layer of the Datastack plays a crucial role as follows:

The Datastack - Client Data Layer

Client Data Layer

We must always start with a customer’s data – where Nebuli consolidates their internal and external data silos into a single and easily accessible Data Layer.

The Data Layer alone could significantly enhance the performance and data structure of the customer’s workflow as it eliminates the tedious task of managing endless data sources.

The Datastack - Private API Layer

Private API Layer

This is the internal security layer that connects a customer’s Data Layer with external services via a private API gateway.

The Datastack - Nebulized Data Layer

Nebulized Data Layer®

This is Nebuli’s flagship core framework through which it conducts its unique deep data mining, generation of working memory and knowledge discovery processes, combined with novel data compression algorithms.

The Nebulised Data Layer (NDL) contains Nebuli’s indexed data that it needs from the Data Layer for the given tasks. Nebuli then compresses this indexed data into its internally generated semantic and ontological models that allows it to read data in any format, language and from any vertical. Further details are discussed below.

The Datastack - Integrated Services Layer

Integrated Services Layer

The central feature of Nebuli’s Datastack is the ability to integrate external services where needed, such as a customer’s custom data security protocols, their internal API libraries, decentralised ledgers (like Augmenter) and more.

This layer is particularly useful if the customer needs to integrate existing software into the Datastack’s single ecosystem and take advantage of Nebuli’s augmented intelligence capabilities, without leaving the ecosystem.

The Datastack - Application API Layer

Application API Layer

This is the secure API gateway that provides access to the full Datastack directly through the customer’s existing systems and applications.

Customers can also extend the Application API Layer to provide direct access to other Datastack ecosystems developed across different departments. Thus, building a rich augmented intelligence as a service (AIaaS) platform.

The Datastack - Application UI/UX Layer

Application UI/UX Layer

This is a customer’s existing applications, enterprise software and internal systems through which Nebuli’s services can be accessed, with minimal to no change in UI.

Hence, customers do not need to worry about tedious integration work or programming and lengthy staff training. All they need is an API key and simple API parameters to activate Nebuli directly from within their UI.

Data Security with the Nebulized Data Layer.

Security and data privacy are the most critical elements of Nebuli’s entire ecosystem and, thus, are at the heart of the Datastack framework.

The Nebulised Data Layer® is our innovative data security layer that completely circumvents the need for customers to upload copies of their original data, as shown below:

The Datastack's Secure Nebulised Data Layer from Nebuli

With the Nebulised Data Layer, Nebuli creates its unique machine-language that offers superior data compression, flexibility, speed and security to customers’ “Nebulised” data. This layer eliminates any footprints leading back to the customer’s original data sources.

The Nebulisation process of customer data can be summarised in the following simple steps:

  • 1.

    Customer dataset pre-processing – creating data description maps to allow Nebuli “understand” the datasets.

  • 2.

    Data extraction – indexing the critical data parameters needed by Nebuli for a given task without storing the rest of the data.

  • 3.

    Data Decomposition – breaking down the indexed datasets into smaller tasks that can be parallelised within Nebuli’s operations.

  • 4.

    Further Extraction of “useful” data parameters – where Nebuli selects subsets of data indices to built its Data-Driven World (the key element of building memory blocks).

  • 5.

    Final normalisation of the extracted data – to reduce data redundancy and improve data integrity, while forming Nebuli’s internal representation of the customer’s data.

Thus, through the Datastack framework, Nebuli’s entire operation is independent of any data formats, platforms and languages.

For our customers, this offers an unmatched, more accessible, personalised and faster cross-disciplinary and cross-regional data integrations and interoperability.

Unlocking value from data versatility and scalability.

We built the Datastack framework with data versatility in mind.

That is, helping teams and enterprises of all sizes to focus on consolidating their data silos and opening up the possibilities to work with public and open data within the same framework. 

Thus, unlocking undiscovered trends and opening new business opportunities.

Above all, with the Nebulised Data Layer, customers can be assured that their data privacy and intellectual property is intact.

Nebuli Newsletter

Nebuli Newsletter

Stay in touch with our developments, latest news, research updates, podcasts, and receive exclusive invitations to our events.