Data Product Platform

Data Product Platform

Browse an org-wide catalog of data products and consume them with the tooling of your choice.

Browse an org-wide catalog of data products and consume them with the tooling of your choice.

UX/UI Design

Research

Design Systems

My Role

My Role

For this project, I led the design and research strategy. It was my responsibility to extract requirements from stakeholders, connect with users to understand their landscape and create hi-fidelity designs and prototype whilst collaborating with front-end development

Team Structure

Team Structure

1x UX Designer,

1x UX Designer,

UX Designer

3x Front-end Developers,

3x Front-end Developers,

Technical Lead

Technical Lead

Scrum Master

Research Methods

Research Methods

Interviewing,

Interviewing,

Workshopping,

Workshopping,

Usability Testing

Usability Testing

Platform

Platform

Platform

Web

Web

Web

Project Duration

Project Duration

Project Duration

12 months

12 months

12 months

Tech Stack

Tech Stack

Tech Stack

Overview

001

Overview

001

Overview

001

The existing landscape made data discovery a cumbersome process. The lack of a central catalog hindered users' ability to find and utilise relevant data. This created inefficiencies, security issues, and obstacles to data-driven decision-making.


Data Product creation was done without a UI, relying on highly technical skilled users to create data products using API's, this became a barrier for creation, reducing the amount of users who could contribute.


To address these challenges, we planned to create a data platform that would streamline data discovery, simplify creation, enhance security and empower users to leverage data effectively.

Objectives

01

Enhance Security and Access Control:

  • Implement robust security measures to protect sensitive data.

  • Provide granular control over data access, allowing producers to define specific permissions for different user groups.

02

Simplify Data Product Creation and Management:

  • Streamline the process of creating and maintaining data products, reducing the burden on producers.

  • Provide intuitive process for creating data products.

03

Improve Discoverability of products

  • Create a cataloging system with enhanced filtering to make finding data products easy

  • Ensure the platform is user-friendly for a wide range of users.

Outcomes

350%

Increased data product usage by 350% after the platform launch. Helping the organisation become more data-driven

80%

80% Reduction in Data Product creation time from 15 minutes to an average of 3 minutes.

The Challenge

002

The Challenge

002

The Challenge

002

01

Available data is scattered across the organisation, difficult to discover what's available and who can use it

02

The process of creating a data product is long and highly technical, limiting the amount of users who can create

03

Lack of access control processes in place for existing data, relying on due diligence of data owners

How might we create a platform to improve discoverability, streamlined data creation collaboration with enhanced access control?

How might we create a platform to improve discoverability, streamlined data creation collaboration with enhanced access control?

Research

003

Research

003

Research

003

We interviewed a variety of data producers and consumers to understand the current data product creation process and process for discovering and consuming data across the organisation. This helped us identify various painpoints and opportunities to help shape the solution

Conducted user interviews with 8 producers and consumers to understand the creation, discovery and consumption process



Conducted weekly workshops with SME's, and users within the data practice to review progress and encourage collaboration with the project



Access to users was very difficult for this project, limiting our potential to gain insights on this unique piece of software. As a team, we needed to be extremely adaptable a flexible to manage very fluid requirements throughout due to the extreme technical back-end nature of the project.


The research we could conduct enabled us to get some understanding of the key processes, identify the pain points: the average creation time took over 15 minutes and was done solely through code using API's without a UI, Discovery was done virtually through word of mouth, access to products was long and arduous to gain permissions.


With these insights, we designed a retail-inspired platform with a comprehensive filterable catalog, an intuitive multi-step data product creation flow and role-based permissions system to control access.

Key Features

004

Key Features

004

Key Features

004

01 Data Product Catalog and Filter System

We designed a retail-inspired catalog for discovering available data products, a central location for all data products in the organisation. Users could search and filter to refine their search results.

Having a visual, familiar experience for finding products in one location made it much easier for users to consume data.

02 Data Creation Wizard

The average time for creating a data product was around 15 minutes or more, and required highly skilled coding ability in order to create it. We wanted to significantly reduce the time taken but also make the process more accessible, attracting more producers to the platform.

We designed a multi-step wizard within the platform to streamline the creation process. Dividing the required fields into logical sections, with the ability to save as a draft and come back at a later stage.

02 Data Creation Wizard

The average time for creating a data product was around 15 minutes or more, and required highly skilled coding ability in order to create it. We wanted to significantly reduce the time taken but also make the process more accessible, attracting more producers to the platform.

We designed a multi-step wizard within the platform to streamline the creation process. Dividing the required fields into logical sections, with the ability to save as a draft and come back at a later stage.

03 Customisable Check-Out

The complexities of data products required a highly customisable experience, what platforms to consume with?, which version of the data?, which output port type do you want to consume from?

Continuing with the retail-inspired experience, we designed a customisable Basket / checkout experience that empowered users to get exactly what they needed from a data product.

04 Role Based Access Control

Controlling permissions and access to data was a high priority feature, we need to ensure data was secure and on a "need to access" basis. We leveraged the existing "AD group" structure the organisation employed to create a "Role-based" access control system.

Essentially, a producer can decide who can access the product using custom policies, which contain specified project groups. The system will automatically detect whether a consumer is a member of these groups or not, determining access and enhancing security.

04 Role Based Access Control

Controlling permissions and access to data was a high priority feature, we need to ensure data was secure and on a "need to access" basis. We leveraged the existing "AD group" structure the organisation employed to create a "Role-based" access control system.

Essentially, a producer can decide who can access the product using custom policies, which contain specified project groups. The system will automatically detect whether a consumer is a member of these groups or not, determining access and enhancing security.