Ukama (Y Combinator) network management system
ROLE
Senior Product Designer
TEAM
Kashif Ali, Salman Naseem, Brackley Casinga
TIMELINE
2022 - Present
Over 2.5 billion people worldwide still lack internet access, which is a significant missed opportunity to boost financial outcomes for people globally. In least developed countries, even a 10% increase in school connectivity leads to an increases of up to 0.6% of children's effective years of schooling, and up to 1.1% GDP per capita, according to the World Economic Forum. Ukama aims to help bridge this digital divide by enabling anyone to  own their own network.

I led the corresponding digital efforts to create a network management system that was intuitive, pragmatic, yet elegant -- so that anyone could navigate it to successfully troubleshoot their network, reducing infrastructure downtime that would reduce customer retention, as well as halt critical business operations.
THE PROBLEM
Traditional network management systems are clunky and overwhelming, which makes it hard for non-technical operators to pinpoint and fix critical infrastructure issues. This is important to maintain high customer satisfaction scores, which leads to high retention rates for the business.

Defining goals: 

  • Enable network owners with little technical/network management training to properly troubleshoot issues; reduce time-to-resolution for critical network issues
  • Increase customer satisfaction score (CSAT) of 80% for end users (paid subscribers), so that monthly customer churn rate can be kept less than 7%
  • Increase sales by maintaining high net promoter score (NPS) >8, by creating an intuitive, elegant solution that both works, and also feels good to use
THE SOLUTION
A modern network management solution built on clearly defined, modular blocks that fit in with users' existing mental models, guided product education, and flexible integrations.

Delays in manufacturing caused by supply chain disruptions, and pauses in USAID and USTDA funding means that this project hasn't been fully rolled out yet. However, internal testing shows strong results, and I plan to more thoroughly test for the aforementioned metrics when we do fully launch.

Impact: 

  • Reduced task completion time by 15% for core network management flows, including troubleshooting site/node specific issues
  • Increased CSAT scores by 16% from initial measurement to 86%
  • Spearheaded two financial payment integrations (mobile money + data sharing) that are key to unlocking two new international markets (DRC + FSM)
Site settings configuration
Homepage onboarding checklist
Settings
Manage organization
Specific site page showing battery status
STRATEGY – SYSTEMS THINKING
To define scope, I workshopped with leadership to sort our customers into clear tiers: "Consumer", "Enterprise", and "Internet for All".

This extremely broad scope presented a key business challenge: maintaining satisfaction among current partners, while also positioning for future growth.

While the network management system (NMS) is the most visible face of the software solution, it’s only one piece of the puzzle. Therefore, I stepped back early in the process to research both specific NMS requirements, as well as the wider company ecosystem. I noticed our initial solution tiers didn't provide enough clarity and distinct value. So, I workshopped with leadership to look at our CRM pipeline (which was all over the place, from the rocky mountains of Colorado, to the healthcare clinics in DRC), and create new product tiers that captured the essence of our three main markets. This helped define scope of the NMS more clearly, and reframe our focus to lock in product market fit as soon as possible.

UNDERSTANDING OUR MARKET
With our product-market fit still evolving, I knew we needed to ruthlessly prioritize. So, I conducted user research to identify the 20% of features that would deliver 80% of the impact.

Because our initial pool of customers was small, I conducted 10 user interviews with key stakeholders, and adjacent experts, to both understand the problem space, what they needed, and how they felt about existing solutions. Something particularly interesting that stood out to me was the current network management method one entrepreneur in the DRC had devised: pinging his network every five minutes to make sure it responded, and was still up.

This really helped clarify the core issue from the users' perspective. I was going a bit crazy looking at all of the different network KPIs that needed to be monitored, and had almost forgotten that at the end of the day, for users without quality connectivity solutions, making sure the network is still running is paramount.

Here are some of the summarized insights:

HONING IN ON OUR TARGET USER
Though we had partners across all three tiers, we decided to focus on the "Internet for All" tier for the dashboard. This group had the lowest technological literacy, so by creating a successful solution for them, we could ensure it would be accessible and functional for more advance users as well.

To design an effective solution, I needed to understand the underlying business model that was hypothesized to support self-sustaining networks, and where the NMS fits in. In an ideal world, our partners can set and forget their networks, and never have to look at the NMS, other than for subscriber management. Alas, the reality is that issues will inevitably arise. The NMS plays a critical role in enabling network owners to quickly detect and resolve problems before they impact service. If the network becomes unreliable, paying community members will eventually lose trust and not return.

ALIGNING LEADERSHIP + DEV TEAM
I wanted to create transparency around the design process, and also enable anyone to contribute. To keep documentation robust without being a nightmare to maintain, I eventually focused on clear user stories, PRDs, and specific feature docs.

Consolidated user stories for alignment on user needs.

Lightweight PRD to define  scope & clarify restraints.
Features doc for specific behaviors, edge cases, etc.
SOLUTIONS EXPLORATION
I began exploring potential solutions for the homepage. As the most visible face of the solution, it should give users clear visibility into the system state, and also lead users in the right direction if there are network problems.
TESTING INSIGHTS
After synthesizing testing insights, I saw strong parallels between what I instinctively designed, and what resonated most with users; interfaces that broke the network down into clearly defined layers that made complex concepts easy to grasp.

Anytime I spoke with any of my brilliant teammates, they would speak about network concepts, and all of its components, jumbled together as one large mass. While this worked great for them because they had years of experience in this space, it did not for me. To best build an interface that not only correctly directs users to solve issues, but also builds trust as they're doing so, we needed to build something that spoke the users' language. What better way to do so that with plain, spoken, words? 

I theorized that informing the user in the clearest possible way about the state of their network systems would be the fastest and least frustrating way to visibility, especially for users with lower technological literacy. Presenting the resulting network components in clearly sectioned building blocks, and leaving intuitive breadcrumbs that allow users to drill down into more detail if desired, will provide a simple, yet robust, network management system.

HYPOTHESIS
By directly aligning the interface with existing mental models through clear language status messages, modular network blocks, and progressive disclosure via intuitive breadcrumbs, we can reduce cognitive load, and empower even non-technical users to confidently and successfully troubleshoot network issues.
HYPOTHESIS TESTING
To test our hypothesis with limited resources, I conducted moderated task-based testing paired with think-alouds, to evaluate not only the success rate of various tasks, but also users' emotional states throughout. We found task resolution efficiency increased by 15% with our hypothesized NMS.

When facing tight resource constraints, my approach tried to balance both quality and quantity of insights. I combined structured task-based testing with think-aloud protocols, and tested 3 users per key flow in 3 rounds, based on Jakob Nielsen's research on percentage of insights that can be extracted from number of research participants. While he recommended 5 users across 3 rounds, I had to modify it due to timeline and budget constraints.

This dual methodology revealed not just what users struggled with, but also why, uncovering hidden assumptions, pain points, and motivations.

ADJUSTING TO DELAYS
Unfortunately, manufacturing delays set our timeline, and we ended up cutting our home node, which catered towards the consumer tier. I capitalized on this extra time to better understand our prospective partners, proactively setting up calls with people in our mailing list.

These calls gave me a lot of new insights into potential future roadmap items, but was wary of potential product bloat that could compromise the user experience, and developmental efficiency. Still, though the numbers said otherwise, I felt we weren't fully meeting users exactly where they were at.

After some group brainstorming, I realized we solve this without deadly product bloat. Building on our existing modular framework, we could introduce custom integrations that allow users to customize their NMS with optional add-ons, offering flexibility without compromising the core experience. The custom integrations tab isn't visible in any of the mockups because our team has been focused on delivering the core experience first.

GUIDING DESIGN PRINCIPLES
With some of the bigger details figured out, I landed on a few design principles to guide the rest of my designs.
SELECTED SOLUTIONS
Here are a few selected core flows.

Some of the core 20% of features that deliver 80% of the value (identified during an earlier research phase) are shown below. These features guide even non-technical users to successfully set up, manage, and troubleshoot their network, which is critical to business success; whether maintaining high NPS or ensuring smooth operations online.

Home: network overview

Providing a clear overview of the network "health" for easy monitoring; freeing users to focus on what matters most to them: growing their business. When issues arise, intuitive breadcrumbs lead users through various layers to the root cause, empowering swift, informed, decision-making.

Site overview

Sites represent the physical building blocks of the network; each composed of the node, controller, solar, battery, backhaul, and switch components. By translating this physical setup to a digital diagram, users gain a clear understanding of how everything connects, making it easy to pinpoint where to look when issues arise.

Node overview

Nodes are the hardware piece that connects a subscriber's phone to the broader network. While each node contains many complex components, this interface simplifies the experience by organizing the most common sources of issues into logical groups, also allowing users to easily explore graphical insights and track performance trends over time.

I wanted to keep the interface consistent with the rest of the system, but the node's data is more independently jigsawed together, and doesn't fit the same physical representation as the site's data. So I optimized the layout to scan key numbers quickly, with the option to dive deeper.

REFLECTIONS
I learned a lot from driving this project , and had a lot of fun on the way. Here are a few reflections:
  • Developer experiences are so important!! I tested a variety of different ways to best create alignment in the beginning of the project conceptualization, as well as later during handoff. I was chuffed to see Figma's dev mode and annotation features developed recently, which were essentially higher fidelity versions of what I had devised earlier
  • Leading one of our key client projects strengthened my product thinking, and broadened my toolset to influence product roadmaps. Establishing weekly stakeholder check-ins helped me also be less precious about my early designs; I learned to share work early, embrace feedback, and iterate quickly