Rethinking Search for the Age of Human-Centered AI - Posts

AGENTIC AI

Rethinking Search for the Age of Human-Centered AI

In a digital world overflowing with information, the key struggle is not about accessing knowledge but connecting with it meaningfully. Whether you’re a student researching a topic, a parent looking for help, or a professional searching for insight, the search bar has become the first step in almost every journey. But how often does it truly serve us the way we imagined?

As someone connects AI and user experience, I’ve often asked this: Why does so much technology still make us feel like we need to think like machines? Why aren’t we building systems that learn to think more like us, humans?

That’s the question that led us to reimagine search from the ground up. At XTOPIA, we’ve developed a new way of search content with AI. The idea is that we don’t want to just retrieve information but to also respond with empathy, context, and intelligence. It sounded like a moonshot when we first embarked in this journey. A search system that listens, learns, and guides?

Here’s how we made that vision real.

Quick snapshot of the idea of a new Smart Search envisioned

Rebuilding the Search Experience with Meaningful Discovery

For a very long time, search engines have been driven by rigid rules (our legacy solution is not exempted from this). We use keyword matching, boolean logic and static filters.

But people don’t naturally speak in keywords. We ask questions. We describe problems. We use metaphors, emotions, and half-formed thoughts. The traditional model doesn’t accommodate this very human and seemingly organic way of looking for information. Afterall, we are ‘asking a machine’ right?

So, we introduced automated content tagging as the first building block of Smart Search. Our system uses natural language processing to deeply analyze every piece of content in a website, automatically labeling it with relevant themes, topics, and contextual keywords. This isn’t about surface-level matching; it’s about mapping out the semantic meaning behind the words so that the system understands the content like a thoughtful human would.

How this can be useful? From the perspective of the end user, this means the search bar becomes exponentially more helpful. Instead of needing to know the right jargon, people can search in their own words — and still arrive at the right content. For example, someone looking for “how to lower my carbon footprint while traveling” doesn’t just find articles with those exact word but they’re guided to content tagged under sustainability, eco-tourism, travel tips, and more.

But the impact goes deeper. For content owners, automated tagging provides a new level of visibility into the website’s knowledge architecture. You can see which themes are dominant, which are missing, and where the gaps are between what you have and what your audience might be looking for. It’s like giving your content team a compass that always points toward relevance. What a relief!

Netflix search matching with input and relevance

Serving Answers in Phases, With Grace

One of the most frustrating things users experience online is any form of waiting. But wait, meaningful search requires deeper processing. So how do we resolve the tension between speed and insight?

Our approach lies in how we structured Smart Search using Server-Sent Events (SSE) to deliver responses in phases. This is a design that mirrors human conversations.

Real-time recommendation based on search term relevance

When a user enters a query, the system first performs a vector-based search, a fast semantic match that retrieves content most closely aligned with the meaning of the question. These results are presented immediately, giving the user instant feedback and reducing cognitive friction.

No empty pause; no feeling of being in limbo.

While the user is browsing these initial results, a second phase kicks in quietly: a Large Language Model (LLM) begins processing the same query to generate a more detailed, natural-language answer that is curated from the content it has indexed and understood. Within a few seconds, a contextual, often conversational summary appears — like having a knowledgeable guide distil what is contextually important for you.

This two-step approach mirrors how we process information in real life: we scan and then we reflect deeply. By architecting the system this way, we designed not just for functionality, but for grace. Users feel attended to, not delayed.

AI-Generated Answer UI by XTOPIA

Don’t Stop at Clicks but Identifying Patterns

We often associate analytics with just numbers such as how many visits, how long users stay, what they click. But what if we could understand the emotional intent behind those actions?

To move towards that goal, we embedded a layer of intelligence in Smart Search that learns from patterns in user behavior over time. By applying clustering and classification techniques, the system begins to recognize recurring search themes, categorize similar queries, and even predict what users are likely to type next based on community-wide behavior.

What this creates is a subtle yet powerful loop of personalization. When someone begins a search, the system can autocomplete their thoughts or suggest adjacent topics. That way, we are gently guiding them, just as a helpful colleague might do during a brainstorming session.

But the benefits also extend to the people managing the platform. Administrators can view search trends to understand what truly resonates with users, what’s being searched but not found, and what opportunities exist to fill those gaps. Imagine discovering that a large number of users are searching for “remote internship programs” even though your site doesn’t have that exact content. That’s not just a missed click; that’s a signal, an unmet need.

In this way, Smart Search becomes a quiet researcher that is actively gathering and surfacing insights that help teams create more intentional content strategies.

High-level Smart Search Solution Architecture

The Bigger Picture

What we’re building here isn’t just a better tool but a better relationship between people and technology.

Take education platforms for example, we imagine Smart Search empower students to ask complex questions and receive clear, layered explanations without having to navigate through dozens of links and references.

On corporate websites, Smart Search can help employees navigate a large depository of documentation and forms in seconds instead of hours. When AI is used right, it builds trust. People feel seen, understood, and respected. That, to me, is the heart of good design and good AI systems that put human at the center, not efficiency and processes.

Of course, none of this came easy. We encountered plenty of friction along the way — especially around messy content data, long LLM processing times, and the evolving nature of user expectations.

These give us the opportunity to ask: How can we make this simpler, clearer and more helpful?

We fine-tuned our tagging engine to ignore irrelevant noise and focus on what matters. We continue to optimize our solution architecture to allow phased delivery without compromising user experience. And we build feedback loops into the system, so it gets smarter with every search.

Each of these decisions was driven by empathy. We weren’t just solving for efficiency but solving for experience.

Final Thoughts

The road is a long one. Our platform development roadmap is full of exciting possibilities: voice search, image-based search, conversational follow-ups, federated knowledge systems across platforms.

But as much as we’re innovating, our focus remains simple: Make search feel more like conversation, and less like decoding a machine. Because in the end, technology should not make people feel smaller but to their ability to find, learn, and connect.

Output of both vector search and LLM processing for a website search query

Now, where do we go from here?

Josephine Toh is a dynamic force at the intersection of digital strategy, product innovation, and artificial intelligence in Malaysia. Currently leading initiatives at XIMNET, a digital consultancy known for its forward-thinking approach, she has been instrumental in developing AI-powered solutions such as XTOPIA, a SaaS platform.

At XTOPIA, user-centric business solutions like Smart Search, AI Forms, and intelligent content engines to serve organizations across Asia.

Her commitment to responsible innovation is grounded in the belief that technology should be “real, good, and human.” Whether she’s facilitating workshops to help teams reinvent their workflows using AI, speaking to boards about AI readiness, or shaping the future of AI-driven platforms in Malaysia, Jo is poised to be a catalyst in Malaysia’s growing AI ecosystem. #WomenInAI

Share this page

This article is brought to you by XIMNET — the leading Agentic AI solutions provider and creator of AI platforms like XTOPIA.IO.

IDEAS FOR AI AGENT SYSTEMS

Ideas that ignite