The fragmentation of search

This post was originally published on the USV blog and can be found here.

The market structure for Search is currently being reshaped. Horizontal and LLM-based “search agents” like ChatGPT and Perplexity are placing unprecedented pressure on search engines like Google. Cracks are beginning to form, from which new possibilities of search are rapidly germinating. 

USV expects this fragmentation to continue and for new opportunities in Search to rise up as a result. We’re particularly intrigued by opportunities that give agency to consumers and web publishers that have traditionally felt at odds with the conventional Google model, or who may already feel uneasy with the idea of search agents becoming the new gatekeepers of our information.

BC (‘before ChatGPT’), Google was synonymous with Search. Its concentrated market power meant it could make unilateral decisions that could adversely impact the consumers, web publishers, and advertisers that transacted on it.

We strove to find businesses with a robust counter positioning to Google. DuckDuckGo was one of them and was able to build a great business protecting consumer privacy online, now generating over 3 billion searches a month. However, Google held firm and its search engine remained the dominant leader.

Now LLM-based search agents are causing all new kinds of upheaval. By providing easy answers upfront to questions I once would have had to google and scroll through a click-bait article for, search agents have unlocked a shortcut for consumers seeking information that obfuscates the publisher entirely. This is inevitably peeling away queries from engines like Google and Bing, as well as displacing web publishers who lose traffic to ChatGPT despite providing the data on which it’s trained.

And it’s not just ChatGPT. It’s Perplexity, Arc Search, Pi and a multitude of others building on top of a variety of different LLMs that are all competing to be the trusted brand for horizontal search agents. In the past, a single tab sufficed for my internet searches, but now I routinely operate with three or more tabs open.

BC:

AC:

This splintering of search raises a number of key questions:  

1/ What business model will horizontal search agents come up with to stem the heavy losses piling in compute and inference cost? Particularly once the AI hype bubble subsides, and the billions of venture capital dollars propping up these platforms does too.

2/ Are consumers willing to pay for Search? And if not, how long till we see targeted ads creep up in those search agent responses?

3/ Will web publishers and content creators struggle to survive if search engines go away, and the SEO and advertising dollars along with them? Is this a “print newspaper” moment for digital publications?

4/ Will horizontal search agents eventually starve off their own information supply if they refuse to cut publishers into the economics?  

5/ Even if search agents do agree to AI royalties, why should publishers bother making new websites if no one’s ever going to actually see them? Will the introduction of financial incentives change the kind of content we’re used to seeing on the internet?

Search will have to confront these questions and will continue to splinter off into new behaviors and platforms as result. As with DuckDuckGo, we’re excited about platforms that can counter position themselves to Google and Microsoft by creating business models that neither can compete with without fundamentally cannibalizing their own businesses.

We can imagine platforms that reward publishers and content creators for generating the content that keeps the internet weird. This could be through financial rewards like subscriptions, though we think there’s an even bigger opportunity for crypto to invent new monetization models for AI-native content. Crypto tokens, buying NFTs, and low / no-cost minting will all function as acts of patronage. These rewards could also not be financial at all, instead creating a network of content creators that runs on social currencies like respect and community.

There’s going to be more consumer-centric models, too. We envision personal knowledge agents that enable consumers to curate their own unique data sets, which they can revisit, mine, and explore over time.

Different kinds of AI-native vertical search platforms will emerge that lean into the stochastic nature of LLMs and emphasize exploration as a feature. This will happen in domains like travel, music, books, fashion, second-hand goods and interior design. Today text-based chat serves as the main user interface for Search. But we anticipate an increasing shift towards diverse and integrated form factors like photo, audio, video, and even biometric data. In the same way that iNaturalist allowed us to query birdsong, new platforms will leverage advanced technologies to interpret richer forms of data to offer personalized and immersive search experiences.

All to say, it’s an interesting time to be in the Search business. LLMs are changing the game and opening doors to new ways of accessing and interacting with information. We’re excited by what we might find.

Loading...
highlight
Collect this post to permanently own it.
In transit logo
Subscribe to In transit and never miss a post.