Cover photo

Introducing the First AI Attestor

Bring the best parts of your IRL life into your onchain identity

seanwbren

seanwbren and Ensō Collective

With the proliferation of intelligent AI, the world is moving away from the old idea of “trust, but verify” to a new adage of “verify, then attest”.

The new problem becomes, how do you create accurate attestations at scale, and about what?

We are excited to announce and simultaneously release our first AI Attestor, that exists to enhance your onchain identity with valuable attestations about your offchain IRL life.

March 22 Update: We're thrilled to be joining the EAS Fellowship program, with demo day in 6 weeks.

The @proofof bot lives on social networks, where it serves as your personal AI Attestor. Farcaster is live, and our Lens and Twitter bots will be online soon. Simply tag it in any image post you make, and based on the content of what you are photographing or screenshotting, it gives you an onchain and permanent EAS attestation. We call this attested data a Proof and it serves a threefold purpose.

  1. Notarize the moment onchain for you — which may be valuable later for a number of reasons.

  2. Mark your action for any brands involved — which may be valuable immediately for quests and points, from that brand or competitors.

  3. Create a data point for your onchain engagement, that you can then consolidate through our proofof.bot dashboard and easily provide as Proof to others. For most coming from web2 social, this helps in proving your passion for brands, your social engagement, and proving your "Proof of Humanity" in the coming sea of online AIs.

Each image below comes from web3 social during SheFi Summit / EthDenver. They have an onchain Proof attestation attached to it, using EAS on Base.

post image

Why Now?

At ensō collective, for the past year we have been championing the ability to bring your physical identity into the onchain and virtual worlds.

There is a now combination of trends that lead to the perfect timing for an AI Attestor to be built, with the necessary blockchain foundation for decentralization and provable fairness. The four major trends are:

  • AI Image Analysis: One year ago GPT4-Vision did not exist, and now just 6 weeks ago a comparable open-source model called LLaVa 1.6 was released (demo link). The idea of an AI Attestor requires effective LLM image analysis in order to validate user data at scale (surprisingly you can't trust anons, or even your fellow dao members!).

    There is a way to move off OpenAI to decentralized compute + inference (Akash and Ritual respectively), and we are in the midst of doing so. More on the product roadmap below.

  • Wallet-connected web3 social: First Lens released Open Actions (and now growing with Permissionless Signups), and Farcaster had huge growth in February and continuing. The simple fact that every user has a connected wallet, is critical in allowing us to deliver our Attestations to them. Also, the wallet has information about the user that the AI can use to make the correct decision.

  • Proliferation of Embedded/Smart Wallets: It's never been easier for someone to onboard to a new site, where there is a wallet on a blockchain is powering their account. This helps us onboard the much greater number of people who post on web2 socials about their passions and brands they love. They receive an immediate benefit of points/rewards for interacting with the @proofof bot, and then gain more points by sharing back onto web2 social (we see you everywhere Drakula).
    Another overlooked benefit that we anticipate becoming more needed, is the fact that having a wallet with onchain identity data will be a passport to the "human side" of the internet in the coming years, and people will need to build out an onchain identity resume. This is already happening with Gitcoin Passport and Coinbase's Onchain Verify.

  • Attestations as the unit of onchain identity: We are launching using EAS onchain on Base L2 for our Proofs, and will soon expand to offer additional destinations for the Proof data. This will include Witness, Intuition, Lukso Universal Profiles, and more (which are helpfully compiled in Disco's Onchain Phone Book).

Product Roadmap

Our tech stack is outlined in this thread. There are 4 clear areas to improve the capabilities of the AI Attestor.

Efficacy of the AI

When we ask the AI to validate a user's request and reward an attestation, the efficacy is the amount of correct results compared to false positives and false negatives.

We are using the state-of-the-art AI models, with multimodal vision and tool usage. Sometimes we will get a huge jump in effectiveness from the built-in model upgrade, such as GPT3 to GPT4 or soon GPT4 to GPT5 (Sam Altman quote from last week).

Beyond the upgrades of the foundational model, we can improve this by

a) fine-tuning the model by adding new labeled images to its knowledge base, such as the logo for Base, the purple $degen hat, or the leafy Lens mascot. Here are two technical code examples from LlamaIndex for images and video.

b) system prompts that steer the AI into the correct response, by giving it the context to make sense of unfamiliar screenshots or IRL photos.

Decentralization of the AI Stack

We are building on Ritual to deploy a container for the open-source LLaVa 1.6 model, which will remove our reliance on OpenAI. Ritual has a partnership with Eigenlayer that provides significant guarantees about the auditability and tokenized incentives of a decentralized AI Attestor.

The actual compute and servers are deployed on Akash Network, which is primarily used to move off of centralized cloud servers and onto decentralized ones (and cheaper at that!).

The most important point:

  • AI that affects people’s lives and livelihoods requires strict guarantees around fairness, security, and group ownership that centralized AI can not provide.

We are proud to be working with the best companies at the forefront of the space, and there are many more we would like to partner with (large list of them).

Integrations for data input and output

For the AI attestor to make the correct decision, we need to provide it as many relevant points of evidence it needs. If the AI sees it is missing data to make a decision, it needs the tools to go out and find that evidence. This is part of the growing field of Agent Tools, where you give the AI the logical reasoning and the ability to call other APIs and pull from data sources.

As an example, the original @proofof bot was only getting images and their description from web3 social media, with no other context. When that context is not enough to make a statistically probable judgement call on emitting an attestation, the AI can look up information about the wallet of the user. This includes tokens and recent transactions, or it could call the POAP API to see whether they have a POAP for the event they claim to be at.

Not surprsingly, the most valuable data points could be previous attestations themselves. The AI will have Tools to read data from any attestation protocol, such as EAS, Witness or Intuition. Because of that, we will “complete the loop” and also allow the @proofof bot to write attestations to every attestation protocol.

Dashboard UX

All of this will result in a lot of attestations over many different subjects and companies. Users need to see a clear and fun points system for the attestations they are accruing, and companies need a dashboard to configure rewards and recognize their most passionate fans.

While we created a dashboard for the quests, user profiles, and attestation gallery for the pilot launch at SheFi Summit, we have a lot to do.

Privy allowed us to quickly build the login flow and social linkages, and we will continue to use the easy creation of embedded wallets to power a new, viral loop of:

see a web2 social link→ create Privy wallet + Proof attestation → share back to web2 social for points

Upcoming

Events

Online Quests

  • Points for sharing the best memecoin memes: $degen, $enjoy, and more

  • Points for sharing Testflight onboarding screenshots

  • JokeRace contest judge

Upcoming IRL Quests

  • Sharing your favorite Lens ecosystem swag on Phaver and Orb

  • Sharing photos of completing an in-person scavenger hunt

  • Posting photos of stickers of a new DeFi site, placed globally during launch week

Get Involved

We have the capability to support more launch campaigns and quests, please schedule a demo with the founders.

For technical integrations regarding the decentralized AI or attestation data, our CTO would love to talk with you.

Follow us on Lens, Farcaster, and Twitter for updates!

Sources:

https://dune.com/vicnaum/lens-protocol-user-growth

https://dune.com/pixelhack/farcaster

https://dune.com/tomfutago/eas

https://llava.hliu.cc/ (LLaVa 1.6 demo)

https://github.com/ritual-net/infernet-container-starter

https://console.akash.network/

https://base.easscan.org/schemas (SheFi Summit pilot used 166, 174, 175)

https://docs.lukso.tech/standards/introduction/

Arweave TX

LxKymTgOIgGrHtLf8nLPMvWCzAonDfPOwiqH6NeouGc

Erin
Erin
Commented 1 year ago

So many incredible updates - bravo Ensō!

Sean BrennanFarcaster
Sean Brennan
Commented 1 year ago

https://proofof.onrender.com/ "Deploy on Degen" week: Created a Frame version of the /proofof AI Attestor First, you need to reply to the Frame with an image of a brand + the image description, then use the Frame. It uses GPT4-Vision to validate, and we issue you an /eas Proof and a $degen rebate on the Degen Chain

Sean BrennanFarcaster
Sean Brennan
Commented 1 year ago

The final screen of the Frame looks like this. For this version of the Frame & our AI validation logic, please use an image with a specific *brand name* visible, and use your reply comment to accurately describe the image's brand and item.

Sean BrennanFarcaster
Sean Brennan
Commented 1 year ago

my Picture Snowboarding jacket

Sean BrennanFarcaster
Sean Brennan
Commented 1 year ago

my Paralelni Polis jacket

Joe / 0xOsprey.ethFarcaster
Joe / 0xOsprey.eth
Commented 1 year ago

Witness Logo

Sean BrennanFarcaster
Sean Brennan
Commented 1 year ago

working on the AI system prompt for non-text examples such as yours. Right now it has a heavy reliance on looking at text in the image to corroborate the brand in the cast, but scaling the steering down

wakeFarcaster
wake
Commented 1 year ago

Brand, as in commercially available products?

Sean BrennanFarcaster
Sean Brennan
Commented 1 year ago

Mostly. It has a system prompt to help it recognize new crypto brands. My example reply with a Paralelni Polis jacket works, for reference. I'm working to help it recognize logos such as the degen tophat or enjoy zorb.

wakeFarcaster
wake
Commented 1 year ago

Interesting. What is this used for?

ManuAlzuru🥑Farcaster
ManuAlzuru🥑
Commented 1 year ago

Any more use cases that come to mind?

Sean BrennanFarcaster
Sean Brennan
Commented 1 year ago

Currently many attestations are binary yes/no based on web2 data or onchain activity (@gitcoin Passport is very useful). For irl/offchain attestations, they would previously need a human authority to "stamp" it, because the evidence (photo, screenshot, text) is fuzzy and needs analysis. Now AI can do that at scale.

ManuAlzuru🥑Farcaster
ManuAlzuru🥑
Commented 1 year ago

How could Blockravers use this?

yashwant🎩Farcaster
yashwant🎩
Commented 1 year ago

irl to attestation?

Sean BrennanFarcaster
Sean Brennan
Commented 1 year ago

yes, I wrote about what I'm building here: https://paragraph.xyz/@ensocollective.eth/ai-attestor-launch

yashwant🎩Farcaster
yashwant🎩
Commented 1 year ago

Awesome, will check it out. Btw just saw your cast on cabal, bought a few. Thanks

binji 🔴Farcaster
binji 🔴
Commented 1 year ago
Michael SilberlingFarcaster
Michael Silberling
Commented 1 year ago

Ooh I think someone showed this to me at ethdenver and I coukdnt remember the name

Sean BrennanFarcaster
Sean Brennan
Commented 1 year ago

Wrote about our launch of the AI Attestor @proofof. Mainly the trends and recent tech that make it possible, and our product roadmap. DCs open for first customers and data integration partners https://paragraph.xyz/@ensocollective.eth/ai-attestor-launch

proofof Farcaster
proofof
Commented 1 year ago

We didn't find a clear brand or quest described in your cast @seanwbren. Please retry your cast with more specific description of the brand or quest hashtag.

Introducing the First AI Attestor