Bounty Review Process Overview
Bounties form a big part of MetricsDAO’s mission to deliver high-quality analytics solutions. As our partners rely on accurate, timely, and informative analytics, it is important that MetricsDAO evaluates bounty submissions according to a specific set of criteria. These are Accuracy & Completeness, Insights, Visualizations, and Definitions. Submissions that get decent scores in these criteria are qualified to receive bounty payouts. Those that get a perfect score are then entitled to the gran...

Goldfinch Deep Dive
SummaryGoldfinch is a decentralized credit platform that enables loans without requiring on-chain collateral. This novel approach increases access to capital and expands the crypto lending market to users that otherwise would not have sufficient on-chain assets to qualify for a loan. Goldfinch’s “trust through consensus” mechanism allows lenders to directly evaluate the creditworthiness of potential borrowers, supporting but removing the need for on-chain collateral. Ultimately, this creates ...

Introducing: MetricsDAO
Uniting the best analytical minds in the space to build the future of crypto analytics. Join MetricsDAO on DiscordThe DAO MissionThe purpose of MetricsDAO is to empower analytical minds and enable blockchains and protocols to succeed. It's critical for blockchains and all ecosystem participants to have the data, insights, visualizations and metrics that enable an active, educated and informed community. MetricsDAO will provide the framework for insights to be delivered on-demand and as-n...
<100 subscribers
Bounty Review Process Overview
Bounties form a big part of MetricsDAO’s mission to deliver high-quality analytics solutions. As our partners rely on accurate, timely, and informative analytics, it is important that MetricsDAO evaluates bounty submissions according to a specific set of criteria. These are Accuracy & Completeness, Insights, Visualizations, and Definitions. Submissions that get decent scores in these criteria are qualified to receive bounty payouts. Those that get a perfect score are then entitled to the gran...

Goldfinch Deep Dive
SummaryGoldfinch is a decentralized credit platform that enables loans without requiring on-chain collateral. This novel approach increases access to capital and expands the crypto lending market to users that otherwise would not have sufficient on-chain assets to qualify for a loan. Goldfinch’s “trust through consensus” mechanism allows lenders to directly evaluate the creditworthiness of potential borrowers, supporting but removing the need for on-chain collateral. Ultimately, this creates ...

Introducing: MetricsDAO
Uniting the best analytical minds in the space to build the future of crypto analytics. Join MetricsDAO on DiscordThe DAO MissionThe purpose of MetricsDAO is to empower analytical minds and enable blockchains and protocols to succeed. It's critical for blockchains and all ecosystem participants to have the data, insights, visualizations and metrics that enable an active, educated and informed community. MetricsDAO will provide the framework for insights to be delivered on-demand and as-n...
Share Dialog
Share Dialog
MetricsDAO provides a 6 step process for Organized, On-Demand Analytics Delivery, or as we like to call it, OODAD.
After curating the blockchain data, sourcing questions, and turning them into Challenges for Analysts, the fourth step is enabling the community to provide results, visualizations, insights etc. to address these specific Challenges. We refer to this as generating “Solutions”.
This is where our second experiment comes in.
After the community documented and prioritized needs for OlympusDAO via a question bank, analysts were offered bounties for providing Solutions.
Setting up these bounties in a way that would successfully enable and incentivize analysts to solve these Challenges raised important questions:
Due Date
-→ How long should Analysts have to complete a specific challenge?
-→ Who determines how long a challenge should take to complete?
Payout
-→ How do we determine the right payout per challenge?
-→ Should the payout amount be stated ahead of time, or after completion once the quality of the submission has been determined?
Driving Engagement
-→ How do we get more Analysts to generate solutions for these challenges?
Transparency
-→ Do we publicly display solutions before they’ve been reviewed?
Here’s how we chose to answer these questions in the first experiment:
Due Date
The bounties were initially due on December 13th 2021, which gave Analysts 7 days to complete the Challenges.
A week seemed reasonable based on the difficulty of the questions asked, but we did not ask Analysts for input here.
Payout
The payout was set at $250 for the top 3 Solutions. The next 22 Solutions would all receive $100. These were to be paid out in OHM.
The payout amount was announced ahead of time but did not vary based on question difficulty.
Driving Engagement
We promoted these bounties on Twitter and Discord but sought no cross-promotion from OlympusDAO.
Transparency
We decided to not share submissions before reviewing them.
Due Date
The turnaround was too short and Analysts asked for more time. We extended the due date by 48 hours and received 4 more submissions, for a total of 11 submissions.
Payout
Dollar amount was deemed too low, especially considering the high transaction fees on the Ethereum network.
The flat payout (especially of $100) was deemed too low for how hard the questions were.
We also found out that Analysts couldn’t easily tell which questions were hard vs. easy before starting to work on them, and they understandably did not want to answer questions without knowing ahead of time how hard they would be.
Driving Engagement
We received 11 submissions for 10 challenges. Three Challenges were not answered.
Transparency
Community members wanted to know when they would be able to see the submitted Solutions.
Due Date
Difficulty should be determined ahead of time, so that due dates are properly aligned.
Payout
Payment needs to be tailored to question difficulty, and Analysts need to know how hard a Challenge is before starting.
Payment date should be announced ahead of time.
We will experiment with adding a step in the process where the community determines how much each Challenge is worth, based on difficulty.
Driving Engagement
We should work with the crypto project itself to help us cross-promote new bounties to their community.
Transparency
We should announce ahead of time:
-→ when POAPs will go out
-→ when Analysts should expect to get paid and
-→ when submissions will be made public.
Any questions or comments let us know in Discord! We’re always looking for new ideas and feedback.
MetricsDAO is uniting the best analytical minds in the space to build the future of crypto analytics.
MetricsDAO provides a 6 step process for Organized, On-Demand Analytics Delivery, or as we like to call it, OODAD.
After curating the blockchain data, sourcing questions, and turning them into Challenges for Analysts, the fourth step is enabling the community to provide results, visualizations, insights etc. to address these specific Challenges. We refer to this as generating “Solutions”.
This is where our second experiment comes in.
After the community documented and prioritized needs for OlympusDAO via a question bank, analysts were offered bounties for providing Solutions.
Setting up these bounties in a way that would successfully enable and incentivize analysts to solve these Challenges raised important questions:
Due Date
-→ How long should Analysts have to complete a specific challenge?
-→ Who determines how long a challenge should take to complete?
Payout
-→ How do we determine the right payout per challenge?
-→ Should the payout amount be stated ahead of time, or after completion once the quality of the submission has been determined?
Driving Engagement
-→ How do we get more Analysts to generate solutions for these challenges?
Transparency
-→ Do we publicly display solutions before they’ve been reviewed?
Here’s how we chose to answer these questions in the first experiment:
Due Date
The bounties were initially due on December 13th 2021, which gave Analysts 7 days to complete the Challenges.
A week seemed reasonable based on the difficulty of the questions asked, but we did not ask Analysts for input here.
Payout
The payout was set at $250 for the top 3 Solutions. The next 22 Solutions would all receive $100. These were to be paid out in OHM.
The payout amount was announced ahead of time but did not vary based on question difficulty.
Driving Engagement
We promoted these bounties on Twitter and Discord but sought no cross-promotion from OlympusDAO.
Transparency
We decided to not share submissions before reviewing them.
Due Date
The turnaround was too short and Analysts asked for more time. We extended the due date by 48 hours and received 4 more submissions, for a total of 11 submissions.
Payout
Dollar amount was deemed too low, especially considering the high transaction fees on the Ethereum network.
The flat payout (especially of $100) was deemed too low for how hard the questions were.
We also found out that Analysts couldn’t easily tell which questions were hard vs. easy before starting to work on them, and they understandably did not want to answer questions without knowing ahead of time how hard they would be.
Driving Engagement
We received 11 submissions for 10 challenges. Three Challenges were not answered.
Transparency
Community members wanted to know when they would be able to see the submitted Solutions.
Due Date
Difficulty should be determined ahead of time, so that due dates are properly aligned.
Payout
Payment needs to be tailored to question difficulty, and Analysts need to know how hard a Challenge is before starting.
Payment date should be announced ahead of time.
We will experiment with adding a step in the process where the community determines how much each Challenge is worth, based on difficulty.
Driving Engagement
We should work with the crypto project itself to help us cross-promote new bounties to their community.
Transparency
We should announce ahead of time:
-→ when POAPs will go out
-→ when Analysts should expect to get paid and
-→ when submissions will be made public.
Any questions or comments let us know in Discord! We’re always looking for new ideas and feedback.
MetricsDAO is uniting the best analytical minds in the space to build the future of crypto analytics.
No comments yet