DiscoverO'Reilly Data Show PodcastAcquiring and sharing high-quality data
Acquiring and sharing high-quality data

Acquiring and sharing high-quality data

Update: 2019-07-18
Share

Description

In this episode of the Data Show, I spoke with Roger Chen, co-founder and CEO of Computable Labs, a startup focused on building tools for the creation of data networks and data exchanges. Chen has also served as co-chair of O’Reilly’s Artificial Intelligence Conference since its inception in 2016. This conversation took place the day after Chen and his collaborators released an interesting new white paper, Fair value and decentralized governance of data. Current-generation AI and machine learning technologies rely on large amounts of data, and to the extent they can use their large user bases to create “data silos,” large companies in large countries (like the U.S. and China) enjoy a competitive advantage. With that said, we are awash in articles about the dangers posed by these data silos. Privacy and security, disinformation, bias, and a lack of transparency and control are just some of the issues that have plagued the perceived owners of “data monopolies.”


In recent years, researchers and practitioners have begun building tools focused on helping organizations acquire, build, and share high-quality data. Chen and his collaborators are doing some of the most interesting work in this space, and I recommend their new white paper and accompanying open source projects.


<figure><figcaption>Sequence of basic market transactions in the Computable Labs protocol. Source: Roger Chen, used with permission.</figcaption></figure>

We had a great conversation spanning many topics, including:



  • Why he chose to focus on data governance and data markets.

  • The unique and fundamental challenges in accurately pricing data.

  • The importance of data lineage and provenance, and the approach they took in their proposed protocol.

  • What cooperative governance is and why it’s necessary.

  • How their protocol discourages an unscrupulous user from just scraping all data available in a data market.


Related resources:


Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Acquiring and sharing high-quality data

Acquiring and sharing high-quality data

Mac Slocum