Abstract:
Domain probe lists—used to determine which URLs to probe for Web
censorship—play a critical role in Internet censorship measurement
studies. Indeed, the size and accuracy of the domain probe list limits the
set of censored pages that can be detected; inaccurate lists can lead to an
incomplete view of the censorship landscape or biased results. Previous
efforts to generate domain probe lists have been mostly manual or
crowdsourced. This approach is time-consuming, prone to errors, and does
not scale well to the ever-changing censorship landscape.