Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This workspace will be used by the ALAC New gTLD Metrics Task Force for its report. 

 

...

Second Draft

Background

On February 28 2013, the At-Large Advisory Committee approved a statement in response to the GNSO report on metrics designed to evaluate the performance of ICANN's gTLD expansion program. The statement, which was sent as correspondence by ALAC Chair Olivier Crepin-Leblond to the Chair of the ICANN Board and the Chair of the Board gTLD Working Group, indicated that the GNSO report did not adequately address metrics that would accurately measure end-user benefits and trust resulting from the expansion. In the statement, the ALAC committed to produce recommendations for additional metrics which we believe it believes are required to supplement the GNSO recommendations. The ALAC created a Task Force to create the new metrics, which are listed below.

...

The ALAC found the scope of metrics used by the GNSO to be too limiting to be effective in measuring end-user benefit and confidence. We believe that to To be effective, the metrics must evaluate the gTLD program not only between the different registries, but between the use of domain names and alternate methods to access Internet information. We are concerned about the effect of the expansion program not only on the new gTLDs, but on public confidence in and of the the whole domain name system. It is possibile possible that a reduction in confidence in new gTLDs could spill over to legacy registries which we believe metrics need to track.

The metrics proposed are intended to measure the gTLD expansion program from the point of view of Internet end-users, the ALAC's constituency community as defined in ICANN bylaws. We assume that the needs of domain buyers and sellers are sufficiently addressed by the GNSO in its metrics. The metrics below supplement, not replace, the GNSO recommendations.

...

In the interest of minimizing complexity and simplifying use, we will maintain the structure used by the GNSO metrics report. The section numbering starts at 4 to avoid confusion with the GNSO metrics.

 

#

Measure

of

related to End-User Trust

Source

Anticipated Difficulties in
Obtaining and/or Reporting

3-year target

     
End-User Confusion
14.1Success Frequency of success in reaching the intended information supplier using through direct entry of domain namesSurvey of end-users; SEO research

Note 1 

Neutral or increase
14.2Accidental Frequency of landing at unintended destinationsSurvey of end users, SEO analyticsNote 1
Selective sampling of analytics may help determine the success of typo-squatting or other unintended destinations
Neutral or decrease
14.3Volume Frequency of redundant or defensive domains (ie, multiple domains pointing to the sam same destination)Survey of registrantsNote 2Neutral or decrease
14.4DeadFrequency of dead-end domains (registered but do not resolve)Registry data + automated samplingNote 3Proportion relative to total domains should decrease
14.5Numbers of complaints received by ICANN regarding improper use of domainsICANNSupplements GNSO metric 1.9 by assessing volume of end-user complaints (which may not come from name owners or result in URS/UDRP action) 
     
Growth in use of both domain-based and non-domain-based alternatives for Internet resource access
25.1Relative preference of explicit use of domain names versus search engines for end-user general Internet useSurvey of end users; SEO analyticsNote 1Note 4
25.2Growth in use of corporate hosted pages for organizations (such as Facebook or Google+)Market researchIe, ComScoreNote 4
25.3Growth in use of QR codesMarket researchie, ScanLifeNote 4
25.4Growth in use of URL shortening servicesMarket research Note 4
25.5Growth in registrations in ccTLDs relative to gTLDsRegistry data Note 3A significant increase in the use of ccTLDs could mean reduced trust in generic TLDs.
5.6Growth of Software Defined Networking (SDN) as alternative to the DNSMarket research Note 4
     
Complaints to, and action taken by, police, regulatory agencies and advocacy groups
36.1Number of consumer complaints to government agencies related to confusing or misleading domain namesGovernment regulatory agenciesEstablishing relationships with consumer protection and regulatory agencies may be difficult to initiate; however ICANN ought is expected to have such relationships in place anyway, either directly or through GAC representativesProportion relative to total domains should decrease
36.2Number of complaints to police agencies alledging alleging fraud or misrepresentation based on – or traced to – domain namesPolice Law enforcement agenciesICANN already has existing communications with LEA groups. Supplements GNSO metrics 1.15 and 1.16 buy by adding complaints as well as remedial action 
6.3Number of fraud investigations where WHOIS information positively assisted investigation and identification of offending partiesLaw enforcement agencies  
     
Transparency of contact information and domain-allocation policies for all gTLDs
47.1How many gTLD registries have privacy policies which are clearly and easily accessible by end usersRegistry websitesManual auditingAs many as possible
47.2

How many gTLD registries have allocation policies which are clearly and easily accessible by end users

Registry websitesManual auditingAs many as possibleSee Note 5 
47.3How many registries disclose end-user information regarding their codes of conduct for sub-domain owner/operatorsRegistry websitesManual auditingAs many as possibleSee Note 5 
     
Accuracy of new gTLD promotion to end users
58.1How many complaints are received by ICANN related to confusion or misunderstanding of TLD functionsICANN  
58.2How many registries uphold to their Public Interest CommittmentsICANN, independent auditWhether or not PICs are enforceable, they are public and likely indicate how each registry is marketed are subject to Compliance activity based on reported breaches of RAAICANN  
 85.3How many registries are subject to Compliance investigation based on breaches of RRA related to objectives or PICshave been the subject of complaints related to their Public Interest Commitments (PICs) ICANN  
 8.4How many registries have lost a dispute resolution process related to their PICs ICANNICANN  
     
Technical issues encountered (including application support)
69.1Are end-user software applications capable of implementing all of the new gTLDs; Can browsers and DNS clients in end-user systems resolve all new gTLDsAudit All major browsers and operating systems should be able to resolve news have versions capable of resolving all new gTLDs, including IDNs
69.2Which browsers or other end-user applications require plugins or user-installed enhancements in order to use new gTLDsAudit Support should preferably be native rather than as an add-in

...

  1. As the scope of ALAC and ICANN itself is global, we anticipate and expect that any metrics to be measured by survey (both the ALAC and GNSO metrics) would need to be globally distributed and multi-lingual
  2. External sources (such as business intelligence publications) can supplement (and reduce the cost of) customized surveys.
  3. An automated system could sample random second-level domains to perform tests based on lists of doomain domain names supplied by registries. The witholding of source data for metrics by contracted parties, in order to prevent collection of metrics which may be perceived to reflect upon them negatively, could impact the metrics and prevent ICANN from accurately measuring end-user trust
  4. Significant growth in alternative methods of accessing Internet services may indicate a corresponding reduction in the relative trust of domain names to perform the same functionThis metric was originally listed in the GNSO metrics report, but was removed (over ALAC objections) and re-introduced here. When possible, statistics should provide comparison with similar statistics for legacy TLDs.