You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

Issue 16 Work Track Leader(s): Cheryl Langdon-Orr and Gisella Gruber to restart working group on Metrics.

Issue 16 Work Track Members: Cheryl Langdon-Orr and Gisella Gruber to restart working group on Metrics.

Issue 16 - Absence of consistent performance metrics

Final Proposal as approved by the Board

The ALAC has had a Metrics WG and an ALS Review Taskforce, both of which largely went into stasis during the IANA Transition and Accountability efforts. It is proposed to revive this activity as part of the At-Large Review Implementation.

The ALAC notes that regional differences make it more difficult to have uniformity over participation metrics, but agrees that is an important target. The ALAC notes that collecting such statistics is a staff-intensive operation.

Prioritization

1:1:2  (Low resource needs : Low risk : 2nd priority)

ARIWG comments

Metrics will be developed for each activity in which At-Large participants are involved in order to measure the effectiveness of our processes as well as the actual involvement of active participants who assist the ALAC to carry out its work within ICANN. Such evidence will not only provide transparency and accountability of the contribution made by At-Large with regards to their meaningful  contribution in support of the policy development work carried out by ICANN's supporting organisations, but also of the degree of effort and engagement of the many volunteers whose meaningful contribution to the work of At-Large adds value to the development of policy that is an essential part of the the work of ICANN. Metrics could also legitimize requests made by At-Large for increased funding support for regional activities where there is still a need for further outreach to educate those in underserved sub-regions about ICANN.

Status of improvement effort / staff lead

Reconvene the ALACs existing Subcommittee on Metrics in November 2018 and in January 2019 conduct a  review of work to date, as well as an exploration of next steps including liaison with work of other existing activities (as listed below) is planned for Feb/Mar 2019  / Gisella Gruber is staff lead.

Activities, if any, on which implementation is dependent, or that are dependent on implementation of this recommendation

The Technology Task Force would be helpful in developing appropriate tools to record assessments of different activities based on the type of metrics being collected for some measurement purpose.

The Stakeholder Analysis Tool will be able to make use of any regional or country based metrics we develop first through At-Large and then further throughout ICANN. An ongoing continuous improvement project in collaboration with the Global Stakeholder Engagement Group will be the possible automation of this tool to incorporate the information needs of both At-Large and GSE staff. The use of Salesforce could also be used to manage At-Large membership metrics is expected to improve the efficiency of the process.

Selection of methodology for scoring identified performance metrics.

Who will implement the recommendation: ICANN community, ICANN Board, ICANN Organization, other?

ALAC via its reconvened  Subcommittee on Metrics with assigned staff support.

Anticipated resource requirements (FTEs, tools)

  • Tool(s) for collecting each identified performance metric

  • Staff (where required) to assist in monitoring and collection of data relevant to each identified performance metric

  • Methodology for scoring each identified/collected performance metric

  • Procedure for dealing with changes in data collection, solution

We note that tracking substantive activity of a potentially large number of individuals (ALS Members and Unaffiliated Individuals) is a task that At-Large has struggled with for a long time. Resources outside of At-Large or ICANN may be needed to find an effective and implementable solution.

Expected budget implications

Unknown at this time.  Any Budget requests arising from FY19 Q3/4 will need to be considered in requests for the FY20/21 budget cycle (and beyond)

Proposed implementation steps:

  1. Metrics WG will propose  performance metrics for ALAC Members, Liaisons and Appointments (beyond those specified in the Rules of Procedure); Regional Leadership; ALSes; ALS Representatives, ALS Members and unaffiliated individual members of RALOs

  2. Each of the items in this implementation plan is expected to provide appropriate metrics that will assess the achievement of the objective of the approved proposal

  3. Each of the three streams of At-Large activity (Organisational, Policy and O&E) will establish a goal with measurable objectives which can evaluated at the end of the year to assess achievement of the workstream objectives during each year.

Metrics

  1. Achieve a Significant  Level of Support for the proposed Metrics  by the At-Large community by June/July 2019

  2. Establish ALAC / At-Large Metrics Project Plan and any initial Budget requests for consideration.

  3. Socialisation and implementation of Metrics Project Plan from Dec 2019 through to June/July 2020

How long will it take to implement this plan?

Implementation of Metrics plan by end FY20;  Review and refinement of project by end FY21


Issue 16 Progress Chart

NOTE: the example Dashboard Report from WS2 of ICANN Accountability CCWG is an exemplar of the TYPE of dashboard/reporting that we recommend be utilised for reporting ARIWG progress to the ICANN Community as well as for inclusion in aggregated terms to the regular reporting /update to the OEC biannually.

The At-Large Review Implementation dashboard aims to update the ICANN Community about the progress of the work of the At-Large Review Implementation Working Group (ARIWG).

Date

Name

Link



Work is now completed.

 

Jan 2020 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

 

Dec 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

  

Nov 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

 

Oct 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

 

Sep 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

 

Aug 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

 

Jul 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

 

Jun 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

  

May 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

 

Apr 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

  

Mar 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

  

Feb 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

  

Jan 2019 ARIWG Dashboard

Link to presentation (PDF) of recent activity updates

See WS2 Dashboard for example(s).

  • No labels