Versions Compared

Old Version 1

changes.mady.by.user Ken Bour

Saved on

compared with

New Version Current

changes.mady.by.user Ken Bour

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

Working Group Self-Assessment Questionnaire

Note

Notes to SCI Members and Other Reviewers:

  1. In this Draft v2 version of the questionnaire, I am attempting to take into consideration a dimension raised by Mikey O'Connor and only partially accommodated in Draft v1. To evaluate any dynamic system, we could subdivide it into three basic or core components: Inputs → Processes → Outputs. In Draft v1, we captured most of the processes, the outputs, but only a few of the inputs, namely, the team members, tools, and experts. I did not ask about the other resources that impinge upon the success of a WG, e.g., its charter and constraints (required processes, time horizon). In Draft v2, I have reconstituted the questionnaire (still five sections but renamed), reorganized some of the original questions, and added a few new ones. 
  2. This Draft v2 also shifts the rating scale to 7 points as suggested by Avri Doria
  3. Initially, the questionnaire material is presented in plain text for the purposes of editing/finalizing the content. Once the design, structure, sequencing, and language have been approved, the intention is to enter the questions into an online tool (e.g., QuestionPro, SurveyMonkey, Wiki) to facilitate data collection, analysis, and reporting.
  4. I recommend a 5-point versus 7-point scale for this purpose. The principle advantage is that it is easier (less stressful) for respondents to make selections when the option set is smaller. The disadvantage is that the statistics will generally exhibit more central tendency (toward the mid-point or 3) because the scale is narrower.
  5. All of this material is submitted as DRAFT and I welcome the SCI's feedback, questions, and challenges. For example, you will notice that I did not insert a question to assess Leadership because I think it can be inferred based upon other dimensions (e.g., Participation, Behavior). If a Chair, or other leader, contributed to an ineffective and inhospitable climate, we would hope to see one or more supplementary text comments to that effect.
  6. I have not attempted to complete this questionnaire to determine length. It "feels" to be within an acceptable range based upon others I have designed; however, we should perform a test to ensure that it (a) can be completed in a reasonable period; and (b) is clear, comprehensible, and straightforward.

...

Welcome and Introduction

Thank you for accepting the invitation to complete this questionnaire concerning your experiences with the __________________________ Working Group (WG). Your Chartering Organization (CO) and other ICANN stakeholders are keenly interested in learning about the effectiveness of its chartered teams by asking participants for their assessments, perspectives, and insights concerning various aspects of the Working Group's operations, norms, logistics, decision-making, and outputs. The results of your feedback will be used to identify improvement areas in the guidelines, tools, methods, templates, and procedures applicable to Working Groups. Summary reports will be shared not only with your Working Group, but the larger GNSO stakeholder community. 

...

This questionnaire is organized into five sections and should take approximately _____ minutes to complete. Although most of the questions will ask you for an effectiveness rating (1-5 Scale), there will be an opportunity within each major section to add free-form text comments. You are encouraged to provide supplementary explanations or other supporting information that will help the Chartering Organization understand and interpret your input. If there is any individual question for which you do not wish to provide a rating, a SKIP option is available. 

I. Personal Identifying Information (Required)
Panel

Anonymity Provision: Although this assessment instrument is requesting personal identifying information, it is being done ONLY as a preventive measure to ensure that (a) all WG Members' input has been received and (b) any spurious or duplicate entries do not undermine or contaminate the value of the feedback to the Chartering Organization. Please be assured that: (1) your individual responses will not be accessible by anyone other than the ICANN Staff Administrator; and (2) they will not be disclosed or published in a way that could be matched to your identity without your express permission. 

Name: 
Email: 
Organization:

Please select one from the drop-down list:

    • Registry Stakeholder Group
    • Registrar Statkeholder Group
    • Business Constituency
    • Intellectual Property Constituency
    • Internet Services Provider Constituency
    • Non-Commercial Users Constituency
    • Not-for-Profit Operational Concerns Constituency
    • At-Large/ALAC
    • Other ICANN SO/AC
    • Representing Self
    • Other (please describe): _____________________
Working Group Role:

Please select one the most descriptive role that you fulfilled on the WG from the drop-down list:

    • Leader (Chair, Co-Chair, Vice-Chair, Other Officer)
    • Contributing Member
    • Background Contributor
    • Liaison
    • Observer
    • Advisor/Consultant
    • Support (e.g., secretary, technical, administrative)
    • Other (please describe): _____________________
Info

In the next three sections (II, III, and IV), you will be asked to rate the EFFECTIVENESS of each dimension; the scale interpretation will be provided appropriate to each element.

II

...

. Inputs ...includes the charter/mission, team members, tools, and resources.

Thinking about

...

the overall EFFECTIVENESS of the Working Group'

...

s Inputs, how would you rate each of the following elements on a scale

...

where 1=Highly Ineffective

...

 and 7=Highly Effective:

Participation climate within inhospitable, unilateral, frustrating, unproductive5 inviting, democratic, accepting, respectful, productive Behavior disruptive argumentative disrespectful hostile, domineering5 accommodating respectful collaborative consensus-building5 honored followed observed respected
Assessment CategoryRating

The

Charter/Mission of the WG where:
1-Highly Ineffective means

confusing, vague, ill-structured, unbounded, unrealistic (e.g., time, constraints), unachievable; and

7-Highly Effective means

understandable, clear, well-structured, bounded, realistic (e.g., time, constraints), achievable

1234567SKIP

The

Expertise of WG members where:
1-Highly Ineffective means

novice,

elementary,

inapplicable,

unusable; and

7-Highly Effective means

knowledgeable,

advanced,

applicable,

usable

1234567SKIP

The Representativeness of WG members where:
1-Highly Ineffective means narrow, skewed, selective, unbalanced; and

7-Highly Effective means broad, diverse, balanced

1234567SKIP

The external Human Resources (e.g., briefings, experts, consultants, liaisons) provided to the WG where:
1-Highly Ineffective means inappropriate, inadequate, untimely, not helpful/useful; and
7-Highly Effective means appropriate, adequate, timely, helpful/useful 

1234567SKIP

The Technical Resources (e.g., systems, tools, platforms, templates) provided to and utilized by the WG Decision-Making Methodology (consensus) where:
1-Highly Ineffective means broken, ignored, not observed, disrespected; and
5difficult, challenging, clumsy, awkward, tedious, slow, not helpful/useful; and
7-Highly Effective means easy, straightforward, clear, efficient, fast, helpful/useful 

1234567SKIP

The Administrative Resources (e.g., support, guidelines, documentation) provided to and utilized by the WG where:
1-Highly Ineffective means inappropriate, inadequate, untimely, not helpful/useful; and
7-Highly Effective means

appropriate,

adequate,

timely,

helpful/useful 

1234567SKIP
Comments about the WG's Inputs: (Free-form Text Box)
III

...

. Processes ...includes norms, operations, logistics, and decision-making.
Thinking about the overall EFFECTIVENESS of the Working Group's

...

Processes, how would you rate each of the following elements on a scale where 1=Highly Ineffective and

...

7=Highly Effective:
Communication/Collaboration Tools provided to and utilized by the WG Briefings and Subject Matter Experts provided to the WG inappropriate, not helpful/useful5 appropriate, helpful/useful 
Assessment CategoryRating

The Session/Meeting Planning (Agenda) Participation climate within the WG where:
1-Highly Ineffective means disorganizedinhospitable, haphazardunilateral, unstructuredfrustrating, untimely noticeunproductive; and
57-Highly Effective means organizedinviting, inclusive, disciplinedaccepting, structuredrespectful, timely noticeproductive

1234567SKIP
The Behavior of WG members where:
1-Highly Ineffective means disruptive, argumentative, disrespectful, hostile, domineering; and
7-Highly Effective means accommodating, respectful, collaborative, consensus-building
1234567SKIP

The Decision-Making Methodology (consensus)where:
1-Highly Ineffective means broken, ignored, not observed, disrespected; and
7-Highly Effective means honored, followed, observed, respected difficult, challenging, clumsy, awkward, tedious, slow, not helpful/useful; and
5-Highly Effective means easy, straightforward, clear, efficient, fast, helpful/useful 

1234567SKIP

The

Session/Meeting Planning (Agenda) where:
1-Highly Ineffective means

disorganized, haphazard, unstructured, untimely

notice; and

7-Highly Effective means

organized, disciplined, structured, timely

notice

1234567SKIP
Comments about the WG's Processes:(Free-form Text Box)
IV. Products and Outputs

Thinking about the overall EFFECTIVENESS of the Working Group's Products and Outputs, how would you rate each of the following elements on a scale where 1=Highly Ineffective and 57=Highly Effective:

Assessment CategoryRating

The Working Group's primary Mission where:
1-Highly Ineffective means not achieved and/or accomplished per the Charter; and
57-Highly Effective means completely achieved and/or accomplished as directed

1234567SKIP
The Quality of the WG's outputs (a.k.a. deliverables) where:
1-Highly Ineffective means incomplete, inadequate, materially deficient/flawed, unsupported; and
57-Highly Effective means complete, thorough, exhaustive, reasoned, supported
1234567SKIP
Comments about the WG's Products and Outputs:(Free-form Text Box)
V. Personal Fulfillment and Demographics
Your Chartering Organization is interested to learn about your own

...

Participation and personal

...

Fulfillment as a result of having invested time and effort volunteering on a Working Group. In addition, we have included a few

...

Demographic questions that will assist in understanding and interpreting your feedback. 
Assessment CategoryRating

My personal Participation in helping the WG achieve its mission where:
1-Highly Ineffective means immaterial, negligible, insignificant, unimportant
57-Highly Effective means material, substantial, significant, important

1234567SKIP

My personal Fulfillment considering the time, energy, and work efforts I contributed to this WG:
1-Highly Unrewarding; and
57-Highly Rewarding

1234567SKIP
How did you learn about the WG?

 

Please select one from the drop-down list:

  • I was informed or invited by my SG/C or ICANN-affiliated organization
  • I was contacted by an ICANN Staff member
  • I was contacted by an individual seeking to recruit volunteers for the WG (e.g., GNSO Councilor, interim Chair)
  • I learned about the WG through one of ICANN's websites (or Wikis)
  • I learned about the WG from another organization not directly associated with ICANN
  • A professional colleague or associate informed me about the WG
  • Other (please describe): _________________________________
Approximately how long have you been involved with ICANN:

Please select one from the drop-down list:

    • Less than 1 year
    • 1 - 2 years
    • 2 - 4 years
    • 4 - 6 years
    • 6 - 8 years
    • More than 8 years
Considering the most recent twelve months, on average, approximately how many hours per week do you spend on ICANN-related activities:

Please select one from the drop-down list:

    • Less than 10 hours
    • 10 - 20 hours
    • 20 - 40 hours
    • 40 - 60 hours
    • 60 - 80 hours
    • More than 80 hours
Comments about Personal Fulfillment and Demographics:  (Free-form Text Box)
Additional Comments:
(Please feel free to provide any additional comments feedback about your Working Group experience,
this Self-Assessment, or any other matter not covered elsewhere in this questionnaire:)		(Free-form Text Box)

THANK YOU FOR YOUR FEEDBACK! 

***END***