Can executive support quality be measured without monitoring every action?

Abstract

GAO evidence guidance emphasizes answering a defined question with credible evidence, and NIST privacy guidance asks organizations to manage the effects of data processing on people [1][2]. Together they argue against defaulting to keystrokes, screenshots, message counts, or continuous presence as proxies for executive support quality. A better measurement system begins with the service promise and collects the least data needed to test it.

Methodology

This review compares ten sources on evidence quality, privacy, internal control, information quality, records, cybersecurity, occupational tasks, and work design [1][2][3][4][5][6][7][8][9][10]. National occupation descriptions provide task context, not performance quotas. The framework does not determine employment compliance or individual performance outcomes.

Start with a service question

Examples include whether urgent calendar changes reach an authorized owner, decision materials arrive before a stated cutoff, or open commitments transfer during planned absence. Each question needs a denominator, time window, and exception rule. Counting messages before defining the service question produces activity data without a defensible interpretation [1][4].

Prefer outcome and reliability signals

Useful measures include accepted handoffs, deadline adherence, rework caused by missing inputs, unresolved exceptions, access failures, and stakeholder clarification loops. O*NET and BLS describe coordination and administrative tasks [8][9], but neither source establishes a universal daily task target or a quality score for one assistant.

Minimize data at collection

Before collecting a field, identify the decision it supports, who may see it, retention period, and whether aggregation or sampling would work. NIST privacy and security guidance supports managing data and access deliberately [2][6][7]. Sensitive calendar subjects, message bodies, health information, and private stakeholder details should not be copied into a dashboard simply because a tool can ingest them.

Separate learning from individual judgment

A service review can reveal unclear authority, poor intake design, insufficient backup, or unstable demand. Those are operating-model findings, not automatic evidence of individual underperformance. If measures will influence employment decisions, the organization needs transparent definitions, appropriate review, and qualified HR or legal guidance.

Test for gaming and burden

Review whether a metric causes rushed closures, duplicate logging, avoided complex work, hidden exceptions, or extra after-hours administration. Compare the benefit of the measure with collection time and privacy exposure. Retire measures that no longer answer a live decision question, and apply the approved records lifecycle to retained evidence [3][5][10].

Key findings

  • Measurement should begin with a defined service question [1].
  • Activity volume is not a universal proxy for quality.
  • Collection should be limited to data tied to a named decision [2][4].
  • System and role-design failures should not be collapsed into individual ratings.
  • Measures need periodic review for gaming, burden, privacy exposure, and retention.

Sources

  1. Guide for Conducting Risk Assessments, National Institute of Standards and Technology
  2. Privacy Framework, National Institute of Standards and Technology
  3. Risk Management Framework for Information Systems and Organizations, National Institute of Standards and Technology
  4. Guidelines for Ensuring Information Quality, Office of Management and Budget
  5. Records Management Regulations, Policy, and Guidance, National Archives and Records Administration
  6. Security and Privacy Controls for Information Systems and Organizations, National Institute of Standards and Technology
  7. Cybersecurity Framework 2.0, National Institute of Standards and Technology
  8. Executive Secretaries and Executive Administrative Assistants: Details, O*NET OnLine
  9. Executive Secretaries and Executive Administrative Assistants: Summary, O*NET OnLine
  10. Mental Health at Work, World Health Organization

Return to the Research Content library