Applied Human Conduct Review — Issue No. 0011
This issue looks at jobs that rarely show people the results of their decisions, and asks who can bring those results back. Four brief reports follow internal trainers and HR generalists whose managers traced their decisions to outcomes, housing-repair coordinators shown what became of their own calls, managers whose organizations did or did not give them time for that work, and procurement buyers who wrote down predictions and checked them with a colleague. In all four, years in the role predicted little by themselves; growth followed when someone made a decision's outcome visible and specific. That someone paid for it: managers in their own hours, analysts and senior coordinators in weekly time, divisions in planned deliverables, and employees in a few uncomfortable early months of looking at their own misses. Most of the return went to colleagues, tenants, and the teams those employees served. As with all issues of Applied Human Conduct Review, reports favor concrete, replicable behavioral comparisons over normative argument.
Papers in This Issue
We cluster-randomized 42 managers, and the 318 employees reporting to them, in five organizations to one of three feedback practices for 12 months. The employees worked in roles where the results of a decision arrive late or unclearly: internal trainers, account coordinators, HR generalists, and grant administrators. "Outcome-linked" managers (14 teams, n=108) agreed with each report on three actions whose results could be traced within a few weeks and held a weekly 15-minute review tracing one recent decision to what followed. "Check-in" managers (14 teams, n=106) held weekly 15-minute meetings on priorities and obstacles without tracing outcomes. "Usual-practice" managers (14 teams, n=104) kept the twice-yearly appraisal. Of the 318 employees, 297 completed both work samples. On a role-specific work sample scored by two raters blind to condition, outcome-linked employees gained a mean 14.6 points on a 100-point scale over 12 months, against 11.9 for check-in employees (a 23% gap) and 11.4 for usual-practice employees (a 28% gap). Years in the role did not predict growth under usual practice: employees with more than five years gained 10.9, against 11.7 for less experienced colleagues. Under outcome-linked reviews, employees with more than five years gained 14.1. Outcome-linked employees also rated their roles as clearer (5.3/7, against 4.4 and 4.2). Outcome-linked managers spent a mean 3.4 hours a week on feedback, 26% more than check-in managers holding meetings of the same nominal length, and rated their strain at 4.3/7, against 3.6 and 3.4.
At the repair desks of six nonprofit housing associations, 274 coordinators who take tenants' repair calls and decide the priority, trade, and instructions for each job were randomly assigned to one of three ways of learning how their jobs turned out, for nine months. "Case follow-up" coordinators (n=92) received a weekly list of their own jobs closed three to five weeks earlier, showing whether each was fixed on the first visit and whether the tenant called again, and reviewed one case for 10 minutes with a senior coordinator. "Dashboard" coordinators (n=91) received a quarterly report of their own and their team's first-visit fix rates. "No-return" coordinators (n=91) received neither. In months 7 to 9, jobs taken by case-follow-up coordinators drew 14.2 repeat calls per 100 within 30 days, against 17.6 for dashboard coordinators (24% higher) and 18.3 for no-return coordinators (29% higher), from baseline rates of 19.0 to 19.4 in all three groups. On a test of 30 recorded calls with known outcomes, scored by raters blind to condition, case-follow-up coordinators scored 66.3/100, against 55.9 and 54.7. At baseline, coordinators with six or more years on the desk had about the same repeat-call rate as those with under two years (18.9 against 19.4). In month 2, case-follow-up coordinators rated themselves as more discouraged by feedback (3.9/7, against 3.2 and 3.1), a difference that had closed by month 9.
After all 236 managers in 27 divisions of six organizations were trained to give outcome-linked feedback, divisions were randomly assigned to one of three arrangements for 12 months. In "credited" divisions (9 divisions, n=80), managers' project work was reduced by four hours a week and feedback practice was counted in their annual evaluation. In "added-expectation" divisions (9 divisions, n=79), feedback practice was counted in the evaluation with no reduction in other work. In "training-only" divisions (9 divisions, n=77), nothing changed after the training. Sustained practice was measured by reports' fortnightly answers to whether their manager had connected a specific action of theirs to a result. At month 3, 66% of credited and 63% of added-expectation managers met the threshold; by month 12, 58% of credited managers did, against 47% of added-expectation managers (a 23% gap) and 45% of training-only managers (a 29% gap). Added-expectation managers rated their exhaustion at 4.3/7 at month 12, against 3.5/7 for credited managers (23% higher) and 3.7/7 for training-only managers. Among three randomly chosen reports per manager, (baselines 52.1 to 53.0 on a blind-scored 100-point work sample), those of credited managers gained a mean 13.4 points, against 11.0 and 10.6. In the first two quarters, credited divisions completed 81.4% of planned project deliverables, against 87.7% in added-expectation and 88.1% in training-only divisions; the gap with added-expectation divisions narrowed to 1.8 percentage points in the fourth quarter.
We randomly assigned 246 procurement buyers at 11 manufacturing firms to one of three practices for 10 months. "Peer-log" buyers (n=83) wrote a short prediction before each significant supplier decision, covering expected delivery timing, quality problems, and cost, and met monthly for 30 minutes with a buyer from another site to compare resolved predictions with what had happened, each acting as reviewer for the other. "Private-log" buyers (n=82) kept the same log and were prompted monthly to compare it with outcomes alone. "No-log" buyers (n=81) worked as before. Outcomes are for the 227 buyers still in post at month 10. In months 7 to 10, 17.8% of peer-log buyers' significant decisions ended in late delivery or quality rejection, against 21.9% for private-log buyers (23% higher) and 22.6% for no-log buyers (27% higher), from rates of 22.8% to 23.4% in all three groups in the six months before. On a test of 40 past supplier decisions with known outcomes, peer-log buyers scored 63.7/100, against 54.9 for private-log buyers (a 16% gap) and 52.4 for no-log buyers (a 22% gap). By month 10, 71% of peer-log buyers were still logging, against 57% of private-log buyers. Among no-log buyers, those with 10 or more years in procurement scored 53.1 on the test, against 51.8 for those with under three. In month 2, peer-log buyers rated reviewing their missed predictions as more uncomfortable (3.7/7, against 2.9/7 for private-log buyers), a gap that had closed by month 10.