In August 2018, the National Academies of Sciences, Engineering, and Medicine published a report showing that high rates of harassment in academic sciences and medicine were creating organizational climates that threatened the integrity of the workplace.
1National Academies of Sciences
Engineering, and Medicine. Sexual Harassment of Women: Climate, Culture, and Consequences in Academic Sciences, Engineering, and Medicine.
Several other studies have demonstrated that women are paid less than men for equal work, are underrepresented at higher levels of academic promotion or leadership positions, and work within academic health science centres, where there is a preponderance of male-dominated hierarchies.
2- Jena A.B.
- Olenski A.R.
- Blumenthal D.M.
Sex differences in physician salary in US public medical schools.
, 3- Herrick-Reynolds K.
- Brooks D.
- Wind G.
- et al.
Military medicine and the academic surgery gender gap.
, 4- Chisholm-Burns M.
- Spivey C.
- Hagemann T.
- et al.
Women in leadership and the bewildering glass ceiling.
A recent update of a longitudinal cohort study of academic medical centres shows that a 35-year trend of women being less likely to receive promotion to associate professor, full professor, or department chair has not improved over time.
5- Richter K.P.
- Clark L.
- Wick J.A.
- et al.
Women physicians and promotion in academic medicine.
,6Women physicians in academic medicine: new insights from co-hort studies.
Atlhough this study was limited in that it did not adjust for academic productivity, its large sample size was compelling.
5- Richter K.P.
- Clark L.
- Wick J.A.
- et al.
Women physicians and promotion in academic medicine.
Accordingly, there has been a call to flatten academic hierarchies on the basis of fairness, and uncertainty as to when hierarchy is potentially beneficial and when it is predominantly harmful.
7- Whitelaw S.
- Kalra A.
- Van Spall H.
Flattening the hierarchies in academic medicine: the importance of diversity in leadership, contribution, and thought.
,8- Greer L.
- de Jong B.
- Shouten M.
- et al.
Why and when hierarchy impacts team effectiveness: a meta-analytic integration.
As a result, the Department of Medicine (DoM) of the Faculty of Health Sciences at McMaster University investigated whether issues of diversity, inclusion, inequity, and unprofessional behaviour existed within the department and explored solutions attempting to address them.
Methods
Data sources
In January 2019, an anonymous online survey was sent to all 304 DoM members in regard to their self-reported demographic characteristics and experiences. Additional data on academic rank, leadership positions, and nonclinical financial remuneration (stipends for teaching and administrative roles) were obtained directly from the DoM’s database. The DoM academic productivity data, which are collected annually to determine remuneration from an alternative funding program (AFP) for teaching and research activity, were also analyzed. Atlhough the academic productivity data are self-reported, they are reviewed for face validity by the division directors, the associate chairs of research and education, and the DoM budget manager.
Departmental structural changes
In order to address issues of inequity within the DoM, its leadership embarked upon the development of broad strategies to promote greater equity and foster inclusion. An Associate Chair of Equity and Diversity position was created, and educational sessions regarding equity issues in academic medicine were presented at various member forums. Division director and associate chair term limits were more strictly enforced, promoting a higher turnover of leadership opportunities, to which female members and people of colour were encouraged to apply by broad declarations but also through direct personal encouragement (ie, “shoulder tapping”). Focus was put on division director roles, as these leaders are directly responsible for the career advancement of all the members in their respective divisions.
The next challenge was determining how to ensure all candidates had an equal opportunity in these leadership competitions. The first step taken to try and flatten the hierarchal structure was the creation of larger selection committees with a more diverse representation. Each committee member was given real voting powers, in contrast to the more traditional model of a chair having the privilege of making all selection decisions. Such voting was also blinded, to ensure anonymity. All questions posed to the candidates during interviews were standardized, to eliminate preferential treatment. Despite these measures, the first leadership selection committee run under these new protocols did not achieve a result that was in the direction of rebalancing gender inequity. This outcome occurred in spite of what was arguably a superior curriculum vitae for the female candidate, thus calling into question whether all the measures taken to that point had been sufficient. This led to calls for an equity solution of rebalancing through quotas. However, the DoM leadership maintained that they could not compromise their fundamental principle that candidate selection be made primarily on the basis of merit. As a result, analysis of DoM members was undertaken to look more closely at merit, using the academic productivity data.
Innovation in leadership selection
The DoM developed an alternative and new strategy to aid in the process of leadership selection for new division directors. This strategy was called Diversitive Agreement Versus Nash Equilibrium (DAvNE), named after physicist and game theory pioneer John Nash.
9Equilibrium points in n-person games.
The strategy was designed to allow candidate selection on a merit basis only if there were enough votes to pass a threshold that would vary based on the diversity of the committee members and the overall parameters of the competition (see
Supplemental Appendices S1 and
S2). For instance, a DAvNE committee with only 30% female membersship would require at least a 71% consensus, in contrast to a traditional “democratic” process in which the threshold only needed to exceed 50%. This ensured that when the DAvNE strategy was used, no represented minority group within the DoM could be routinely outvoted by the majority. In deciding upon the removal or selection of any given candidate using the DAvNE strategy, failure to exceed a voting threshold resulted in the decision being made instead by random selection (see online
Supplemental Appendix S3) from the pool of eligible candidates. This process was applied through all steps, from earlier decisions to eliminate candidates when there were more than 2, to the final selection between the last 2 remaining candidates. In this way, using the DAvNE strategy incentivized the department chair and all others involved to create a more diverse selection committee and process in order to lower the threshold needed to avoid random selection. Although McMaster University DoM members were motivated to avoid random selection during this process, they were comfortable with it as a fallback for uncertainty, as it paralleled their frequent use of randomization in clinical trials for situations of equipoise.
10Why did the randomized clinical trial become the primary focus of my career?.
,11- Liu M.
- Choy V.
- Clarke P.
- et al.
The acceptability of using a lottery to allocate research funding: a survey of applicants.
Statistical analysis
During leadership selection competitions for division director, candidates were scored by committee members on a Likert scale from 1 (highest performance) to 5 (lowest performance) based on the following domains: their curriculum vitae, their initial 10-minute presentation to the committee, and each of their answers to the selection committee’s standardized questions. Selection committee members scored candidates using their own computers or mobile devices, and the scoring and subsequent voting was blinded. Scoring was not made available to the selection committee during their deliberations or voting. Although individual committee member scores remained anonymous, aggregate data on candidates were made available for ANOVA and post hoc testing using the least significant difference and Bonferroni tests. Analyses of aggregate scores were then compared with committee member voting and final candidate selection.
Ethics statement
Prior to the initiation of the demographic survey and all the DoM changes made to leadership selection processes, the Hamilton Integrated Research Ethics Board was consulted, and they declared that these activities did not require their approval, as there was no involvement of patients or vulnerable study subjects. Although the results presented here represent separate initiatives undertaken by the DoM (demographic, salary, and merit surveys vs departmental structural change and leadership selection processes), they have been reported together, as they are linked by their implications for the interest in equality and right to fair process that all department members share.
Discussion
After multiple lines of investigation, inequities in base salary, leadership, and perceptions of barriers to promotion were identified in the DoM, consistent with what has been reported at other academic health science centres.
1National Academies of Sciences
Engineering, and Medicine. Sexual Harassment of Women: Climate, Culture, and Consequences in Academic Sciences, Engineering, and Medicine.
The DoM leadership made attempts to restructure the department to create more equitable processes with an openness to consideration of many strategies, including equity quotas and a novel approach using the game theory–based DAvNE strategy. The initial target for equality change was the selection of division director leadership positions, given their integral role in the mentoring and career advancement of all DoM members. Although the primary focus was on addressing gender inequity, it became increasingly clear from the data that racial inequity was also an issue within the DoM. After these first 4 division director selection committees were completed, the need was clear for further adaptation of the DAvNE strategy and other DoM policies to broaden the scope to foster greater racial equity. Although these efforts had been temporarily stalled due to the coronavirus disease–2019 pandemic, plans are in place to implement further division director selection processes using the DAvNE approach.
Although the DoM is made up of 40% women and 40% people of colour, only 27% of candidates participating in these leadership competitions came from these demographics. Possible reasons for lower than expected participation rates include the following: female candidates passing up promotion opportunities owing to time constraints related to having young children
14- Kahn J.
- Garcia-Manglano J.
- Bianchi S.
The motherhood penalty at midlife: long-term effects of children on women’s careers.
; candidates feeling that applying was futile because of an already apparent preferred candidate; and anxiety related to imposter syndrome.
15Imposter syndrome threatens diversity.
The presence of imposter syndrome in any organization indicates a need to further develop policies that foster more inclusion at earlier career stages, particularly for members from minority groups.
15Imposter syndrome threatens diversity.
Of the few women who did participate in these competitions, 66% actually won a leadership position, a success rate higher than the 25% for men that competed (
Table 2). This result showed how unwarranted gender imposter syndrome is, as women clearly were not inferior to men on any merit basis. Nevertheless, even if the DAvNE approach is able to provide equal opportunity for women, this does not guarantee that gender equity will be achieved. Under conditions of greater opportunity, the gender gap has in some instances become even larger, the reasons for which are unclear but potentially are related to gender preferences.
16Relationship of gender differences in preferences to economic development and gender equality.
Given that no McMaster University policies explicitly promote systemic discrimination, it was assumed, based on the equity literature, that the root cause for the inequities observed in the DoM was implicit (unconscious) bias.
17League of European Research Universities, Implicit bias in academia: a challenge to the meritocratic principle and to women’s careers—and what to do about it.
Since the concept of cognitive bias was first described, it has been assumed to have a principal role in erroneous judgment.
18Judgment under uncertainty: heuristics and biases.
But critics of this approach, including those involved in academic health sciences research, question whether it properly assigns thought rationality and consequently lacks validity for real-world decision-making.
19The bias in researching cognitive bias.
Therefore, the use of cognitive bias methodology to solve a problem as complex as inequality ultimately might be unsuccessful, and this possibility seems to be supported by the literature, in which implicit association testing (IAT) has been shown to be such a poor predictor of discriminatory behaviour and decision-making that its construct validity has been questioned.
20- Oswald F.
- Mitchell G.
- Tetlock P.
- et al.
Predicting ethnic and racial discrimination: a meta-analysis of IAT criterion studies.
In addition, studies of unconscious bias training (UBT) have shown that it is mostly ineffective at improving equity,
21- Kalev A.
- Dobbin F.
- Kelly E.
Best practices or best guesses? Assessing the efficacy of corporate affirmative action and diversity policies.
,22- Bezrukova K.
- Spell C.
- Perry J.
- et al.
A meta-analytical integration of over 40 years of research on diversity training evaluation.
and in some instances, worsens discrimination.
23Ironic evaluation processes: effects of thought suppression on evaluations of older job applicants.
Therefore, in these DoM leadership competitions, IAT and UBT were encouraged but not mandated for selection committee members. Still, 69% (34 of 49) of selection committee members responding to a survey reported having recently taken UBT.
The failure of IAT and UBT to significantly reduce systemic discrimination has led to calls for an equity solution, defined as a strategy of rebalancing through affirmative action quotas.
24Pointless diversity training: unconscious bias, new racism and agency. Work.
However, the DoM leadership maintained a fundamental principle of not compromising merit-based candidate selection. Therefore, further analysis of the DoM members was undertaken to look more closely at their merit, and no gender differences were seen in either educational or research academic productivity (
Fig. 1). Although the frequency distribution for the educational productivity of members was normally (Gaussian) distributed, it was clearly not normally distributed for their research productivity. This finding has implications for candidate selection, as prior studies demonstrate that whereas Gaussian distributions suggest that the majority of members are equally productive, a non-normal (Pareto) distribution indicates that they are not.
25The secret sauce for organizational success: managing and producing star performers.
In such Pareto distributions, the overall mean productivity of an organization is largely being driven by relatively few highly productive performers, thus making it vital to that organization’s prosperity to identify, select, and retain them.
25The secret sauce for organizational success: managing and producing star performers.
Using equity quotas to choose candidates based only on their belonging to demographically underrepresented groups risks missing highly productive candidates from the majority demographics. Conversely, in order for any organization to reach optimal success, the highly productive performers from underrepresented minorities must not be overlooked. It was for these reasons that a strategy other than equity quotas was explored by the DoM and resulted in the DAvNE methodology being tested in hopes that highly productive performers from all demographics would be equally considered.
The results of these DoM leadership selections did not effectively address racial inequities, as no people of colour who participated were successful at securing a director position. However, taking into account overall ranking, people of colour did garner all the second- and third-place voting positions for competitions they participated in (
Fig. 2, B and D), suggesting some fairness in the process. With adjustment of the DAvNE strategy to foster greater inclusion, not only for gender but also race, more people of colour might secure leadership positions. One such adjustment may be in regard to the DAvNE randomization voting threshold. In Divisions 1 and 4, both final candidates were selected with vote counts ranging from 87% to 100%, so in these instances, much higher voting thresholds could have been met easily (
Fig. 2, A and D, respectively). Division 3 actually had the lowest required voting threshold (68.5%) of all 3 of the DAvNE contests but still failed to reach it, with a vote count of only 60%, presumably due to the 2 candidates being very close in merit. Taken together, the findings suggest that these DAvNE contests were not over-randomizing, as distinct candidates were still able to be selected and randomization avoided. Indeed, the DAvNE approach actually may have led to under-randomizing, as reflected in Division 2 (
Fig. 2B), where there seemed to be a pretense of merit sorting, as all candidates actually had similar merit scores.
By modifying the DAvNE approach to magnify the degree to which diversity raises the voting threshold, the frequency of randomization would be increased, thereby giving all candidates, including those from minority groups, a greater chance of being randomly selected. For example, if Division 2 under a revised DAvNE approach had been given a 10% penalty due to its lack of female candidates, its voting threshold would have been raised to 81.5%. This higher voting threshold would not have been exceeded by 2 of the 3 vote counts reached in Division 2, thus triggering random selection twice, which may have led to one of the people of colour being randomly selected instead of the White male who was eventually chosen. In this way, the DAvNE strategy could leverage gender inequality against race inequality, creating a positive intersection between 2 targets of discrimination that usually intersect synergistically in a negative manner.
26Mapping the margins: intersectionality, identity politics, and violence against women of color.
Of course, making the DAvNE randomization disincentives more impactful also would have had greater influence on Division 2, leading it to avoid running an all-male contest in the first place. In this way, the true advantage of game theory is illustrated, as exploitative strategies are automatically mitigated by their greater vulnerability as they get farther from equilibrium.
9Equilibrium points in n-person games.
,27- Neumann J.V.
- Morgenstern O.
Formulation of the Economic Problem. The Theory of Games and Economic Behaviour.
Lastly and most importantly, the very low demographic numbers in the DoM for both Black and Indigenous members is unacceptable and cannot be solved by use of the DAvNE strategy. as that degree of inequity is too high to rebalance using game theory without invoking excessive randomization. For inequities this steep, only an affirmative quota strategy, put in place upstream at the point of hiring new department members, is sufficient to gain the much-needed representation from these demographics. Although the DAvNE strategy can be a tool to help reach diversity and inclusion goals, it is only one part of a comprehensive equality strategy.
Limitations
A number of important limitations in this report must be considered. The first limitation is the relatively small number of both candidates and committee members, and the strict application of the DAvNE approach to only 2 of the 4 leadership contests, thus making it difficult to determine if the data being analyzed are truly trending in certain equity directions or simply reflect the random drift of small sample size. Still, there was enough power to detect statistical differences in candidate mean performance scores, and these mostly correlated with voting selection. Another limitation relates to the initial DoM demographic survey, to which only 60% of department members responded. This level of response could potentially skew the data toward respondent perspectives, as people who did not respond to the survey may be different from those that did. Important to note is that the difference in frequency distributions between educational and research productivity seen in
Figure 1 is an empirical observation of the DoM and is not an implication about the relative importance of these academic activities. The reasons for the observed difference in pattern are not fully known. It may be due in part to the educational AFP being based on time-compensation, whereas the research AFP is allocated more on the basis of achieved results (mainly successful grant applications and article publications) that have candidate performance and stochastic determinants. If educational AFP allocation was dependent instead on candidate teaching-evaluation scores, educational productivity theoretically could shift from a Gaussian to a Pareto distribution similar to that seen for research.
Acknowledgements
We acknowledge Graeme Matheson, McMaster University DoM Budget & Financial Analyst, for his contributions to the financial and productivity analyses. We recognize Dr Randi E. McCabe, Professor of Psychiatry at McMaster University, for her aid in statistical analysis and manuscript review. We thank Dr Andrea N. Frolic, Director of Clinical and Organizational Ethics at Hamilton Health Sciences, for her ethics expertise on DAvNE development. We salute Dr Geoff Norman, Professor Emeritus, Health Research Methods, at McMaster University, for his insight on cognitive bias and heuristics and his advice to treat these 2 imposters just the same. We are grateful to Matt Berkey,
SolveForWhyAcademy.com, for his consultative opinions on game theory, in particular on the difficulty of reaching true equilibrium and the rare necessity to do so.
Funding Sources
This work was supported in part by an Associate Chair, Equity and Diversity, DoM, McMaster University, the Michael G. DeGroote Heart and Stroke Foundation Chair in Population Health, the Canada Research Chair in Ethnic Diversity and Cardiovascular Disease, and the Leo Pharma Chair in Thromboembolism Research.
Disclosures
The authors have no conflicts of interest to disclose.
Article info
Publication history
Published online: September 13, 2021
Accepted:
September 7,
2021
Received:
May 25,
2021
Footnotes
Ethics Statement: Prior to the initiation of the demographic survey and all the DoM changes made to leadership selection processes, the Hamilton Integrated Research Ethics Board was consulted, and they declared that these activities did not require their approval, as there was no involvement of patients or vulnerable study subjects.
See page S60 for disclosure information.
Copyright
© 2021 The Authors. Published by Elsevier Inc. on behalf of the Canadian Cardiovascular Society.