Audit Regime
Author: Amelia H. Wheeler
Where did audits come from?
An Ancient Assyrian template written in Cuneiform detailing an audit of the contents of a caravan from Accountca (and old Assyrian trading colony) 20th–19th century B.C.
“It would start with an email shot across the department like Paul Revere’s heralding of the British. An email with only a subject line, “The Fox is in the Hen House”. This alarm signaled to myself and the other teachers on my hall that it was time to prepare to be infiltrated by an interloper .The forthcoming guest was not a hostile army but fear and anxiety circulated our hall all the same. Chests tightened and senses sharpened as we steadied ourselves for the inevitable fox to materialize in our classrooms. Who was this fox? Why was she disturbing our carefully tended “hen houses”? And how could 7 simple words illicit such a visceral individual and collective response?”
Naming the Audit Regime
Who was the fox in the hen house? The “fox is in the hen house” was the code among teachers at the high school I taught at that an administrator was conducting surprise performance evaluations. Though I thought I understood the point of the visits I was unaware of greater phenomenon to which they belonged. I was also unaware that the professional goals I had to set, the ongoing concerned conversations about test preparation with my administrator, and the frequent check in’s at faculty meeting about our school's College and Career Readiness Preparedness Index (CCRPI) score were also manifestations of the same phenomenon. This phenomenon, a collection of loosely related discourses, techniques, and knowledges, I now know is called an “audit regime."
Though this term may sound unfamiliar in text, in practice we are all intimately acquainted. For not only does the audit regimes operate within and across every level of the education system (from individual teachers to international rankings), but they now pervade in public and private employment. The reach of the audit regimes extend still farther though. They ripple through our working lives, and have seeped into even our relations with ourselves and others . In other words, audit regimes are a ubiquitous part of contemporary society though unfamiliarity renders them essentially hidden in plain sight. As any teacher knows - knowledge is power. Thus we can hope that by becoming familiar with the history, logic, and implications of the audit regime, we can figure out ways to not to be blindly governed by them.
Where did audits come from?
The word “audit” comes from the Latin word “to hear”. This references the role of the “auditor” in medieval Europe - as the one tasked with listening to official reports by responsible representatives and confirming their accuracy. Auditing as a practice extends even further into the annuals of history though. Evidence of auditing have been found in the official records for ancient China, Egypt, and Greece. Though execution varied by context - audits served the same general function. They were a set of tools to meet the perceived need to gather information or reassurance about the appropriate use of resources by individuals. Since interested individuals, who were those in leadership positions, are unable to obtain this information for themselves, they relayed on auditors and their reports to gather and present this valuable data. These reports were usually on things like collection of taxes, government spending, agricultural yields, and so forth.
Using the data from audits, leaders could exert a more exacting control. With the audit mechanism they could monitor the flow of resources from afar while enforcing accountability to their mandated standards. So if an ancient Chinese auditor found that their assigned province did not contribute its required grain tax, then the Emperor’s court could adjust their book keeping and take action to ensure it did not happen again. In other words, audits are nothing new. They are historical tools that have been used for thousands of years to measure, count, track, and control the management of resources.
However, they became increasingly integral to business practice during the Industrial Revolution (starting approximately in the 1840’s). It was then that audits were picked up by the burgeoning managers of private industry. These new industrial leaders (and their investors) needed to ensure that their accounting books, which detailed the movements of vast amounts of money and resources, were free from fraud and error. As the American and British economy continued to boom (and sometimes bust) through the Industrial Revolution and beyond into the post war years, audits became increasingly entrenched into corporate practice.
In the decades following the 1960’s audits continued to evolve as economies grew increasingly complex. Audits weren’t just for checking accuracy or detecting fraud anymore. Businesses were now more complicated and extended and they needed the ability to monitor the performance of large numbers of dispersed individuals and resources. Their very structure required that audits become part of the system to lead such enterprises. Without a regular stream of data to gage performance how could businesses make informed decisions? And even more pressingly - how could they ensure their money and resources were being used in ways that maximized profits? Audits in effect became baked into the very structure of business practice in capitalist democratic countries like America.
The evolution of an audit society
Since around the 1980’s audits spilled beyond the business world leading to an unending proliferation of auditing activity in all walks of life. They have been increasingly applied to measuring and evaluating human behavior and social practices in all sorts of manner. Their rise can be clearly tied to the increasing influence of neoliberalism in our society. The effects of this change cannot be understated.
Everything from public services, education, policing, health care, energy conversation, and the performance of employees, states, and countries are now subject to elaborate systems of audit. Earlier, people had only heard of financial audits. But now there are technology audits, medical audits, environmental audits, quality audits, teaching audits, and so on. In fact, auditing of human behavior and conduct has become so pervasive that they can appear utterly commonplace. Most people just assume they are inevitable and natural aspects of being a worker, student, or employee. They do not realize that not until very recently the idea you could quantify social behavior and use it to make high stakes evaluations about performance would have seemed quite preposterous.
The explosion of audits extends even further still. Proliferation of audits is not restricted to the United States but is now a worldwide phenomenon. From New Zealand to England, Singapore, to South Africa, audits wrap around our globe at every scale. Further, not only do audits reach across the planet, but they have also permeated into our internal worlds as well. For example, you may have seen lifestyle experts espousing the virtues of conducting “life audits” on internet platforms like youtube. They advise how to tally the negative and positives aspects of your life and make changes accordingly so you can become “more successful”. People also conduct this type of self-auditing in other less obvious ways.
For example, using a fit-bit to track steps or an app to count calories to evaluate our daily physical exertions and food intake are essentially health audits that we perform on ourselves. Because the tools and logic of auditing (like counting, measuring, and evaluating) are so common in our external world it is no wonder we start to view and govern our own selves using such terms. As a result more than ever our lives are increasingly controlled by and through quantifications and comparative evaluation of our behaviors based on standards set by distant experts.
These audit regimes have a powerful influence on our lives, and thus need to be critically examined. We should remember that they are not inevitable and are actually quite peculiar compared to the historical role of auditing. We should also remember that it is not politically natural. This is because audits in our world today are rooted in goals of control, accountability and compliance. Sometimes voluntarily but often under directions from the powers that be we assent to be measured, monitored and controlled through these audit regimes. The techniques, knowledges and discourses associated with these regimes look especially crafted for specific control and accountability purposes. But if we scrape beneath the surface, we can see that these regimes all follow an economic rationality that might be well-suited for an economic activity but is totally out-of-place in rest of the world. This is because efficiency and maximization of outcomes are always the chief virtues and USP (unique selling proposition) of these regimes. As a result, subjection under these audit regimes has real material and physiological consequences for those under its scrutiny.
Despite its pervasiveness and perceived legitimacy, educators and other educational stakeholders can do a lot to escape being mindlessly governed by the audit regimes if they are critically aware about their logic and goals. Their response options, of course, includes plain old-fashioned resistance as in helping students opt out of standardized tests or providing research to administrators about the ineffective burden of required “data collection” (resources for both are provided at the bottom of the page). They can also be strategic and/or subversive in their responses by being opportunistic and creative in their selective and critically aware participation in the audit regimes.
An absence of critical awareness not only makes educators subservient to the dictates of the audit regime, it also prepares them to voluntarily begin self-auditing their professional work and personal life using audit regimes set by remote experts.
The Audit Regime in Education
How do audits function in schools?
As my administrator evaluated me, he used tools that in hindsight appear to me more suited for tracking assembly line worker productivity than educational outcomes. If a student had her head down, I would be marked down a point on my evaluation. If I forget to announce the standard covered for that day, another deduction would ensue. That fact that none of these instances substantially represented my teaching ability or students’ learning was conveniently overlooked. The contextual, multi-facted, and nuanced art of teaching was reduced to a 5 category rubric of mandated practices. Like all auditors, my administrator used these standards to “measure” my performance. His measurements were then translated into documented conclusions about my “efficiency” and “quality” as a teacher. It is no wonder myself and my colleagues found this process anxiety inducing. In fact, being the object of audit scrutiny is unnerving, regardless if you are a teacher, student, or even school district.
That is because conclusions drawn the audit “data” are highly influential in the decisions made by educational leaders. This is especially vexing because usually these leaders are far away from the people and organizations they are running. Meanwhile those being audited have little input into the metrics used to gage their success. In my example, audit data, designed to enforce compliance and control, was used to draw conclusions about my ability to promote student learning. The conclusions drawn from this data had real consequences for me professionally and physiologically. For example, receiving a low evaluation score would forever be accessible to future employers, not to mention shake my sense of professional confidence. Elsewhere too the audit regimes operating in public education often have led to profound consequences. Some examples include:
Third grade honor students in Florida are denied graduation to fourth grade because their parents chose to legally opt them out of state standardized reading test.
The Prince George School District in Maryland is scandalized after it is discovered that 30% of their graduating seniors failed to meet graduation requirements. The teachers and administrators involved claim they were pressured to raise the graduation rate by the school system’s executive as he attempted to “reform” the struggling district.
Denver teachers went on strike for 3 days to successfully protest contractual conditions that stipulated merit based pay based on student performance that caused their income to fluctuate widely from year to year.
Schools in the 100% charter school system of New Orleans are routinely closed when they are judged as “failing” by their students’ standardized tests scores.
Further, by voluntarily internalizing the various audit regimes recipients often start to view and govern themselves using their logic. One common manifestation of this self-governance in public school setting is to the self-imposed pressure among educators to “teach to the test.” This is problematic considering that the metrics of the audit (in this case standardized tests as indicators of learning) are rarely created with the input of the people and systems that they affect (students, teachers, and schools). What is even more troubling is the damaging effects of the audit regime on marginalized students from minority or low income background and their teachers. Audits are championed as THE tool to close the achievement gap.But in reality they have been documented to at best do nothing to the achievement gap or at worst exacerbate it. All the while “struggling” students and their teachers are continually labeled as failures using parameters they had no stake in creating. The audit regimes wield a considerable force in both the formal and informal decisions made in schools. Thus taking a moment to consider how the welter of activity happening in school is turned into audit-table data may be useful for educators interested in better understanding the powerful force of the audit regimes.
Practices that fall into the audit regime are typically those that are deemed by the powers that to be critical for monitor and controlling all aspects of teaching and learning including educators’ professional work. For schools this would include data like student achievement, teacher quality, and school effectiveness.. But to reduce such complex sociocultural actions, such as achievement, quality, and effectiveness into measurable quantities requires certain translation practices - specifically transparency, observability, and standardization.
For example when I received my performance evaluation I accepted being subjected to the observation of the auditor (transparency). The auditor used a 5 category rubric to assess my performance in relation to an idealized set of performance standards (standardization). The auditor then calculated my score based on what he was personally able to witness in that particular visit (observability). Through this process the rich and vibrant practices of teaching and learning are oversimplified into a few numerical indicators. Yet reducing the vast field of human activity into such narrow terms inherently ignores a host of influential processes that happen outside that meteric’s parameters. It also begs the question why systemic inequalities that are highly impactful to schools, such as growing wealth inequality, the resegregation of American schools, etc.) fall so neatly out of detection. Audits claim to produce reliable and objective data justified in making important decisions. Yet they paradoxically produce data that is so oversimplified and surface level that it is unable to capture numerous influential factors affecting the variable being measured.An extreme example of this problematic can be found in the Bushwick Community High School in Brooklyn.The school was labeled a failure and faced closure due to low graduation rates. Yet the audit data failed to highlight that Bushwick was a school that primarily admitted 17-18 year students with little to no high school credits. The graduation rates also failed to represent the successes Bushwick achieved in graduating students who never thought they could receive a high school diploma.
The validity of audit data is questionable at best. Yet both policymakers and laypersons find it attractive because its numerical form makes it easy to compare and rank schools and teachers. Numerous academics in education and policy have have voiced serious doubts about the validity and reliability of the audit regimes used for measuring teacher performance. They like many teachers and students doubt the claims that the audit regime utilizes rigorous objective, and fair assessments. In fact it seems like only the powers that be that instigate the audit regime believe that numerical data can represent human activity effectively. Without such data, it would be difficult to legitimize decisions like closing schools or failing students. The audit regime has thus been called “governing by numbers” as its reduce complex processes to simple numerical indicators for purposes of management and control. All the while the overemphasis on data, statistics, and competitive rankings fuel an increasing infatuation with numerical data as the ultimate indicator of qualitative concepts like excellence, value, and effectiveness.The “data driven” instruction movement, which encourages teachers to use student test scores to drive their instruction, provides an example of how the fetishization of numerical data operates within the audit regime.
When students, teachers, schools, or entities have their value quantifiably judged they can internalize the standards of the audit as the standards they hold themselves to. Previous indicators may fall out of view as audit standards crowd the frame of what is considered success. In other words, audits govern in 2 directions. By quantifying social practices into narrow calculations, audits allow leaders to make decisions despite being removed from the context while also encouraging those who are being audited to take on its standards of success instead of their own. Of course, it cannot be denied that while audit regimes have been, on the whole, disastrous for public education in the United States, they have also contributed to some positive outcomes as well. For example, audit data has been helpful in highlighting the achievement gap between white students and students of color. They also have uncovered school board embezzlement of tax payer dollars.
How do audits perpetuate mistrust of teachers and schools?
Audit regimes, as a manifestation of neo-liberalism, assert economic rationality as the ideal model for structuring life. Economic ideals from the world of business such as competition and growth are championed while social ideals such as equality and justice are viewed as inefficient and unnecessary. This has contributed to a general mistrust of public institutions. This is because the traditional goal of such institutions to serve the common interest have been replaced instead with goals from the business world which focus on efficiency and performance. In turn, audit regimes perpetuate the general impression among the public that public institutions, such as public schools, are usually inefficient and in need of competition for any improvement. Students, teachers, schools, districts, and even entire country’s education systems are continually cast as teetering on the brink of failure thanks to their perceived laziness and ineffectiveness. Within this atmosphere, audits are put in place with the promise of restoring professional competence with the help of outside experts.). As a result, audits undermine the expertise of local educators and diminish the democratic underpinnings of public education. But, I believe that all this can change for the better if educators, equipped with the knowledge and a critical eye, become critically aware of the promises and pitfalls of the audit regimes and assert their rightful place at the educational table.
What are some other resources to learn more about audit culture in schools?
Barbian, E., Gonzales, G., Mejia, P., Christensen, L., & Au, W. (2016). Activism is Good Teaching: Reclaiming the Profession. Retrieved from https://www.rethinkingschools.org/articles/activism-is-good-teaching
Adams, R. (2018, November 5). 'Audit culture' causing staff burnout in schools, report finds. The Guardian. Retrieved from https://www.theguardian.com/education/2018/nov/05/audit-culture-staff-burnout-england-schools-department-for-education
References
Apple, M. W. (2005). Education, markets, and an audit culture. Critical Quarterly,47(1-2), 11-29.
Power, M. (1997).The audit society: Rituals of verification. OUP Oxford.
Rose, N. S. (2010). Powers of freedom: Reframing political thought. Cambridge: Cambridge Univ. Press.
Shore, C., & Wright, S. (2015). Governing by numbers: Audit culture, rankings and the new world order. Social Anthropology,23(1), 22-28.doi:10.1111/1469-8676.12098