A Modest Proposal for the AAR’s Guidelines for Evaluating Digital Scholarship

The Sneetches. Do you know the story? Dr. Seuss’ story has stuck with me. Somehow, this is what came to mind when I read through the AAR’s draft guidelines for evaluating digital scholarship. After reading through the draft, I began to wonder whether appending “digital” to the work of a scholar is akin to the differentiation made between Sneetches with or without stars.

In brief: whose scholarship is, today, not imbricated with digital technologies?

The number of scholars who care to remember how scholarship worked whilst writing on a typewriter is fading fast. I would fathom that the vast majority of scholars working on topics relevant to the study of religion are doing so with tools that function via digital information processing. Such doings as noted by the draft guidelines are “to discover, interpret and disseminate information.” I wonder, then, does the term “digital” make a useful distinction for scholars of today and the future? I also wonder what purpose the term serves in the draft AAR guidelines.

The guidelines seek to set about defining digital scholarship in the midst of a broader conversation about scholarly merit. As I read it, “digital” serves to function as a placeholder for “non-traditional” or “unconventional” in the draft guidelines. The terms that are used in the guidelines serve to construct a binary between scholarship that is “collaborative”, “multimodal” and “open-ended” versus scholarship that is “single-author”, “print” and “finished”. I am reading these as background assumptions which make authenticity claims that, I think, add unnecessary noise to discussions about the attributes of scholarship.

The draft guidelines do deploy these triads of terms to offset digital versus non-digital scholarship. I am unsure that scholars of religion would always be pleased to characterize even their single-author work as lacking collaboration and open-endedness. As the acknowledgements in many monographs will show, scholarship typically results from ongoing conversations across a variety of modalities. The guidelines therefore seem to either open with a non sequitur or set up a straw figure to be distanced from the single-author, printed and finished baseline.

The suggestions for the evaluation of so-called digital scholarship likewise seem to me as ones that should be among those applied to all other forms of scholarship. Every scholar should consider what “the medium enables that would not be possible in other formats.” I converted the criteria from the section on design (II.a.3) into point-form in order to consider whether they should be applied to every scholarly production:

  • Clarity and effectiveness of interface design.
  • Ease of identifying and accessing information.
  • Ease of navigating the resources.
  • Adherence to established standards of accessibility.
  • Ease of use for all users.
  • Coherence between the design and the argument of the project.

Any scholarly work that lacks these attributes is probably flawed. Every scholar should be able to articulate why one means of demonstrating scholarship was chosen over and against the other options now available. There must be a thousand ways to explain why someone chose to write a single-author work in print whose argument is considered finished. Why was that mode of dissemination chosen rather than others?

And so I would suggest that these guidelines be pitched as a statement of general expectations rather than simply directing them to those who do “digital” scholarship. Fulfilling these attributes-cum-criteria thereby helps any scholarly production succeed in the parameters of evaluation set forth by the proposed guidelines. In such a case, then, I would suggest that these guidelines be revised to clearly state that the document sets the bar for what is expected of contemporary scholars of religion. Whomever expects to be counted within today’s academia needs to establish capabilities to be conversant in the variety of environments for the production and presentation of their colleague’s scholarship.

My suggestion is to revise these guidelines as a statement on the general professional development of scholars who live in a world where being “computer-savvy” is a basic requirement. I have already suggested something along these lines. So, to turn the guidelines around, let’s ask a different question: who may be excused for limiting their academic literacy to single-author, finished works in print? For that, I think, no academic should be getting a proverbial “star on thars.”

N.B. The entire constituency of the AAR should pay close attention to the sections on “additional evaluative sources” and “promotion and tenure” (e.g. II.c.1 and the fifth and sixth bulleted points of III.b.).