Skip to content

I have been serving as the Rhetoric Consultant on the TATIL test since 2014, where one of my main responsibilities was to analyze the Framework in order to prepare the board to write outcomes and performance indicators. In this post, I will be giving a brief overview as to how I went about that process of understanding the Dispositions.

In order to be able to test for the Dispositions, or what the Framework calls the “affective, attitudinal, or valuing dimension of learning,” we needed to determine what kinds of latent traits sat beneath the surface-level descriptions of these Dispositions within the Framework. Studying the Framework, I was initially confused about the distinction between Dispositions and Knowledge Practices because many dispositions appeared to be bound-up with an understanding of core information literacy concepts. For example, in Information Has Value, the Framework says that competent students will “value the skills, time, and effort needed to produce knowledge.” The problem is that in order to value the time and effort required to create knowledge, students must first have learned what is involved in creating these kinds of texts; so, unless students are explicitly taught the multiple stages of forming research questions, collecting data, analyzing, and then synthesizing the information into a cohesive text, how can they have developed an attitude that values the rigor of this process? Thus, an important question emerged: How do we isolate the affective trait from the knowledge implied in the Dispositions?
Read more

There's still time to participate in field testing one or more modules this semester.  This is great opportunity to contribute to the effectiveness and rigor of the test.  If you're interested, please contact me (aprcunningham@gmail.com) or Rick Wiggins (rwiggins@carrickenterprises.com) to get started.

We continue to make strides in developing the test.  We've just completed cognitive interviews and usability testing for the third test module and we are writing items for the final module, 4: The Value of Information.  Thanks to our talented team of test question writers, we are making exciting progress.

I had a chance this month to check in with Carrie Donovan to find out what she's thinking about the Framework now that it's been a little more than one year since ACRL filed the document. Carrie is Assistant Dean for Research & Instruction Services at Ferris State University’s Ferris Library. She is a curriculum designer and facilitator for ACRL's Assessment in Action. She also serves as the ACRL Instruction Section Member-at-Large, and as the ACRL Liaisons Training and Development Committee Vice-Chair. Carrie has been a member of the TATIL Advisory Board since 2014.

I asked her the following questions and she shared her insights.
Read more

We are now ready to start cognitive interviews to get students' feedback about Module 3: Research & Scholarship.  We are also starting to write items for our final module, Module 4: The Value of Information.  That means we're more than half way through with test development.  And we just keep getting more intrigued with the depth of the Framework the more we work with it.

One of the exciting things about the Framework is the way the writers identified the “dispositions” that constitute the affective facets of information literacy. From the beginning of brainstorming about a new IL test way back in spring 2014, we’ve known that we wanted to address dispositions, as well as knowledge, in any new instrument we created. We found a way to do that with scenario-based problem solving items. And we’ve continued to deepen our understanding of dispositions by searching the education literature.
Read more

At the ALA MidWinter meeting this month, the ACRL Board of Directors formally adopted the Framework for Information Literacy.  At last year’s meeting, the Board filed the Framework, making it an official document of the organization.  By formally adopting it, the Board is signaling to librarians who might have considered their previous action to be ambiguous that the Framework is here to stay.  You can read more about the timing of their action at ACRL Insider.

In their post, ACRL’s president, vice-president, and past president acknowledge that there may be a role for standards or outcomes to be created in tandem with the Framework to support librarians’ ongoing assessment efforts.  That’s certainly what we’ve found by working on the Threshold Achievement Test of Information Literacy.  We’ve spent a lot of time developing and refining the outcomes and performance indicators that we use as the skeleton for our test.  These guide how we create test questions because they describe the understanding, critical thinking, problem solving, and dispositions we expect students to demonstrate on the test.  We’re excited to see how the ACRL leadership and membership work together in the coming year(s) to define additional outcomes.

If you haven’t checked it out already, visit ACRL’s Framework for Information Literacy blog, where Donna Witek is posting weekly links to scholarship related to the Framework.

I presented a session at LOEX Fall Focus on Friday, November 13, about our analysis of the Framework and our work on creating dispositional items along with knowledge items for each of our modules.  I was honored to get to represent the efforts of our Advisory Board members and consultants, some of whom have been working on the test for more than a year and a half already.

DSCF7633

We got a great crowd at my session, including librarians who were new to the Framework as well as people like Merinda Hensley, Sharon Mader, and Lisa Hinchliffe, who’ve been thinking about IL standards, frames, and concepts for a long time.  It was great to hear from librarians who are interested in trying out our test.  I also was energized by feedback I received from several librarians who felt that we were contributing useful ideas to the larger discussion about assessing IL through the analysis we’ve done to develop outcomes, performance indicators, and situational disposition item scenarios that are inspired by the Framework.

The image below is a link to the pdf of my presentation slides.  Please email me if you’d like any additional information about what I discussed.

loex slide title

After my session, I had the pleasure of chatting with a few colleagues who asked critical questions, offered constructive observations, and generally got me excited to get back to writing new items and refining our outcomes.  Because I was so involved in the discussion, I missed the second breakout session.  But the following are my reflections on all the other sessions I got to attend.

It was a wonderful conference!  Thank you, Brad Seitz, Teague Orblych, Bill Marino, and Ben Oberdick, and all of the other conference volunteers, for making it a fantastic event.
Read more