Here’s just a quick update about what we did in April with the Threshold Achievement Test for Information Literacy, since we’re busy writing test items and enjoying the spring weather. 🙂
We’re happy to introduce Michelle Dunaway and Lettycia Terrones as the two newest members of our Advisory Board. Michelle is a librarian who is currently pursuing a PhD in Education Evaluation & Research at Wayne State University in Detroit. Lettycia is the Education Librarian at Cal State Fullerton and she was a high school English and ESL teacher for seven years before becoming a librarian.
The advisory board members have been drafting and refining performance indicators for the first test module we’re developing. Here’s a sampling of some we’re working on:
- Identify reasons for selecting sources that represent a variety of perspectives, values, and judgments.
- Distinguish when it is appropriate to use a primary scholarly article versus a review article.
- Arrange a sample set of sources into their appropriate positions on the information cycle.
- Match descriptions of audience values to descriptions of the authorial expertise they would find most authoritative.
And if you’re interested in learning more about the test development process and research-based item formats, we recommend the following books that have been influential to us so far:
- Downing, S. M., & Haladyna, T. M. (2006). Handbook of test development. Mahwah, NJ: L. Erlbaum.
- Haladyna, T. M. (1997). Writing test items to evaluate higher order thinking. Boston, MA: Allyn and Bacon.
- Haladyna, T. M., & Rodriguez, M. C. (2013). Developing and validating test items. New York, NY: Routledge.
We're looking forward to an exciting summer. Keep checking back for updates. 🙂
In March, at the ACRL Conference in Portland, Carrick Enterprises sponsored an exhibit booth. Rick, Carolyn, and their colleague Paula McMillen fielded questions about the Threshold Achievement Test. Many librarians from institutions as varied as chiropractic colleges, state universities, and community colleges from across the country expressed interest in taking part in the field test scheduled for this fall.
The field test will generate data that we’ll use to set criteria for scoring the test and will give us the chance to analyze individual items. It will give the participating institutions a snapshot of their students’ information literacy knowledge practices and dispositions.
But the discussions at the booth weren’t all business. Attendees also got to take a Facebook-style quiz to reveal which of the IL frames best matched their personality. If you missed your chance to take the quiz and find out if you know yourself, your friends, and the Frames as well as you thought you did, then plan to stop by the Project SAILS, Carrick Enterprises booth at ALA in San Francisco at the end of June. And as you check out everyone’s name badges, look for their Threshold Achievement Test stickers that proclaim their Frame.
February has been a pivotal month for the Threshold Achievement Test, as we've transitioned our focus from defining Information Literacy concepts and dispositions to bringing those concepts to life as test items. The item writing taskforce spent February drafting our first ideas for test questions and we took steps toward identifying a workflow for the process going forward. Thanks to the dedication of volunteers from the advisory board we’re getting the chance to try out many types of test questions and many ways to gather evidence of students’ IL knowledge, experiences, and values. The item development process will continue throughout March.
Also in March, Rick Wiggins and Carolyn Radcliff, along with other representatives from Carrick Enterprises, will be sharing news and answering questions about Project SAILS and the new test at the ACRL 2015 Conference in Portland, OR. Rick will be available to provide additional updates on the next steps in our test development, including preliminary plans for identifying colleges and universities that are interested in beta testing modules of the new test as early as fall 2015. If you think you might be interested, stop by the exhibitor booth to learn more or contact Rick. We hope we’ll see you in Portland!
We’re pleased to hear that on February 1, the ACRL executive board voted to file the Framework for Information Literacy for Higher Education. This decision confirms the value of our efforts to envision a new approach to assessing students’ information literacy. The richness of the Framework and its alignment with librarians’ ongoing efforts to engage information literacy’s deep questions and troublesome knowledge, serve as inspiration to our advisory board as we advance to the next stages of test development. At the same time, we are glad that a final decision about the future of the Standards will be made at a later date, once librarians in the field have had ample opportunity to apply the new Frames and fully explore their strengths and limitations. We see our test development efforts as one facet in this wide-ranging project of investigating the affordances of the Framework.
In January, the advisory board studied the final version of the Framework. We found that the performance indicators and outcomes that we drafted in the fall closely matched many of the concepts described in the Framework. Reviewing the frames again inspired us to organize our extensive lists of indicators into core components of our key IL concepts. After further refining our lists of information literacy practices and dispositions, we defined four modules for development.
A taskforce of advisory board members formed to write test items that will take advantage of HTML 5 capabilities to experiment with a variety of innovative item types. If you’re looking for more information on innovative item types, you’ll find that Christine Harmes, Cynthia Parshall, and Kathleen Scalise have developed helpful taxonomies. The item writing taskforce is now engaged in the iterative process of writing items and performance indicators. Based on what we learn from the process of writing our first module and doing preliminary usability studies with our early item prototypes, we will begin writing items for the three remaining modules in the spring.
We're really excited about our latest progress and we're looking forward to updating you again soon!
Happy New Year!
In December, despite the hectic pace of the end of the semester, the Advisory Board reviewed lists of knowledge practices and dispositions that we created throughout the fall. This review was the next step in our process of defining the elements of information literacy that this new test will assess.
At our meeting on December 19, the Board discussed how the draft Framework for Information Literacy for Higher Education can guide our decisions about the behaviors, knowledge, and values we’ll ask students to demonstrate on the test. Advisory Board members are now working in small groups to further refine our definitions and prepare the guidelines we need to have in place in order to start writing test items in February.
This month we also made a major step forward in the process of selecting a name for the new test. Watch this space for exciting announcements!
At ALA MidWinter in Chicago we expect to hear that the Framework for IL in Higher Education has been finalized and our Advisory Board members in attendance at the conference will be meeting face to face (some of us for the first time).
We’re looking forward to having a fantastic 2015! We hope you are, too.