Home About Hours Libraries For Schools For Libraries Help

Blogs

chat session length for different librarian groups

I was curious to find out if the length of a chat session was different depending on which group the librarian belongs to.

Who Time
KnowItNow 8:42
AfterDark 12:07
Oregon 10:23
Average 11:00

I don't mean to imply that longer or shorter sessions are preferable. If virtual reference is a good experience for patrons, the longer they have to fall in love with their library, the better.

This is a bit lower than what we've reported in the past. According to a 2006 blog entry, session length then was 13 minutes and 35 seconds, and according to our 2004-05 report, it was 16 minutes. You can find me lots of times generalizing that chat reference takes about 15 minutes.

We don't really know what accounts for the difference. For sure, we have new software and it is "faster" than what we had with QuestionPoint. QP may have changed by now, but when we were using it, librarian and patron screens checked for new messages only every 6 seconds, meaning that each message was delayed on average 3.5 seconds.

That wouldn't account for the whole two minutes, even if we pretended that all messages were read right away and the librarian and patron were never multi-tasking. With QuestionPoint, conversations were about 18 messages long, so that would account for about a minute of time difference. If we pretended.

There is less pressure to connect with patrons who are waiting because we don't see that they are waiting. Part of it may be less dead time during the middle of the session. Maybe some of us are just getting good at virtual reference. Maybe some of us are getting bad at it and patrons are disconnecting sooner.

The only thing we can say for sure is that the sessions are shorter.

followup on pranks

A few months ago, I wrote that we would be using a 'prank' queue to identify patrons coming from IP addresses that had been associated with the 'prank' resolution code in the past hour.

You can read up on that link to find out how it works and why, but the main idea is to save librarians from the trouble of dealing with repeat pranksters, or at least to warn them.

I checked today and found out, since we added the queue system on March 12, librarians have used the Prank resolution code 310 times.

+--------------+-------+
| resolution   | count |
+--------------+-------+
|              |    16 |
| Completed    |  3570 |
| Disconnected |   740 |
| Followup     |   465 |
| Prank        |   310 |
| Test         |    33 |
| Transferred  |    68 |
+--------------+-------+

Of those, 61 came in the 'prank' queue, meaning they were repeat pranksters within an hour. That doesn't seem very significant - 61 of 310 questions (20%) coded 'prank' came within the hour of another from the same IP address.

+----------+--------+
| queue    | pranks |
+----------+--------+
| academic |      3 |
| lnet     |    246 |
| prank    |     61 |
+----------+--------+

Keep in mind we sometimes questions don't export right after they are finished, so some repeats might have snuck in on the regular queues before we got the resolution code from the first session. I am going to call this at least 20%.

I also looked at the resolution codes used for questions in the 'prank' queue.

+--------------+-------+
| resolution   | count |
+--------------+-------+
| Completed    |    98 |
| Disconnected |    42 |
| Followup     |     1 |
| Prank        |    61 |
+--------------+-------+

Almost half of the questions coming into the prank queue were coded 'Completed', indicating that they weren't questions from repeat pranksters after all. The percentage of the time they were coded pranks is significant though - 249 of 5,000 (5%) of questions in the 'lnet' and 'academic' queues were coded prank, compared with 61 of 202 (30%) in the 'prank' queue. There is also a higher rate for the 'Disconnected' code, 20% as opposed to 15%.

There are three ways we can go from here:

  • Leave this system in place
  • Scrap this system
  • Adjust the parameters of how we define who should go in the 'prank' queue. We could change the amount of time we label an IP address, look at other parameters, etc.

My main question for L-net staff is, does it help you to know that a patron might be a prankster?

patron accounts

We are experimenting with letting patrons have accounts on this site so that they can save and manage their chat interactions. Instead of every patron being a one-time visitor (no matter how many times they've visited our site), librarians will be able to look up the patron's prior interactions.

I made a short screencast about this what it looks like on the librarian side:

http://www.oregonlibraries.net/system/files/patron-accounts-librariansid...

The first group of patrons to have accounts are some middle school students in Southeast Portland. The idea is that we'll be able to provide them better service if we can have an ongoing relationship with them, if we can acknowledge they are working on L-net as part of an assignment, and if they can save, re-use and share their work.

In most chat reference interactions, librarians know very little about why patrons are looking for information and what they are going to do with it. Librarians' experience and patrons' experience intersects only at the reference question.

OCLC's QuestionPoint product is aptly named: there is no relationship here, only a point of contact, though in fact OCLC automatically creates an account for each patron. They just don't let you do anything cool with it.

As our service has grown, I've come across three types of patrons that I think would benefit from a more sustained relationship with reference librarians:

1) The researcher: Some of the first questions I answered on L-net were from someone researching the history of the Creationism/Evolution debate. It wasn't useful for her to reconnect to the service and do the reference interview over and over, only to be sent the same basic resources by each librarian.

Think of someone buying a house for the first time and all the questions they might have. It would be nice to be able to refer back to them.

2) The student: We've had over 1,000 questions this year with the word 'immigration' in them. Why? Because a whole class of students had an assignment on this topic this year and each student asked their question over and over.

This isn't pleasant for anyone. Librarians burn out, and students don't get help.

3) The contributor: Since going live with our conversation archive, about 20% of patrons have said they would let us make their question and answer public. People see value in what the library can give to them and they want to see other people benefit from it as well.

Instead of having patrons commit to receiving a transcript or not, patrons with accounts will be able to decide later if they want to keep, delete, or share their transcripts.

There are several other opportunities and stumbling blocks I want to touch on briefly. I don't mean to say that any of this will happen, just that I've been thinking about it.

The first opportunity is the discovery layer: Right now the demonstration highlights our site's Google Custom Search Engine, made up of websites that librarians have already shared with patrons.

But what if we could add articles from our statewide databases?

Downloadable audiobooks from Library2Go?

What about books from each patron's library?

What about answers to L-net questions?

It's true, many libraries offer federated search tools already, but we could bring it to all Oregonians.

The second opportunity is the social software layer. We could make L-net a social software site centered around the idea of asking Oregon librarians reference questions. You may have noticed already that patrons can tag questions in their accounts.

In that social software way, patrons could organize themselves into groups, share questions and answers with each other and contribute to answers themselves.

Our Drupal website is already set up to these things, we just haven't allowed patrons access to these features before.

Building on this idea, we don't need to make patrons sign up for accounts. We could authenticate them based on something else - their library card number or their FaceBook account. They could automatically share transcripts with their friends from FaceBook.

Instead of providing answers, we could be helping to facilitate a conversations around research and what library resources have to bring to it.

Another opportunity is the content layer.

If I'm right that this is a better way to work with schools, here is also an opportunity to pull together quick subject guides for patrons working on the same assignment. We could work with school librarians and teachers to build guides to online content, then when students logged in, they could see that guide available in their account.

But content might be valuable in other ways as well. Different types of libraries will be able to contribute different resources on the same subject.

What happens if we combine the collections of musical scores at Multnomah County Library, the University of Oregon and Jackson County Library?

What do a public library, a research library, a law library and a naturopathic medicine library have to say about medical marijuana?

We could host a killer genealogy page for Oregon. Oregon libraries have so much to offer Oregonians.

The major stumbling block I'm thinking of is kids. L-net is used heavily by kids, and if you haven't noticed, if you put kids and social software together, someone is very likely to scream "online predators!"

And it isn't that I believe that L-net would be used in this way, but I do imagine that we would have to meet the sometimes very-strict policies that schools have regarding using social software sites. If we're going to be helpful to kids, we have to consider these questions.

If these tools are valuable to kids, do we need to separate accounts based at schools from other accounts?

Do we need to ask everyone how old they are?

Do we need to be vigilant about reviewing contributed material such as comments and other communication between patrons?

I have some ideas about all of this, but I'm going to shut up now. I'd like to hear from you, whoever you are, about your ideas to make collaborative multi-type virtual reference better.

would you use this service again? it depends on the time of day

After patrons exit their chat, they are offered a survey which asks, among other things, "Would you use this service again?", with the options of Yes, No, and Maybe.

Between October 23 2008 and May 25 2009, patrons have answered:

Yes Maybe No Total % yes % maybe % no
2,161 366 217 2,744 79% 13% 8%

If we look at the hour of the day for each survey, we can divide the responses by who might have been answering.

6pm-6am: AfterDark staff
6am-9am: KnowItNow staff
9am-6pm: L-net staff

Caveat 1: those hours only work for Monday-Friday. I didn't break out survey results for weekends, so some of the KnowItNow and L-net responses actually belong to AfterDark.

Caveat 2: I don't know who survey respondents actually chatted with. The hour of the day they filled out their survey might be different than the hour of the day they submitted their question.

Time Yes Maybe No Total % yes % maybe % no
KnowItNow 119 23 31 173 69% 13% 18%
AfterDark 685 155 78 918 75% 17% 8%
L-net 1,357 188 108 1,653 82% 11% 7%

The purpose of this exercise was to determine if patrons saw things the way we do - that Oregon librarians are providing a higher quality of service than our partners and backup services. I always expect this to be true.

Rather than finger-pointing at 'bad librarians', I think these numbers show that we need to work harder with our partners to set the expectation for that high quality of service and to share strategies for delivering it.

Some of my favorites to start with are our rubric for quality in virtual reference.

maybe like a ninja and then a librarian

Paul Frantz from the University of Oregon passed on the link to this blog entry from the UO's "Ducks @ Oregon" blog, written by students. I guess it is sort of like reality TV for college admissions and alumni giving, but bloggy.

In Last Night a Librarian Saved My Life, Korrin B. writes:

I have to write two big research papers for finals this term (both joyously due on the same day - yippee!) and I feel a little better knowing that at any hour of the night, as long as I have an internet connection, I have a librarian by my side. And let me tell you, that is a good person to have on your side. Maybe like a ninja and then a librarian.

Way to go librarians!

Syndicate content