Wherein the IngentaConnect Product Management, Engineering, and Sales Teams
ramble, rant, and generally sound off on topics of the day
 

Consortial Networks and Publishers: Partnering in a Sea of Competition

Monday, March 17, 2008

The Electronic Resources & Libraries conference is taking place from tomorrow in Atlanta, GA. This is the conference's third year, and it's sold out - no surprise, given that it's a packed schedule with some strong speakers. Our own Jeff Downing (library relations manager) will be part of a panel discussion about the ways in which consortial networks can help libraries to retain "market share" in an increasingly competitive landscape. Here's a précis of Jeff's paper (which we published in last week's eyetoeye newsletter).

It is no secret: libraries face daily and ever-increasing competition. Within this sea of competition, however, publishers and regionally-based consortial networks are forging partnerships to develop creative, long-term cost-effective business models for content delivery.

Where is the competition coming from?
Competition for traditional library services is coming from all directions, but most obviously from the web, where consumer information is widely available and in many cases freely accessible. Wikipedia, for all its faults, has become a destination reference resource while other less well-branded sources of information are made easily discoverable by search services such as Google. Thus users are now able to self-serve much of the information that historically has only been available via the library or other paid services. But, of course, users are largely untrained in the skills of assessing found materials for authoritativeness, and in forgoing library assistance they are at risk not only of missing out on valuable paid-for resources, but also of basing their studies on incorrect data or ill-formed arguments. The convenience of internet research is substituting for the credible sources to be obtained from the traditional library.

What effect does this new competition have?
Historically, libraries have had the good fortune of being a monopoly; if you wanted access to information, especially authoritative information, you went to the library. Libraries had no competition and thus had no need to operate like a commercial business. As other resources become more prominent, libraries are having to re-envision and re-tool to operate in a more competitive environment. This is an attitudinal shift to which not all librarians are ready to adapt; the rigours of competition in a free market are not necessarily a welcome environment for those who have opted for an altruistic career assisting researchers in their information quest.

End of Chain of Craters Road, where it meets the lava flow (Volcano National Park, Hawaii)

Some people's reaction to the sea of competition?

How can libraries reinforce their value in the information supply chain?
Researchers continue to need to access quality, peer-reviewed information, and in providing this the library is making itself an essential tool in the academic arsenal. Libraries should take advantage of regional networks like Amigos and Palinet that can help by promoting libraries as information providers and community leaders, and by facilitating sharing of resources and development of innovative services. Networks may also be able to negotiate discounts of which members can take advantage when purchasing scholarly content from publishers or aggregators.

If you are attending ER&L, be sure to attend this session in order to add your voice to the discussion. If you would like to arrange an appointment with Jeff Downing during the event, please contact jeff.downing@ingenta.com - or stop by the Ingenta table at the sponsors' reception tomorrow night.

Labels: , , , , ,

posted by Charlie Rapple at 5:34 pm

 

Persistent linking, web crawlers and social bookmarking

Wednesday, March 07, 2007

Typically a web crawler, unless configured to use a separate index or crawling algorithm, will use the URL from which it retrieves some content as the entry in its search index. This means that anyone clicking on a search result will be taken to this URL.

Where a site has access controlled content and the full-text resides at a different location, this presents a problem. The site owner or publisher would like users to go to one page, e.g. the abstract, but will want the crawler to get the full-text. Making this work involves some dialogue between site owner and the search engine. For example the web crawler needs to use an alternate index or additional metadata to make the connection between the index entry link and the full-text retrieval link.

Some site operators, with approval, use a technique known as "cloaking" to achieve this. This involves serving different content to a web crawler, e.g. a PDF, than would be served to an end user, e.g. an abstract. Most search engines disapprove of this approach, but Google Scholar, for example has allowed it. This has caused some debate.

On IngentaConnect we use cloaking to serve content to some crawlers. But we no longer do this for Google Scholar. The reason for this is that Google were interested in obtaining the richer metadata that we include (as embedded Dublin Core) in abstract pages. This metadata, supplemented with the full-text, improves the quality of Scholar search indexes.

I thought I'd explain the fairly simple solution I concocted to achieve this and point out where the same technique could be used to improve another problem: persistent linking in social bookmarking services.

When the Googlebot requests an abstract page from IngentaConnect, it gets fed some additional metadata that looks like this:


<meta rel="schema.CRAWLER" href="http://labs.ingenta.com/2006/06/16/crawler"/>
<meta name="CRAWLER.fullTextLink" content=""/>
<meta name="CRAWLER.indexEntryLink" content=""/>


The embedded metadata provides two properties. The first, CRAWLER.fullTextLink, indicates to the crawler where it can retrieve the full-text that corresponds to this article.

The second link, CRAWLER.indexEntryLink, indicates to the crawler the URL that it should use in its indexes. I.e. the URL to which users should be sent.

The technique is fairly simple and uses existing extensibility in HTML to good effect. It occured to me recently that the same technique could be used to address a related problem.

When I use del.icio.us, CiteULike, or Connotea or other social bookmarking service, I end up bookmarking the URL of the site I'm currently using. Its this specific URL that goes into their database and associated with user-assigned tags, etc.

However, as we all know, in an academic publishing environment content may be available on multiple platforms. Content also frequently moves between platforms. The industry solution to this has been to use the DOI as a stable linking syntax. Some sites like CiteULike make attempts to extract DOIs from bookmarked pages, or resolve DOIs via CrossRef. But the metadata they collect is still typically associated with the primary URL and not the stable identifier. This presents something of a problem if, say, one wants to collate tagging information across services, or ensure that links I make now will still work in the future.

A more generally applicable approach to addressing this issue, one that is not specific to academic publishing, would be to include, in each article page, embedded metadata that indicates the preferred bookmark link. The DOI could again be pressed into service as the preferred bookmarking link. E.g.


<meta rel="schema.BOOKMARK" href="http://labs.ingenta.com/2007/03/7/bookmark"/>
<meta name="BOOKMARK.bookmarkLink" content="http://dx.doi.org/10.1000/1"/>


This is simple to deploy. It'd also be simple to extend existing bookmarking tools to support this without requiring specific updates from the owners of social bookmarking sites. If the tool found this embedded link it could use it, at the option of the user, instead of the current URL.

The only downside I can see to this is the potential for abuse: it could be used to substitute links to an entirely different site and/or content for that which the user actually wants to bookmark. This is why I think users ought to be given the option to use the link, rather than silently substituting it. If owners of sites like CiteULike or Connotea decided to support this crude "microformat" then they can easily deploy a simple trust metric, e.g. that they'll use this metadata from known and approved sites.

I'd be interested in feedback on this as its something that we'll likely deploy on IngentaConnect in the next few weeks.

Labels: , , ,

posted by Leigh Dodds at 3:41 pm

 

The Team

Contact us

Recent Posts

Archives

Links

Blogs we're reading

RSS feed icon Subscribe to this site

How do I do that

Powered by Blogger