Harvesting from UIUC

UIUC Harvesting

Background

• Voyager
• 2 record system – xref on 856
• Building shared repository for CIC/Google
  • Not sure whether dark or access
• 2 Handles servers
  • IDEALS
    • UIUC published materials
    • Dspace
  • Digital books

• World Fact Book
• Historical encyclopedia of IL

Harvesting Process

• Start in IA Metamanager
• Ask for all UIUC items in reverse chronological order
• Check items interested in harvesting
• Export to tab delimited list
  • Includes server location
  • Manual processes to this point
• VB programs reads file
  • OCAScripts-UIUC2.zip
  • DownloadOCA.vbs
  • DispatchOCA.vbs
• Launched at night
  • Generally 25 books/workstation/night
    • Have run 2 at once
• WGET grabs files
  • Logged to SQL Server
• Files saved locally
• Secondary process to copy files, create Handles
  • Org-specific processing
• Provide a Handle at the title-level
• ILS points to titles
  • Items not cataloged yet
  • Digital library interface provides item-level access

Requests from IA

• RSS to include server location
• Fat pipe for retrieval
  • ½-1 hr at night
  • 3 hr during day
  • What happens when volume increased; European scanning

• Lacking detailed info
• Defined in site…somewhere