MLibraryDatamart – Giving the people what they want:Spreadsheets – Build a data warehouse

View Github Repository Open presentation in a new window

billdueber

See all presentation from billdueber

MLibraryDatamart – Giving the people what they want:Spreadsheets – Build a data warehouse

0 0

c4l13_lightning_talk

Slides for my Code4Lib 2013 Lightning talk on Datamart

On Github billdueber / c4l13_lightning_talk

MLibraryDatamart

Giving the people what they want:Spreadsheets

Bill Dueber, University of Michigan

Demos 1 2 3 4

Problem 1:Generating reports is boring

  • I want to support data-driven decision making.
  • Canned reports tend to Not Do It.
  • So....drop into SQL to get information.

Problem 2:Aleph's Oracle tables

  • Example: The invoice number is in characters 21-35 of field z30_rec_key_3.
  • End up in substr hell

Solution:

  • Build a data warehouse(now we have two problems)
  • Build a query-builder and UI for it

Build a data warehouse

Thank you, Margaret Kelly and Talend software

Decide what to support

I have to do this by hand:

All records with fixed field lang=eng (008/35-37) and with “&” in 245 $a or 245 $b that also have one or more 246 fields, none of which contain the word “and.”

Decide what to support

Should I have to do this?

I would like to request a report for all items in: Sublib = AAEL, Collection = FUN

Please include Title / Author / Call Number / Barcode / Loans / Date last returned / Date item created

2mn demo

Worth it?

  • Up for a couple months
  • People running 20-25 reports a week
  • Waaaay more than we ran by hand...even taking messing around / messing up into account
  • Implication: people are asking more of their data. Good!

Thanks!

Bill Dueber

University of Michigan

bill@dueber.com

billdueber on twitter/github/irc