Pardon my French

News is flying around the blog-o-sphere that the French have given up their fight against Google Books and have decided that they will embrace the Google Solution. This is simply not true, based on my reading of the "Rapport Tessier". Admittedly, my French is mediocre at best, but here's my reading of what is actually said in this report (with some quoted bits in case I've misunderstood).

Flash: Thanks to Jean-Marc Destabeaux, there is a translation of the executive summary (pp 38-41). Note that I also edited that text, so any beefs or corrections should be sent to me. Ditto take-down notices.

Among other solutions (continuing to develop Gallica, and continuing to contribute to the European digital library, Europeana), the report suggests that a partnership with Google that respects the role of the French National Library (BNF) MAY be possible. No such deal has been struck with Google, as far as I can tell. The report is an in-depth summation of the need for a digitization program in France, as well as the problems.

It is important to note that the role of the BNF is something that that does not exist in the US. The BNF is the official keeper and protector of the French cultural heritage, as far as intellectual products are concerned. The Library takes this role very seriously. France has a mandatory deposit law, and the BNF strives to have a copy of every book, journal, etc. ever published. France has a law that gives BNF the legal right to digitize its holdings for the purpose of preservation. It also has an orphan works law that specifically gives the BNF certain rights, although this report says little about the nature of that law.

I read the report as an excellent analysis of the many ways in which Google Books is at odds with the mission of libraries.

Une réponse inadaptée au regard des missions des bibliothèques

Preservation, equality of access, privacy... Google's program is lacking in all of these areas. The commercial goals of Google and the public goals of a national library are essentially at odds.

To me, the main thrust of the report comes from this:

Les bibliothèques françaises - en particulier la BnF - disposent d’atouts importants, qu’il ne faut pas sous-estimer dans le cadre d’une négociation avec un partenaire privé. (p. 17)

What this says is that libraries have a strong negotiating position with Google (that I think the authors of this report feel has not be fully exploited) because of the incredible value of their holdings. You could say that libraries have a monopoly of their own. Yet they seem to have traded their holdings for fairly meager returns in the contracts with Google.

The report talks about the need to make library materials findable on the Web, primarily through search engines. (p. 62) Gallica and Europeana are typical databases, part of the dark web. Google books are keyword indexed in Google, but not findable through other search engines. BNF does not want its "patrimony" bolstering a single commercial search engine, and one source of access is not enough -- if the library is to be available, it must be available generally.

S’il y a un rapport étroit entre Google et Google Livres, il reste que Google ne peut être considéré comme une modalité d’accès suffisante aux contenus de la bibliothèque numérique.

There is a section of the report on public/private partnerships. I believe that this is the source of the rumors, because it does suggest that a partnership with Google could be possible. That partnership, however, must respect that essential mission of the library.

- proposer à la société Google une autre forme de partenariat, fondé sur l’échange équilibré de fichiers numérisés, sans clause d’exclusivité ; (p. 38)

"... a different kind of partnership..." The "exclusivity" clause referred to relates to the contractual clauses that do not allow the participating libraries to share the files with third parties without Google's approval. Instead, the BNF proposes that such sharing must be allowed if libraries are to partner with Google so that they can make full use of the digital files to fulfill their mission.

L’autre difficulté tient à des limitations explicites, qui peuvent brider les initiatives de la bibliothèque pour renforcer l’accessibilité à son patrimoine numérisé. Ainsi, la bibliothèque ne peut partager ou fournir le contenu numérisé à une tierce partie sans avoir obtenu préalablement l’autorisation de Google... (p. 16)

I could go on and on, but I really hope that someone will translate this report (or at least the executive summary) because it is an excellent summarization of vast difference in goals between Google and libraries. It discusses the downsides of mass digitization, and proposes a mixed solution between mass digitization and curated digital collections.

La numérisation de masse est une voie possible, mais non exclusive, de la numérisation ; ses contraintes et ses limites, tout comme ses indéniables apports, doivent être aujourd’hui intégrés à toute réflexion poussée sur ce qui constitue les missions historiques des bibliothèques patrimoniales, tant en termes de conservation que de valorisation. C’est une des conditions nécessaires pour ne pas perdre le fil du débat.

Girls are still icky

In 1996 I wrote a piece that was published in a book called Wired Women about the gender gap in computer advertising. (Online version) At the time, the computer world was so awash in testosterone that the back pages of computer user magazines, like PC Magazine, were mainly adds for pornography. The message for women was clear: No Girls Allowed. Like this postcard ad for a mid-1990's bulletin board system, which said on the back:

No wasted time.
No garbage.
No noise.
No irrelevant clutter.
For serious computer programmers and developers, BIX is the exclusive online club.

And one could add: no girls allowed.

I thought all of that was in the past, but ... nooooooooo. This Verizon Droid ad is just an updated version of that 1996 BBS advertisement.


Not only should the phone not be pretty (so maybe Ugly Betty would be acceptable), but it is not a "tiara-wearing digitally clueless beauty pageant queen" and, as the women puts on her lipstick in the street, "it's not a princess, it's a robot." I don't want to go so far as to assume that the attack on the fashion-plate male manikins equals homophobia, but the ending salvo of "It trades hair-do for can-do" is eerily reminiscent of the image above.

1923

The Google Books Settlement is causing a great deal of previously unexpressed bibliographic interest -- just how many books are there in the known universe? How many are published in the four countries now included in the settlement agreement? (US, UK, Canada, Australia). And how many are in the public domain?

Lorcan Dempsey and Brian Lavoie have recently published an article in DLib that looks at these figures using the world's largest database of bibliographic data, WorldCat. The data is fascinating, but I have already seen it mis-interpreted, so I thought some clarification might be useful.

Dempsey and Lavoie are very clear that what they are measuring is "Manifestations." Folks outside of the library environment are unlikely to know what that means, therefore it is important to clarify what the numbers in the Dempsey/Lavoie article represent. Each “book” that is counted represents a published product at about the same level of granularity that today would be given an ISBN. Therefore if a publisher re-issues a book in their backlist after the previous print run has been exhausted (say, a decade later) and with a new introduction, it is considered a different book. The publication date that is fed into the study is the date of the new issuing of the book. Also, as publishers re-package and re-print public domain books, these also are considered separate products with new ISBNs and new dates.

Thus, if you look up a commonly re-published book like “Moby Dick, Or The Whale” in the Library of Congress catalog, you retrieve 40 items (and more if you use the short form of the name, simply “Moby Dick”), of which only one is pre-1923 — that one was published in 1851. Of the other thirty-nine instances of the publication of the work, which range from 1925 to 2006, some contain what GBS called “inserts” - that is, separately copyrightable intellectual property in the form of introductions, etc., but others may be a straight republication of the text. If you do the same lookup in FictionFinder, a work-based view of a portion of the WorldCat database. you find:

823 editions of "Moby Dick" (which combines the various versions of the title)
534 of which are in English

of these:

9 have an unknown date
60 have a date of 1923 or earlier
465 have dates after 1923

Looking through the list on FictionFinder it is easy to see that there are some duplicate records, both in the pre- and post-1923 entries.

Therefore, the question we now need to answer is: how many public domain works have been republished after the 1923 cut-off date?

Google appears to currently lack the ability to make the proper connection between the original text that is in the public domain and the many “manifestations” (as they are called in library-speak) that were published later — and are also in the public domain, at least as far as the primary text is concerned. This is a non-trivial exercise when one is working only with the metadata that describes the work, but may become more feasible with the ability to do a full text analysis of the contents of the various packages in which publishers have placed the original work of Melville. I assume that Google is working on this, although I cannot predict how it will affect their assessment of the PD/(c) split.

What is clear, however, is that Google is going to need to identify Works (if not strictly in the FRBR sense, then at least in the sense that meets some definition that is valid for copyright law).

Amended Google/AAP Settlement

The amended settlement has been issued (the best way to see the changes is in the redline version). I will summarize here the changes that I see as having the greatest impact on libraries and on the public. For legal issues, I suggest James Grimmelmann's blog. For business issues, probably the NY Times and Wall Street Journal.

Foreign Works Mostly Excluded

Undoubtedly due to the many complaints from foreign rights holders, the settlement now only includes (oddly enough) US, UK, Australian and Canadian works. This would include, as I interpret it, translations of non-USetc works published in those four countries. This greatly changes the value of the institutional subscription for higher education, as well as the value of the 'research corpus' (essentially a database of the OCR'd texts that researchers can use for computational research).

Since we know that information seekers prefer accessing works online rather than in hard copy, I anticipate that the online service will be very popular. But it will contain almost exclusively these Anglo-American products, a narrow swath of the intellectual output of the planet. As it is, too many Americans are unaware of the world outside of those Anglo-American borders. This will just exacerbate that problem. It could change the content of of education and research. As I've said before, availability is a significant determinant of what intellectual materials people use in their research.

Particular to Libraries

In general, the sections on libraries (both participation and use of the digital copies) remain unchanged. There are a few minor changes, some of which are puzzling.

Public Libraries

The statement about the free access for public libraries has been changed from:

in the case of each Public Library, no more than one terminal per Library Building

to

in the case of each Public Library, one terminal per Library Building.; provided, however, that the Registry may authorize one or more additional terminals in any Library Building under such further conditions at it may establish, acting in its sole discretion and in furtherance of the interests of all Rightsholders.

So it leaves the options open for giving some public libraries additional (free?) access. Still, there is no information on whether or how public libraries could subscribe in a way that would allow them to fully serve their communities.

Microforms

The definition of "books" that could be digitized originally included microforms. The word "not" has been added:

hard copy (not including microform)

No idea why, but perhaps a look at the comments will reveal one from UMI or some other party related to microforms.

[Found it: The ProQuest letter states that dissertations should NOT be included as they are controlled through ProQuest's dissertation service. The letter mentions that some dissertations are in microform format, but that today many are available as print-on-demand or online. Although microforms were excluded, p. 327 of the redline document states:
"What Material Is Covered?
"Books” include in-copyright written works, such as novels, textbooks, dissertations, and other writings...".
So ProQuest did not get what it asked for.]

OCLC Networks

The original settlement had a strange exception that removed OCLC networks from the definition of "consortium":

"Institutional Consortium” means a group of libraries, companies, institutions or other entities located within the United States that is a member of the International Coalition of Library Consortia with the exception of Online Computer Library Center (OCLC) - affiliated networks.

That exception has been removed. I would love to know why it was there in the first place, but can only assume that one or both of these requests came about because of participation by OCLC in the settlement discussions.

[Note: I discovered that Lyrasis and Nylink filed an objection about this exception, which may be why it was removed. Their analysis was that it had come from OCLC and gave OCLC the ability to manage competition by determining which organizations would be excluded from participating in the business of brokering services for libraries. They assume that OCLC hopes to be in that business itself.]

Download Formats & Course Packs

In the original settlement, the only download format mentioned was PDF. As we know, since then Google has announced that it will provide e-books from the publisher partner content that it carries on GBS. Ebook formats have been added in to the settlement as possible download formats. At the same time, the product line described as:

Custom Publishing - Per-page pricing of Books, or
portions thereof, for course materials, and other forms of custom
publishing for the educational and professional markets

has been removed.

Other?

There are complex changes to the treatment of orphan works which I have not tried (yet) to absorb. Those will undoubtedly have some impact on libraries and the public but at the moment I have no thoughts on that.

The settlement now allows rightsholders to place a Creative Commons license on their works. I really don't see a great deal of significance in this, although it does emphasize that by participating in GBS your rights are now governed by contract law rather than copyright law.

And, last, Google admits to some of its own difficulties in bibliographic control when it states that "The inclusion of a work within the Books Database does not, in and of itself, mean that the
work is a Book within the meaning of Section 1.19 (Book)." In other words: we threw a whole bunch of bib records into a database; don't assume anything from it.

Googled

Waiting for the next round of Google/AAP/AG settlement prose (which was due today, November 9, but has been moved back to Friday, November 13, when the parties will presumably present it to the judge), I have read Ken Auletta's book "Googled: the end of the world as we know it." It's mainly a business book, and primarily about media and advertising. I can sum up what it says about Google in three statements:

1. Engineering can fix anything
2. Information is neutral and measurable
   
3. Advertising is information

OK, maybe that's a bit overly concise, but that is what it boils down to. I've often wondered how your motto can be "Don't be evil" when you are in the advertising business. It obviously works if you consider information to only have meaning based on numerical measures, and that advertising is just another kind of information. This engineer-based mentality as the guiding principle of the largest, richest advertising company in the world falls somewhere between Ayn Rand's objectivism and Bernie Maddoff's ponzi scheme. About 50% of Google's employees are engineers, and engineers, on average, earn twice what non-engineers earn.

Google has ramped up the advertising game by orders of magnitude, destabilizing huge, long-lived media companies, and it's all based on... winners win. Google sees its role as matching up users with things they are seeking, whether it's web sites, books, or a place to buy sneakers. It doesn't matter to Google what the information is.

There is something creepy about the way that Auletta refers to SergeyandLarry as "the founders." It sounds almost... cult-like. The fact that the book treats the founders and CEO Eric Schmidt as a three-some is just way too trinitarian for my taste.

Objecting to GBS/AAP/AG Settlement

ALA Washington Office has posted an analysis of who filed comments/briefs to the court relating to the Google/AAP/AG settlement. Of the "class member objectors," e.g. authors and publishers, 82 US parties filed objections. Astonishingly, there were 295 objections filed by foreign "class members," including the publisher organizations in a number of countries. The objections range from the seemingly trivial (the poor quality of the translations of the notice that were provided) to concrete descriptions of how the settlement violates the rights of rights holders under the Berne Convention. I'll sum up some of these objections:

1. The class -- members of the class were not given sufficient notice, nor were they able to read the actual settlement documents, which were not provided in translation.
2. Moral rights -- Berne includes moral rights, that is the right of the author to control the use of ones' work. This is interpreted quite liberally in some countries, to include things like cover images used in sales, metadata, etc. While these may seem unimportant, the Italian publishers' organization AIE was horrified to find one of its newsletters listed with an author of "Fascist Federation of Publishers". This was a previous name of the organization, but was found offensive to the organization.
3. Registration requirements -- Berne states clearly that "... exercise of these rights shall not be subject to any formality..." It was this aspect of Berne that ended the copyright registration requirement in the US. Objectors claim that the need to register with the Books Rights Registry violates this aspect of Berne. The logic being that you are the copyright holder regardless of any action you take to assert that.
4. Definition of "out of print" -- This is probably being revised by the main parties, but the original settlement document stated that "Google will use the publishing status, product availability and/or availability codes to determine whether or not the particular database being used considers that Book to be offered for sale new through one or more then-customary channels of trade in the United States." Various objectors were able to show that Google's determination (as available in the database managed by Google today) was wrong in a majority of cases.
5. Definition of "in print" -- This one also might be undergoing revision. The settlement defines "in print" as "be offered for sale new." Some objectors pointed out that there are books that are free, that are online for open access, etc. The argument is that these cannot be considered out of print.
6. Representation -- None of the foreign class members consider either the AAP nor the AG to represent them. Some ask that there at least be foreign class members on the board of the Rights Registry. Others simply consider the class membership to be invalid.
   
7. The burden on publishers -- The burden of identification has been placed on publishers. For a publisher with an active list of titles, this could be a considerable amount of work. Google offered that if publishers would provide ONIX metadata, they would do an automated matching against the database. Apparently this has failed to provide relief, most likely because of differences between the publishers' metadata and that of Google.
8. The effect of secrecy -- Because Google works heavily in "trade secret mode," it is very difficult for the rights holders to find and diagnose problems relating to their works. Yet the settlement does not hold Google accountable for errors in the data.
9. Privacy -- the EU has rather strict privacy rules. This argument is a bit contorted because at the moment there is no plan to allow EU users to access the books covered by the settlement, since the settlement is only valid in the US. But at least one objector acknowledged that users would gain access by going through US proxy servers. It isn't clear to me if one can apply local law when masquerading as someone else through a proxy.
10. Local digitization laws -- At least one country, Germany, has made provisions for library digitization of works (and in-library access) which requires that the library obtain permission from the rights holder. This objection is a bit indirect, but it seems to be one of indignation that Google could be digitizing works that the national library of the country where the work was published cannot.
    
11. Censorship -- Many are concerned that Google may eliminate books from its service "for editorial reasons" without having to justify itself. This is an interesting and difficult argument -- it's like saying you're against the service, and you're afraid it won't have everything. It makes sense, however, because if Google becomes the predominant access to books in the US and it could censor without recourse, that a single company gets a great deal of control over both information and culture. There should be more objection to this from within the US.
    
12. General moral and cultural indignation -- I read about a dozen of the foreign objections. In some cases, I may have been reading into the text an undertone of moral and cultural indignation. Not in the case of Germany and France, however, who were quite clear on their objection to the monetization of their cultural heritage. Here are some quotes:

"... the proposed settlement homogenizes (or "Googlizes") and demeans those special elements that distinguish the unique cultural tradition of France by turning books into a merely industrial by-product of a computer database."

"France's concern for its authors is only heightened by the proposed settlement's shroud of secrecy and hint of an uncontrolled, autocratic concentration of power in a single corporate entity, Google, that generates more revenue than many countries."

"The Federal Republic of Germany is historically called "Das Land der Dichter und Denker" (the land of poets and thinkers). ... Germany can rightfully claim the mantle of birthplace of modern printing and publishing. ... [the settlement] will flout German laws that have been established to protect German authors and publishers... creating a new worldwide copyright regime without any input from those who will be greatly impacted -- German authors, publishers and digital libraries and German citizens who seek to obtain access to digital publications through the Google service. "

OCLC and "Competition"

The announcement of a new company, SkyRiver, providing cataloging services to libraries has sparked a number of comments about competing with OCLC and WorldCat. For a number of reasons, I don't think that the result of such a service is necessarily competitive, although I am very glad to see alternatives enter the marketplace, especially for those who do not use OCLC.

To begin with, OCLC is more than an online cataloging service. Admittedly, revenue from cataloging is OCLC's largest income source, so cataloging is not in any way just an incidental function from OCLC's point of view, but cataloging alone is not the point or purpose of OCLC to its users. I see OCLC as a kind of social network where the "beings" are libraries. The value of OCLC is directly related to the population it encompasses, and the social services it can provide based on that population. Shared cataloging copy is one service, but discovery and delivery options probably motivate OCLC members as much or even more than the cataloging effort. This was evident when RLG still existed, as some RLG member libraries who did their cataloging in RLIN also loaded their records into WorldCat in order to participate in the services that OCLC provided.

The value of the catalog copy on OCLC may be second to the value of the holdings information that OCLC maintains. Catalog copy, if that's all you want, can be found in innumerable library catalogs (including the Library of Congress), and some library systems allow you to export or retrieve a full MARC record that you can then add to your own catalog. Catalog copy can also often be found on the retro of the title page in the form of Cataloging in Publication (CIP), although not in MARC format and not as a complete record. But no one else, and no other service, has the combined holdings of some 60,000 libraries, and that's the main thing that OCLC brings to the table. It is only because of these holdings that WorldCat has value to individual searchers and to the libraries who serve them.

The view of OCLC as "the only game in town" for library cataloging ignores the fact that there are libraries who do not participate in OCLC, for a variety of reasons, but who still need to create bibliographic records. These libraries may not be able to afford OCLC's prices for cataloging services, or they may simply not wish to be bound by the standards of that society of libraries. Some libraries, in particular those in corporate settings, are not able to share their holdings publicly, and therefore are not able to participate in the social life of libraries that WorldCat represents.

There are also non-library providers of library catalog records, in particular the vendors who include catalog data with the products they sell to libraries. These vendors need a source of cataloging copy that is unrelated to particular holdings information.

If we can think further down the line, a database of bibliographic records, like that in SkyRiver or biblios.net could become a resource for anyone who needs to work with bibliographic data. This could include anyone on a research project who wants to provide a quality bibliography with a minimum of effort. Although the bibliography will follow citation standards, the basic data is the same as that found in library records.

Another advantage that these and other bibliographic services may provide to us all in the library profession is that they could be a source of data for experimentation. What with RDA looming on the horizon and much talk about updating our data format from MARC to something else, we'll need data to work with. OCLC has historically been slow to change its data, and not without reason: OCLC is integrated into the workflows of tens of thousands of libraries that depend on it for every day functionality. Although the OCLC research division comes up with innovative ideas, the OCLC core functionality is essentially the same as it was two or three decades ago. If we want to experiment with radical change, I for one expect it to come from the sidelines, not the center.