Beth Daley
Editorial Adviser , Europeana Foundation
Clemens Neudecker
Project Coordinator , Berlin State Library
With the new Europeana Newspapers collection, Europeana Collections gives access to hundreds of newspaper titles and millions of newspaper pages. Today, Clemens Neudecker tells us all about how the collection was put together, and what it can be used for.
Clemens: I work at the Berlin State Library (Staatsbibliothek zu Berlin - Preußischer Kulturbesitz), where I advise the Directorate on research strategy and also participate in several research projects, mainly in the areas of Optical Character Recognition (OCR), Machine Learning and the Digital Humanities.
I have been involved with Europeana Newspapers from the start. When the Europeana Newspapers project received funding in 2012, I worked at the National Library of the Netherlands, and led the OCR processing of 10 million newspaper pages for the project. In the summer of 2014, I moved to the Berlin State Library to coordinate the overall project, until its end in 2015. Since then I have been working with Europeana to make the project outputs available as a thematic collection.
Newspapers capture the details of daily life in the past - a lot of what does not make it into history textbooks can be discovered in historic newspapers. There is great potential in having a common point of access for newspapers from different European countries, for example, for comparison and the study of how media in the past reflected public perceptions of major events such as the murder of Franz Ferdinand or the 1917 Revolution.
There are already a number of research projects that work with the Europeana Newspapers collection data in various ways, from text analysis to image-based methods or the study of historical stock market indices. But newspapers are also a very interesting source for creative coders, citizen scientists or genealogists or just anybody interested in the many details of life in the past.
When we began with the Europeana Newspapers project, Europeana couldn't provide full-text search in addition to metadata about cultural heritage objects. So a prototype portal was developed and served by The European Library (TEL). Unfortunately, CENL, the organisation that funded TEL decided to close the service by the end of 2016. Since then, we have been working with Europeana to save the newspaper data and access features by migrating to the main Europeana Collections platform.
However, TEL and Europeana use different technology to serve data, so most of the development had to start from scratch. Since the newspapers require specific functionality not present before in Europeana, and since the data is of immense volume, this proved to be quite difficult and time-consuming. Furthermore, the newspaper collection needed to blend in with the overall presentation of cultural heritage objects on Europeana Collections, which brought about additional challenges for design and development.
The content that newspapers cover is so broad, it is really exciting to discover the variety. You can find, for example, famous novels that first appeared in a series in a daily newspaper. But what has so far captured me most are the historic adverts. They are interesting from so many angles - typesetters were really creative with the techniques that were available to them. The products themselves and in particular how they were advertised is often quite funny and very revealing about the trends and mindsets of the societies back then.
The momentum for digitised historical newspapers is enormous and still growing. While there are a number of international, collaborative research projects like Oceanic Exchanges, impresso or NewsEYE, there are also for example, three panels on using digitised historical newspapers in research at this year’s international Digital Humanities conference.
Here in Germany, we have just started a project to establish a common portal for all digitised German newspapers within the context of the German Digital Library. And at the same time, many more millions of pages will be digitised in the coming years thanks to funding made available by the German Research Foundation (DFG). The German newspaper portal will benefit greatly from the standards and best practices developed within Europeana Newspapers. Other countries like Switzerland and Luxembourg have since adopted similar standards and launched impressive new newspaper portals.
We do, of course, hope that in the future we will be able to include more of these dispersed newspaper collections in Europeana Newspapers while at the same time working to improve and extend the functionality available for newspapers within the Europeana Collections platform.
