Reference articles on history, science, culture and more
Encyclopedia

Shadow library

Online database of otherwise inaccessible content

Shadow libraries, also referred to as pirate libraries or black open access, are online repositories of freely available digital media that are normally paywalled, access-controlled, or otherwise not readily accessible. Shadow libraries usually contain textual works such as academic papers and ebooks, and may include other digital media like software, music, or films.

Anna's Archive, Library Genesis, Sci-Hub, UbuWeb and Z-Library are some of the most popular shadow libraries for books and academic literature.

01History

Early predecessors to shadow libraries were informal collections of unauthorized digital copies of books, scholarly literature, and other textual media, often shared with small groups via mailing lists, forums, or social media websites. Online communities of scientists also collaborated to share paywalled literature among themselves.

Many shadow libraries originate in Russia, which has a rich history of samizdat stemming from the Soviet era. There was strict state censorship and control of print materials, which gave rise to the dissident activity of copying and disseminating censored or underground works. Even after the dissolution of the Soviet Union and the end of the official censorship program, these sharing practices continued as a result of widespread economic hardship. Texts were widely digitized and shared on Russian FidoNet systems as computer and internet access became more widespread in Russia. One early collection of digitized texts was Maksim Moshkow's 1994 Lib.ru. The Russian Kolkhoz collection, named for the kolkhoz collective farms, was created by a community that worked in the early 2000s to download or digitize scientific texts, which they stored on FTP servers and DVDs. This collection eventually grew to around 50,000 documents.

Some of these early collections later became shadow libraries as they attracted volunteer librarians who catalogued the archives' contents. Early academic shadow libraries in the 2000s included Textz.org, Monoskop, and Gigapedia (later Library.nu). Gigapedia focused more on academic texts than other shadow libraries, which mainly contained literature. Around 2006 or 2007, it incorporated the files amassed by the Kolkhoz collectors, and had become the largest shadow library by 2010. Gigapedia, by then renamed to Library.nu, was shut down in 2012 through a lawsuit from a coalition of seventeen publishing companies including HarperCollins, Oxford University Press, and MacMillan.

Library Genesis (also known as LibGen) was founded in approximately 2007 or 2008 by a group of Russian scientists, who began by organizing a collection of Russian science and technology texts made available on a torrent site, aggregated from sources including the Kolkhoz collection and lib.ru. In 2011, LibGen absorbed the Library.nu collection, keeping it accessible even as Library.nu was forced to shut down. At the time, LibGen was unique in its focus on its open library infrastructure, prioritizing the free sharing of its collection, catalog, and source code to encourage many others to increase shadow libraries' collective resiliency by mirroring and forking the project. As of 2025, Library Genesis "claims to have more than 2.4 million non-fiction books, 80 million science magazine articles, 2 million comic files, 2.2 million fiction books, and 0.4 million magazine issues."

Growth of Library Genesis, 2009-2022
Growth of Library Genesis, 2009-2022

02Motivation

Shadow libraries are part of the open access and open knowledge movements. They seek to more freely disseminate academic scholarship and other media, often citing a moral imperative to make knowledge freely available.

LibGen's operators have described the site's mission as enabling access to information for poor people and opposing the gating of knowledge by elite academic institutions, with one administrator writing "the target groups for LibGen are poors: Africa, India, Pakistan, Iran, Iraq, China, Russia and post-USSR etc., and on a separate note, people who do not belong to academia. If you are not at a university, you can't access anything or at least your access will be so much troubled that you won't be able to progress at all." Alexandra Elbakyan, the creator of Sci-Hub, has justified the site by arguing that the lack of open access to scholarship violates the human right to science and culture, captured in Article 27 of the United Nations Universal Declaration of Human Rights, which states: "Everyone has the right freely to participate in the cultural life of the community, to enjoy the arts and to share in scientific advancement and its benefits." Elbakyan has also argued that "Any law against knowledge is fundamentally unjust". American activist Aaron Swartz captured the motivations of many shadow libraries in his 2008 Guerilla Open Access Manifesto, writing:

The world's entire scientific and cultural heritage, published over centuries in books and journals, is increasingly being digitized and locked up by a handful of private corporations. ... Those with access to these resources, students, librarians, scientists, you have been given a privilege. You get to feed at this banquet of knowledge while the rest of the world is locked out. But you need not, indeed, morally, you cannot, keep this privilege for yourselves.

, Aaron Swartz, Guerilla Open Access Manifesto

Shadow libraries have also cited the increasing cost of academic literature and books, also termed the "serials crisis".

03Technologies

Some shadow libraries (or their content databases) make use of BitTorrent (mainly for database dumps), dark web, and InterPlanetary File System (IPFS) technologies to increase their resilience or distribute loads. Shadow libraries including LibGen and Anna's Archive develop and make their software accessible as open source software, enabling code development by any volunteer and encouraging mirrors or forks. Anna's Archive claims that "if we get taken down we'll just pop right up elsewhere, since all our code and data is fully open source".

Russian samizdat and photo negatives of unofficial literature
Russian samizdat and photo negatives of unofficial literature

05Reception

By academics

Some academics have tacitly or explicitly endorsed shadow library efforts, with many viewing them as morally acceptable acts of civil disobedience against the abusive business models of academic publishers. Furthermore, shadow libraries may increase the impact of academics whose work is made available. According to one study from Cornell University, articles that are available on Sci-Hub receive 1.72 times as many citations as articles from journals of similar quality that are not available on Sci-Hub.

By non-academic authors

Non-academic writers have been more vocally opposed to shadow libraries.

In February 2022, after joining a lawsuit with Amazon Publishing and Penguin Random House against a Ukrainian website selling pirated e-books, American bestselling fiction authors John Grisham and Scott Turow published an op-ed in The Hill calling on US lawmakers to pass a law prohibiting search engines from linking to piracy websites.

In October 2022, the US-based Authors Guild submitted a complaint to the United States Trade Representative about LibGen and Z-Library, describing digital book piracy as "one of the biggest threats facing authors' livelihoods today". The Authors Guild and the UK-based Publishers Association both worked with the FBI in efforts against Z-Library, which culminated with November 2022 the arrest of two of its operators.

However, some authors and writers' organizations have opposed such efforts. British novelist Alison Rumfitt wrote in Dazed that she was not celebrating the site's takedown, and that "the hunger to read is something to be encouraged, something which, in my opinion, is a societal good; even as publishing grows ever more overtly capitalist and monopolised, reading still thrives, and piracy allows it to take place despite borders and Digital Rights Management. Not everyone has access to a library, and not every library in the world is well-stocked." Dave Hansen, executive director of the Authors Alliance nonprofit, expressed that students and researchers would be negatively impacted by attempts to shut down shadow libraries, and expressed that such projects were "a kind of symptom of how broken the system is, particularly when you're looking at access to scientific articles".

Watch videos about Shadow libraryExplainers and documentaries on YouTube (opens in a new tab)

Sources and credits

This article is adapted from the Wikipedia article Shadow library, written by its contributors and licensed under CC BY-SA 4.0. Fathomly has changed the layout, removed citation markers, navigation and maintenance notices, and adjusted punctuation. This adapted version is shared under the same license. For references, see the original article.

Images, from Wikimedia Commons:

Fathomly is not affiliated with or endorsed by the Wikimedia Foundation. Spotted a problem? Tell us.