Viw Magazine

Men's Weekly

.

  • Written by Andy Simionato, Lecturer, RMIT University

Books are always transforming. The book we hold today has arrived through a number of materials (clay, papyrus, parchment, paper, pixels) and forms (tablet, scroll, codex, kindle).

The book can be a tool for communication, reading, entertainment, or learning; an object and a status symbol.

The most recent shift, from print media to digital technology, began around the middle of the 20th century. It culminated in two of the most ambitious projects in the history of the book (at least if we believe the corporate hype): the mass-digitisation of books by Google and the mass-distribution of electronic books by Amazon.

The survival of bookshops and flourishing of libraries (in real life) defies predictions that the “end of the book” is near. But even the most militant bibliophile will acknowledge how digital technology has called the “idea” of the book into question, once again.

To explore the potential for human-machine collaboration in reading and writing, we built a machine that makes poetry from the pages of any printed book. Ultimately, this project attempts to imagine the future of the book itself.

A machine to read books

Our custom-coded reading-machine reads and interprets real book pages, to create a new “illuminated” book of poetry.

The reading-machine uses Computer Vision and Optical Character Recognition to identify the text on any open book placed under its dual cameras. It then uses Machine Learning and Natural Language Processing technology to “read” the text for meaning, in order to select a short poetic combination of words on the page which it saves by digitally erasing all other words on the page.

Armed with this generated verse, the reading-machine searches the internet for an image – often a doodle or meme, which someone has shared and which has been stored in Google Images – to illustrate the poem.

Once every page in the book has been read, interpreted, and illustrated, the system publishes the results using an online printing service. The resulting volume is then added to a growing archive we call The Library of Nonhuman Books.

From the moment our machine completes its reading until the delivery of the book, our automated-art-system proceeds algorithmically – from interpreting and illuminating the poems, to pagination, cover design and finally adding the endmatter. This is all done without human intervention. The algorithm can generate a seemingly infinite number of readings of any book.

The poetry

The following poems were produced by the reading-machine from popular texts:

deep down men try there

he’s large naked she’s even

while facing anything.

from E.L. James’ Fifty Shades of Grey

how parties popcorn

jukebox bathrooms depressed

shrug, yeah? all.

from Bret Easton Ellis’ The Rules of Attraction

Oh and her bedroom

bathroom brushing sending it

garter too face hell.

from Truman Capote’s Breakfast at Tiffany’s

My algorithm, my muse

So what does all this have to do with the mass-digitisation of books?

Faced with growing resistance from authors and publishers concerned with Google’s management of copyright, the infoglomerate pivoted away from its primary goal of providing a free corpus of books (a kind of modern day Library of Alexandria) and towards a more modest index system used for searching inside the books Google had scanned. Google would now serve only short “snippets” of words highlighted on the original page.

Behind the scenes, Google had identified a different use for the texts. Millions of scanned books could be used in a field called Natural Language Processing. NLP allows computers to communicate with people using everyday language rather than code. The books originally scanned for humans were made available to machines for learning, and later imitating, human language.

Imagine infinite readings of the books we already have. Unsplash, CC BY

Algorithmic processes like NLP and Machine Learning hold the promise (or threat) of deferring much of our everyday reading to machines. History has shown that once machines know how to do something, we generally leave them to it. The extent to which we do this will depend on how much we value reading.

If we continue to defer our reading (and writing) to machines, we might make literature with our artificially intelligent counterparts. What will poetry become, with an algorithm as our muse?

We already have clues to this: from the almost obligatory use of emojis or Japanese Kaomoji (顔文字) as visual shorthand for the emotional intent of our digital communication, to the layered meanings of internet memes, to the auto-generation of “fake news” stories. These are the image-word hybrids we find in post-literate social media.

To hide a leaf

Take the book, my friend, and read your eyes out, you will never find there what I find.

Ralph Waldo Emerson’s Spiritual Laws

Emerson’s challenge highlights the subjectivity we bring to reading. When we started working on the reading-machine we focused on discovering patterns of words within larger bodies of texts that have always been there, but have remained “hidden in plain sight”. Every attempt by the reading-machine generated new poems, all of them made from words that remained in their original positions on the pages of books.

The notion of a single book consisting of infinite readings is not new. We originally conceived our reading-machine as a way of making a mythical Book of Sand, described by Jorge Luis Borges in his 1975 parable.

Borges’ story is about the narrator’s encounter with an endless book which continuously recombines its words and images. Many have compared this impossible book to the internet of today. Our reading-machine, with the turn of each page of any physical book, calculates combinations of words on that page which, until that moment, have been seen, but not consciously perceived by the reader.

The title of our early version of the work was To Hide a Leaf. It was generated by chance when a prototype of the reading-machine was presented with a page from a book of Borges’ stories. The complete sentence from which the words were taken is:

Somewhere I recalled reading that the best place to hide a leaf is in a forest.

The latent verse our machine attempts to reveal in books also hides in plain sight, like a leaf in a forest; and the idea is also a play on a page being generally referred to as a “leaf of a book”.

Like the Book of Sand, perhaps all books can be seen as combinatorial machines. We believed we could write an algorithm that could unlock new meanings in existing books, using only the text within that book as the key.

Philosopher Boris Groys described the result of the mass-digitisation of the book as Words Without Grammar, suggesting clouds of disconnected words.

Our reading-machine, and the Library of Nonhuman Books it is generating, is an attempt to imagine the book to come after these clouds of “words without grammar”. We have found the results are sometimes comical, often nonsensical, occasionally infuriating and, every now and then, even poetic.

Now that machines can read, will we defer the task to them?

The reading-machine will be on display at the Melbourne Art Book Fair in March and will collect a Tokyo Type Directors Club Award in April. Nonhuman Books are available via Atomic Activity Books.

Andy Simionato is founder and editor of Atomic Activity Books, and is a lecturer at the School of Design, RMIT University.

Karen ann Donnachie is founder and editor of Atomic Activity Books, an independent, experimental publishing concern.

Authors: Andy Simionato, Lecturer, RMIT University

Read more https://theconversation.com/friday-essay-a-real-life-experiment-illuminates-the-future-of-books-and-reading-131832

VR Training in Australia – Conflict Resolution Training For Employees

In today’s rapidly evolving workplaces, Australian organisations are turning to immersive learning tools like VR to handle specialised n...

Financial Planning For Couples

Why Every Couple Should Talk About Money And A Will (Before It’s Too Late) When you’re in a new, exciting relationship, it’s easy t...

Navigating Relationships While Living with Depression

Living with depression can feel like carrying an invisible weight—one that not only affects how you experience the world but also how yo...

Choosing the Right Vinyl Flooring Suppliers for Your Home or Business

When it comes to selecting flooring options that combine durability, style, and affordability, vinyl flooring stands out as a top choice. ...

Why Food Manufacturing Cleaning Services Are Essential for Safety and Quality

The complexity of food production environments demands specialised cleaning approaches that go beyond regular janitorial work. This is whe...

The Importance of Choosing the Right Industrial Electrician Melbourne for Your Business

When it comes to powering large-scale operations and complex machinery, commercial electrical services are not enough. Industrial environm...

What to Expect During a Property Settlement After Separation

Separation is a challenging and emotional time, and one of the most complex aspects can be the division of property. However, understandin...

Designing the Ideal Healthcare Environment with a Professional Medical Centre Fitout

When it comes to healthcare spaces, functionality, hygiene, and patient comfort take top priority. An intelligently designed medical centr...

Stay Comfortable Year-Round with Ducted Cooling Melbourne

When the temperature starts to rise, having a reliable and efficient cooling system becomes a priority. With unpredictable weather and sud...

Best Practices for Content Ownership and Tagging Across Departments

Image by kaboompics on Freepik The bigger and more complex content ecosystems grow, the more valuable ownership and tagging become. In ent...

Understanding Public Liability Insurance Australia: What You Need to Know

Image by rawpixel.com on Freepik The necessity of public liability insurance in Australia is that it acts as a financial safeguard for busi...

How HID Proximity Cards Improve Workplace Security Without Slowing Down Access

In today’s workplaces, security is non-negotiable, but so is speed. Companies are under pressure to protect their people, property, and ...

Unlock Business Insights Faster with Power BI Tools

In this digital age where data drives the consumer landscape, businesses are shipping huge amounts of data every day. To remain competit...

Why Split System Installation Is a Smart Choice for Home Climate Control

Temperature control is essential for comfort, and when it comes to efficient, versatile cooling and heating, a split system is one of the ...

The Ultimate Guide to Door Replacement: Everything You Need to Know

Image by freepik Sure, swapping out a door is a fairly easy task, but it requires careful consideration of options for materials, designs...

Common Web Development Issues Perth Businesses Face (and How Agencies Fix Them)

Image by freepik Let's be honest, in the bustling heart of Perth's business scene, a website that's not up to scratch is like trying to he...

Life With Clear Aligners: 10 Small Changes That Make a Big Difference

Image by tonodiaz on Freepik Clear aligners have transformed orthodontics, offering a nearly invisible way to straighten teeth without the...

Choosing the Right Hair Loss Treatment for Your Needs

Millions of people experience hair loss globally, and it can be a major cause of emotional discomfort and self-consciousness. Hair loss ca...

Cardboard Display Boxes: An Effective Solution for Retail Presentation

In the competitive world of retail, how products are presented can be just as important as the products themselves. Cardboard display boxe...

Why Hiring a Skilled Shopify Web Developer Can Transform Your Online Store

Shopify has become one of the most popular e-commerce platforms due to its ease of use, powerful features, and scalability. However, creat...