Digital Library of Banned Books in Minecraft

This video is a fly-through of the virtual library in Minecraft. With interviews of banned writers and journalists from Russia, Vietnam and Saudi.
An image from The Uncensored Library project. This is a view of the front entrance of the virtual library in Minecraft. A virtual sculpture of a raised fist holding a dip pen in a garden with trees and grass is in the foreground. The library itself is slightly of focus in the background in order to emphasize the sculpture. The library is built using a neoclassical architectural style with big columns and a domed rooftop. It is intended to resemble well-established institutions such as the New York Public Library, as well as stylistically allude to the authoritarian structures the project aims to subvert.
An image from The Uncensored Library project. The library is intended to resemble well-established institutions such as the New York Public Library, as well as stylistically allude to the authoritarian structures the project aims to subvert.
https://uncensoredlibrary.com/en
  • Media freedom activists have built a 125 million block library in a Minecraft map called the “Uncensored Library” which contains a collection of banned publications and is available to read for users within oppressive regimes that otherwise censor such information.
  • The publications are available in English and the original language. The texts within the library are contained in in-game book items, which can be opened and placed on stands to be read by multiple players at once. These articles generally discuss censorship, unjust punishment, and other critiques of the writer’s government.
  • The Uncensored Library works because though many of the works currently within the library are censored, the Minecraft software is not currently censored in any country.
  • The Chinese government may try to lean on Microsoft to remove the map from within the game. Worst yet, the Chinese government may leave the map up and instead use their powers to log information on who accesses the Uncensored Library within Minecraft and China and forward that information to their internet police.

Part 1: Protests in Animal Crossing

A scene from Animal Crossing. A masked female protester stands in front of a banner with the slogan 'Liberate Hong Kong, Revolutions of our times'. The protester has an eye patch that references the first-aider who was shot in the eye by police during a protest in August 2019. The colourful post-its on her clothes reference Hong Kong's Lennon Wall.
A scene from Animal Crossing. A masked female protester stands in front of a banner with the slogan ‘Liberate Hong Kong, Revolutions of our times’. The protester has an eye patch that references the first-aider who was shot in the eye by police during a protest in August 2019. The colourful post-its on her clothes reference Hong Kong’s Lennon Wall.
Burning torches and a protest banner, that reads 'Free Hong Kong, Revolution Now', on a beach in Animal Crossing. Gamers are free to whack the portrait of Carrie Lam, Chief Executive of Hong Kong on the beach. There are 5 characters in the background cheering for another character who is destroying a portrait of Lam. On the left, here is also a small painting on an easel with the image of a piggy (one of the mascots of Hong Kong protest).
Burning torches and a protest banner on a beach in Animal Crossing. Gamers are free to whack the portrait of Carrie Lam, Chief Executive of Hong Kong on the beach.

Gaming activism is not new. It started as early as 2004 when video games broke into the world of politics, advocacy, and activism. In April 2020, Hong Kong protesters began to shift their protest actions to the virtual world of Animal Crossing because of the restriction of public gatherings in the name of health security. The game was used by Hong Kong activists to spread pro-democracy messages, and consequently it was removed from sale on websites in China.

In July/August, protesters in the US also started to voice out in Animal Crossing and other video games such as World of Warcraft, Splatoon, ToonTown, Grand Theft Auto, and NBA 2K20. In The Sims, a BLM rally hosted by Ebonix (as her avatar is known) was attended by at least 200 players. (from The Guardian)

A screenshot from a Black Lives Matter Animal Crossing rally with 2 black-clad protesters wearing BLM caps and t-shirts.
A screenshot from a Black Lives Matter Animal Crossing rally. https://www.theguardian.com/games/2020/aug/07/black-lives-matter-meets-animal-crossing-how-protesters-take-their-activism-into-video-games
A scene from Animal Crossing where protestors sit and chant for Black Lives Matter. 7 characters are sitting in a backyard with a sign at the entrance that says Black Lives Matter. Photos of George Floyd and other victims are one the ground with small bouquets of flowers. There are 2 speech bubbles, one says 'BLM!', the other 'No justice, no peace!'.
A scene from Animal Crossing where protestors sit and chant for Black Lives Matter. With photos of George Floyd and other victims. https://www.businessinsider.com/animal-crossing-users-are-having-virtual-black-lives-matter-protests-2020-6

Lipreading in the age of COVID-19

I was taught lipreading before I began using BSL (British Sign Language) and use the two communication methods contiguously. The term “lipreading” is somewhat misleading, as it’s not just lip patterns that contribute to understanding – you pick up information from the rest of the face, from body language, and from the contextual environment (context is something I’ll be picking up on again). My biggest obstacle is dark sunglasses that block the information you see around people’s eyes; if lip patterns provide information on words, the eye area often gives the equivalent of tone of voice, and lipreading people wearing sunglasses translates as a monotone to me.

During 2020, the ratio has been flipped, with masks preventing lipreading, but often leaving the eyes and surrounding areas clear; I’ve started to notice that I still pick up information, so can (sometimes) recognise tone, even if there’s no way to pick up words. I’ve also noticed hearing people struggling with understanding (with masks muffling voices), and am wondering if this will impact on people’s thinking about hearing loss in the longer term. Will their own difficulties lead to more understanding? Will they turn to D/deaf people as communication experts they can learn from?

I’ve been playing with images from the 1986 edition of “Lipreading – A Guide for Beginners”, masking the lip patterns illustrated. I’m planning a duotone risograph print, perhaps using several of these images – due to local lockdown I can only prep my files at present, so anything shown at this stage is an approximation.

Black and white photo showing a woman's face. Superimposed is an orange facemask. Only her eyes are visible. On the bottom left are the letters "OO"t ar
“OO”- Lipreading in the age of COVID (study for risograph) 2020

香城Online (Heung Shing Online) Part 2

Screenshot of the Heung Sing Online App. The key image is an illustration of a black bloc leveling up to a frontliner in full gear with gas mask, helmet and umbrella. These two characters stand on a grassland with a blue sky. The illustrations are created in the style of pixel art, with game energy bars. Underneath the key image are tabs that are available in the app such as 'Frontliners' Duties', 'Protest Schedules' and 'Map of Yellow Shops'. There are 2 QR codes and also facebook, instagram and twitter links.
Screenshot of the Heung Sing Online App. The key image is a black bloc leveling up to a frontliner in full gear with gas mask, helmet and umbrella.

A spin-off of ‘Heung Shing Online’ was launched on 31 December 2019 (with revenue from advertisements donated to the cause). This time it is a real game but in a milder/more peaceful form. It’s actually an information sharing app in disguise of a game. In the app, protesters can find a timeline of major events, memes, information about protest schedules, frontliners’ tasks and a map of all the yellow shops (shops that voice out for the movement) etc. Once you enter the app, you can create your own character like in any other game. There are both tasks online and in real life that you can complete. For online tasks you can tweet info or ‘like’ a post on other protest apps such as LIHKG; for real life tasks you can participate in street protests or visit yellow shops. Once a task is completed, points can be earned.

香城Online (Heung Shing Online) Part 1

First page of the strategy guide of Heung Shing Online, with an image of the adaptation of Delacroix's Liberty Leading the People. A protester with a yellow helmet holds a makeshift shield in one arm and waves the Black Bauhinia flag. Designed by pro-democracy protesters, the flag is a powerful symbol of the fight for freedom. The flag bearer is leading other protesters in full gear (helmet, gas mask, shield,  umbrella) to march forward despite poisonous smoke coming out from tear gas canisters on the ground. The night sky is full of smoke, with a hint of a blazing fire in the background. One protester reaches out his arm to help a fallen protester, while a few others hold up an angry fist. There are banners and also road blocks made out of makeshift materials such as orange-coloured barriers, traffic cones, and yellow metal fences that are commonly found in construction sites.
First page of the strategy guide of ‘Heung Shing Online’, with an image of the adaptation of Delacroix’s Liberty Leading the People

The story of ‘Heung Shing Online’ is fascinating. It’s a perfect demonstration of how the virtual and physical realms are blurred. The yellow text in the above image reads,

‘Disclaimer: We urge all netizens to be clearheaded. Please distinguish reality from fantasy. Don’t indulge in gaming to excess. This webpage is only for the purpose of gaming, we don’t instigate nor encourage real violent acts nor criminal behaviour. We take no legal responsibility in the usage of the content of this webpage’

On 19 July 2019, one month into the Anti-ELAB movement, a netizen on LIHKG posted about their idea of creating an online game like Sim City, that mimics the street protests in Hong Kong. (LIHKG is an online forum much like reddit. It was highly influential, generating images, slogans, discussions and strategies. I would say LIHKG was the leader of the leaderless movement, especially in the early months.) On the same LIHKG post, they also uploaded a ‘strategy guide’ created with excel.

‘Heung Shing Online’ was never meant to be a real game, only the strategy guide exists. However it was labeled by pro-Beijing media as the ‘Biggest real life RPG (role-playing game)’ that instigates violence against police, the strategy guide as a training manual for frontliners, especially secondary school kids who ‘do not’ have the ability to distinguish reality from fantasy.

This image indicates Some of the roles in the 'game', including 'Painter' (to create protest art), 'Sentinel', 'Combat Medic' and 'Keyboard Fighter'. The background colour is yellow with 4 illustrations of a piggy in 4 different attires. This particular piggy ('Li-Pig') is one of the mascots of the protest. As an example, the Combat Medic Li-Pig wears a white helmet with the symbol of the red cross. Illustrations of the different supplies (saline solution, bandage, scissors, gloves, isopropyl alcohol, scissors.. etc) floats around the piggy. The texts underneath the illustration list out in details, the supplies needed and the medic's duties.
Some of the roles in the ‘game’, including ‘Painter’ (to create protest art), ‘Sentinel’, ‘Combat Medic’ and ‘Keyboard Fighter’.

In the following months, netizens continued their discussions of strategies on LIHKG with gaming terminology as if the protest was a real RPG. This was to minimise the risk that one day the posts could be used against these netizens in court.

Dutil-Dumas Message

Page 1 of the Dutil-Dumas message. The 1999 message is made of 23 images (or pages) of 127x127 pixels. All the symbols in the messages are created in black and white grid formation. This particular message is an introduction of numerical digits used in human civilisation.
Page 1 of the Dutil-Dumas message
A table of symbols that represent different physical concepts such as energy, density, temperature, etc. All the symbols are built using a 5x7 bitmap.
A table of symbols that represent different physical concepts

The Dutil-Dumas messages were sent out by SETI (Search for Extraterrestrial Intelligence) scientists in 1999. Different messages about the conditions on planet Earth were represented with special symbols designed to maintain a high level of information even in a noisy reception. The whole set of characters is made by small bitmaps of 5×7 pixels.

For my residency, I will selected a series of symbols and re-create them on the virtual art space of Hong Kong’s Cattle Depot Artist Village. I will also compile my own glossary for these symbols on the studio page.

Miku made Minecraft

A screen shot of a website that tell the story of how Hatsune Miku created Minecraft. Miku looks like a Japanese anime character with long, turquoise twintails. She stands in front of a scene from Minecraft.
A screen shot of a website that tells the story of how Hatsune Miku created Minecraft. https://noise.thehardtimes.net/2019/08/29/miku-created-minecraft-how-queer-vocaloid-fandom-brought-a-parody-account-to-infamy/

In 2017, the original creator of Minecraft Markus ‘Notch’ Persson made a series of controversial comments on social media, such as referring to feminism as a “social disease” and claiming that most feminists are “overtly sexist against men.” In March 2019, he made a number of transphobic comments that eventually triggered backlashes including Hatsune Miku declaring herself creator of Minecraft.

Hatsune Miku is a Vocaloid software voicebank developed by Crypton Future Media (Japan) in 2004. The face of the Vocaloid is a 16-year-old girl with long, turquoise twintails. Soon after Notch published his tweets in March, queer Minecraft players decided to have the virtual superstar Miku as Minecraft’s creator.

A tweet by Miku claiming that she is the creator of Mincraft

Subsequently, Minecraft update silently removed references to Persson from the game’s menu, though his name is still in the credits. Persson was not invited to be part of the Minecraft tenth anniversary event later that year, with Microsoft saying that his views “do not reflect those of Microsoft or Mojang”

WE’RE IN!

I managed to get into the Videotages Minecraft realm and be part of past residents Cattle Depot creation zone realizing I accidentally let all the animals out! I’ll try and get them back in!

“He maybe did” or “He may be dead”?

2020 has been a year of information distortion for many people in many ways. Being deaf means my focus has been around digital and physical access – or lack of access – to information, something I’ll be exploring during the residency.  Originally, I had been viewing my planned areas of research – typography and dummy text, AI transcription, and sound effect captioning – as distinct, albeit with some loose links. Maybe these areas have more in common than I envisaged?

I’ve begun looking at Dr Rachael Tatman’s research around conversational AI and linguistics and have been struck by the similarities between the areas of error in AI, conventional listening, and lipreading. These are often mirrored in typographic and compositing errors.

The images in this post are taken from

  • Lipreading – A Guide for Beginners
  • Finer Points in the Spacing and Arrangement of Type
  • An AI voice transcription programme

The header text on this post is taken from a research paper written by Dr Tatman in 2017.

Black text on white background discussing hyphenated works. The example given is "camellia" This word is split across two lines so that the word initially reads "camel-".
Dark blue text on white background from AI transcription programme. The text does not make sense showing the translation is distorted

Jake

A colour photograph of a piece of graffiti carved into a chalk wall. Weather worn letters spell out the name 'Jake '08'. The colours of the image are chalky white, creams and light tans.
Grafitti at Telscombe Cliffs

About 12 years ago Jake came to the beach at Telscombe Cliffs, just outside Brighton in the UK and carved their name into the chalk. I wonder what they are doing now?

Dead Giant

A colour photo of a water eroded, chalk (I think) fossil. The fossil is roughly circular with large bites taken out of it's top half. In it's middle is a bowl shaped hole. The hole is filled with green tinged water and there are small plants and animals living in it. The surface of the fossil is covered with crustaceans. Barnacles appear small on the surface, so the fossil must be large. The fossil is surrounded by clear water and you can see pebbles on the seabed. The colours of the picture are close hues of grey, creamy chalk, ochre, and light green.
Fossil Ammonite

This is a picture of one of the ammonite fossils at Telscombe beach. There’s no reference for size in this image (what an oversight) but I can tell you the fossil is around 1 meter across. Apparently it is 100 million years old. Standing next to it, I was literally staring down at the seabed of an ocean so ancient that when this animal was alive there was no-one to name it, no-one to be aware of it’s vastness. But geologists have reconstructed the landmasses and waters of that period and they have given them names, from this long distant perspective in time. Perhaps I was standing on the seabed of the Tethys Ocean? My knowledge of geology isn’t good enough to know for sure. Here’s a list of ocean’s I would like to visit, but never can because they are lost to time (are the places in this list more alien than places that might be visited in deep space today?):

Panthalasa Super Ocean. Lapetus Ocean. Pannonian Sea. Rheic Ocean. (I like the sounds of these words and how they feel as they rolled out of my mouth when I speak them.)

Treasure! What a find!

A colour photo of a hand holding a fossilised sea urchin. The fossil is around 2 or 3 times the size of the thumb that helps hold it up to the camera. It is grey in colour with 2 rows of small dimples that traverse the surface on opposite sides towards central point at the fossil's top. The surface of the fossil is mottled with different tones of chalky white and grey. The hand that holds it has smudges of chalk on it's fingers. The background is out of focus but looks like a rocky beach, green seaweed, dirty chalk.
Fossilised Sea Urchin

My partner found this beauty on a recent visit to the beach at Telscombe cliffs. This little beast lived out it’s quiet life right where it was found, around 85 million years ago. It stayed in one place for so long it literally became stone. Like something from a myth or fairy tale. Unspeakably beautiful.

Telscombe Cliffs

A colour photograph of a rock strewn beach and chalk cliffs. It is a bright day, with a few light clouds stretching out towards the horizon. The sky is a vivid, light blue. The sea is crystal clear. It looks cold. Seaweed, a deep, dark green, cover chalk rocks which are densely packed across ground. The rocks have fallen from the high chalk cliffs that form a wall on the right hand side of the picture. The cliffs are a wide range of colours; greys, creamy whites, yellows, browns, ochre and dark greens. It looks wild, a bit dangerous but beautiful.
The beach at Telcombe Cliffs

This is an image I took of a beach just outside of my home town. It is only accessible by some very slippery steps that lead down from a concrete under cliff walk way. The beach is well known for being a likely stop to find fossils. It also has some of the largest ammonite fossils in Europe. It feels wild and ancient and I always feel like a time traveler when I am there.