Final Project - Reading with different narration

For the final Game Design experience, I focused on Automatic &Effortful thinking + Bandwidth.

I was inspired by my experiences with ebook reading with audio. (proposal)

There are a lot of different approaches /researches regarding to reading comprehension. Though I cannot find the exact references, below are commonly known researches.

  • We don’t read each letter of words, or even each words, we just read general shape.

  • Harder the typeface of article is, you learn more information, remember about the contents better.

  • Listening to unpredictable background music helps reading comprehension.(Similar approach to the second one)

Based on that, I wanted to explore if ‘narration-like music helps reading comprehension’.

For that, I needed to figure out.

  • How to cut corpus by meanings.

  • How to generate sound of text

  • How to play the sound accordingly to the text you are reading.

Here is the link for the precise journey how I made narration-like (but not narration) sounds.

My goal is narrowing down bandwidth and trigger effortful thinking.

  • Bandwidth: Ebooks shows a whole page of text, which sometimes hinders you to focus when you are listening to audio also. By showing exact line where you are reading, hopefully narrow bandwidth and focus on the text.

  • Effortful Thinking: listening to unexpected sound according to text you are reading can be annoying but also wake you up to focus on the text (I guess). I think this approach is pretty similar to reading in illegible font or unpleasant music as background. Even underlining on the text you like or memo on the side can be one way of triggering effortful thinking while reading.

Sadly, the background sound was too different than I expected, but I tired to present how the reading experience could be different with different sounds.

For the further step, to gamify reading experience, I can add some interaction with click or touch gesture.