Moon Creative Lab Favicon

Moon Creative Lab

Join Moon’s one week, in-person, business-building Make-a-Thon in Tokyo.

Explore Moon’s Tokyo-based foundation-building program, Learning Labs.

Learn

Explore Moon’s Tokyo–based incubation program, Boost.

Explore Moon’s Palo Alto–based incubation program, In–Residence.

Build

Grow

/grow

Connect

/connect

About

<a href="https://goril.jp/">GORIL</a> is a digital product that teaches native Japanese speakers proper pronunciation and articulation of the English language through visualization and providing real-time feedback.They recently launched a new web application, <a href="https://demo.goril.jp/">GORIL48</a>, which visualizes the user’s sounds when they speak out loud. An illustrated animation shows its mouth and tongue moving along with the sound, showing the user how to articulate the correct English pronunciation based on the correct mouth movements. But how did Satoshi Yoshida, founder of GORIL, come up with this idea? Read on to hear Satoshi describe how GORIL came to be, from idea to research and ultimately, product launch.&nbsp;<figure class="image"><img src="https://moon-website-prod-images.s3.us-west-1.amazonaws.com/image1_8b8b316cf1.jpg" alt="image1.jpg"><figcaption>Satoshi Yoshida, GORIL founder: Satoshi studied abroad at a university in Wisconsin, USA., as an exchange student while in college. After graduation, he joined Mitsui &amp; Co. in the fall of 2021 and was transferred to Moon Creative Lab as an in-house entrepreneur. In April 2023, he launched the iOS app GORIL Beta, and in August 2023, the web app GORIL48.</figcaption></figure><h3>Is it “food” or “hood”?</h3>The prototype of the idea came to me around 1997. When I was in college, I studied abroad as an exchange student at a university in Wisconsin, but even after six months, my English pronunciation had not improved at all and I lacked confidence.I struggled with taking notes in class because I could not comprehend what was being said, and even when I tried my best to speak English, I was always asked, "What did you just say?” I was always in a constant state of anxiety.My interest in the English language started long before college though. In junior high school, my life was all about baseball. I practiced endless hours without a break, aiming for the Koshien (National High School Baseball Championship), and English was the only thing I was interested in other than baseball. I had this vague idea that if I could master English, I would eventually expand my horizons.When an exchange student from Australia transferred to my school in my second year of high school, I was assigned to be his class guide. At first, he could barely speak Japanese, so I spent a year at school with him, carrying both Japanese-English and English-Japanese dictionaries. However, only having been taught English by Japanese teachers up to that point, I was honestly at a loss with understanding English.For example, I could not understand the difference between "food" and "hood" at all. I asked the exchange student to pronounce those words for me dozens of times and I repeated it so much that he told me to give it a rest, but still I couldn't understand it – and this problem came up again later in life when I studied abroad in the U.S. Not only was it difficult to properly formulate what I wanted to say in English, but I was also having problems getting him to understand what I was saying through my pronunciation in the first place!My scores on written tests did not reflect the difficulty I was experiencing with pronunciation – it was a completely different situation. And after much trial and error to figure out what to do at that point, the idea came to me of what would become the prototype for GORIL.<blockquote>"I could not understand the difference between 'food' and 'hood' at all."</blockquote><h3>Learning through imitation</h3>Six months into my U.S. study, I was still struggling with my English pronunciation. I decided at that moment that I needed to ask a classmate to teach me. The classmate I reached out to was an English as a Second Language (ESL) major and aspired to become a teacher, so the student was eager to help me.One day while practicing, I suddenly started looking at my classmates' mouths and imagining the shape of their mouths and the movement of their tongues and muscles. When I was finally told, "That was good," I became aware that the shape of my mouth and the movement of my tongue was important in my pronunciation! Suddenly, I was able to pronounce the words correctly and was given positive feedback.Overtime, I was able to imitate other sounds as well, and I was able to apply these sounds to words more and more. Eventually, people would tell me, "You have good pronunciation! Where did you learn to speak like that?" I gradually gained the confidence I was lacking and actually wanted to speak more English. This made me think that perhaps my method for pronunciation could be replicated to improve other’s English pronunciation as well. &nbsp;<h3>Still a student, not quite the teacher yet</h3>Since joining Mitsui, I’ve worked mostly in logistics. But in 2015, I was transferred to Singapore as a port operator. At the time, a colleague of mine, who was also transferred, wanted to improve his English pronunciation. I remembered my university days and tried the same pronunciation approach, this time as the teacher and he was the student.But when I told him, "Try to visualize the opening of your mouth, the position and use of your tongue, and adjust the way you produce the sound," he did not understand what I meant by "visualize." No matter how many times I tried to explain the concept, I couldn’t get it right. He told me, "If I could see the image you are talking about more clearly, I think I would be able to do it." I began to agonize over it.The port operator I was managing at the time was forming a task force to think of how to create new businesses for the next generation, and I was fortunate enough to join. We didn't really know how to come up with new ideas, and we didn't have much experience, but as the task force members worked with Moon on the ideas, we gradually became fascinated by the novelty of Moon's approach.At that time, I thought the idea of "visualizing pronunciation" could be potentially materialized at Moon. Fortunately, I got the support of the people around me, including my boss at the time, and I made my pitch in March 2021. &nbsp;<h3>Design research</h3>With Moon’s wide variety of professional resources, we were connected with Takuya Yamagishi, a design researcher who is still currently working on GORIL with us. The research we conducted at the time revealed that 3D models developed to improve pronunciation already existed in the speech therapy industry.In fact, the existing 3D model closely mimicked the movements of my classmates' mouths when I was studying in the U.S., but it was too complicated for users to understand, which really surprised me.Of course, I was very particular about the 3D model I had in mind, and some linguists who collaborated with us agreed that a three-dimensional representation would be better to visualize pronunciation, but the users' reactions were different. I think they didn't intuitively know how to imitate it.We have talked to nearly 200 people, and 100 of which we have provided workshops and lessons to. I came to believe that there needed to be a more intuitive system to understand how one's mouth opens and how the tongue is positioned to produce a certain sound. As a result, I began to think about a two-dimensional interface that would allow me to roughly understand the opening of my mouth and the position of my tongue, and my ideas evolved into the current form of the program. &nbsp;<h3>2D proves better than 3D</h3>The team decided to utilize 2D to teach pronunciation and we have even gamified the experience. We developed familiar games like pinball where users must pronounce vowel sounds in order to control the game.<figure class="image"><img src="https://moon-website-prod-images.s3.us-west-1.amazonaws.com/Goril_image_2_f4a7c592d5.jpg" alt="Goril image 2.jpg"><figcaption>The pictured interface uses formant frequencies to output to two-dimensional coordinates. By objectively capturing the characteristics of the sound and showing them in the visuals, the mouth movements are expressed in a way that is easy to imitate.</figcaption></figure>This simplification was easy to understand because the way people understand different sounds may differ from person to person. Even when people say that they understand and can pronounce a sound, some might be able to imitate it naturally and immediately, while others might not. Even when it comes to listening, there are some people who can separate listening into many elements and others who cannot.When you practice English pronunciation with GORIL, you are turning pronunciation into a simple exercise of moving your mouth into a certain shape, and once you learn it, it’s hard to forget – much like riding a bicycle.The 100+ people who have tried GORIL so far have confirmed its effectiveness, and I am now convinced that anyone can understand it and create a new muscle memory related to English pronunciation, as long as it is visualized in this way.In my 2021 pitch, my Singaporean English, or “Singlish,” was in full swing because I had been in Singapore for a long time. Some of the Moon Committee members I was pitching to commented, "Satoshi's English is special, isn't it!” But, as I’ve learned from my own experience, English has many different pronunciations to begin with.GORIL will start with American English, but in the future, we would like to include British English, Australian English, Singaporean English, and many others. Though we have already visualized a portion of the Japanese language, we believe that there is ample potential for visualization of languages other than Japanese and English. &nbsp;&nbsp;&nbsp;GORIL released the iOS app (beta version) GORIL in April 2023 and its web app <a href="https://demo.goril.jp/">GORIL48</a> in August. GORIL has been actively communicating their work in English pronunciation by holding events, appearing on radio programs, and starting their own podcast, "GORIL Pronunciation Club" (available on <a href="https://open.spotify.com/show/08ldUbbRAc2fxR9sSZlKUP">Spotify</a>, <a href="https://podcasts.apple.com/us/podcast/goril-%E7%99%BA%E9%9F%B3%E9%83%A8/id1689364810">Apple Podcasts</a>, and <a href="https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy9lMDUzMTM0MC9wb2RjYXN0L3Jzcw?hl=ja">Google Podcasts</a>).In the future, GORIL intends to develop an English-learning support tool that allows parents and children to learn pronunciation together, and to visualize not only words but also sentences. They are also looking at applying this technology for learning languages around the world. For the latest information, please visit <a href="https://goril.jp/">GORIL's official website</a> and <a href="https://twitter.com/Goril_English">Twitter</a>.&nbsp;Check back here frequently as we will be sharing more stories and updates about GORIL.

large_image1.jpg

medium_image1.jpg

small_image1.jpg

thumbnail_image1.jpg

image1.jpg

In this article, we talk with two Moon Creative Lab Designers about their experiences designing for inclusivity and how inclusive design can reach unexpected and wider audiences.<img src="https://moon-website-prod-images.s3.us-west-1.amazonaws.com/110822_Blog_Image_Inclusive_1500x2500_c1f4ad11ce.jpg" alt="Moon Creative Lab_ Inclusive_Design"><hr><h4>Key Takeaways:</h4><ul><li>What is inclusive design</li><li>Examples of inclusive design</li><li>How to design for inclusivity in your own work</li><li>Resources for learning more about inclusive design</li></ul><hr>Inclusive design is a design practice that we are always considering when supporting our ventures. At Moon Creative Lab, one of our core values is “Be Human-Centered” which focuses on designing for human needs rather than the business outcomes – the essence of inclusive design. We believe that unexpected opportunities come when we look outside of ourselves and really get to know our users. &nbsp;With Moon’s parent company, Mitsui &amp; Co., celebrating Diversity &amp; Inclusion Week this September, we interviewed two of our designers in Tokyo on what it means to design businesses, products, and services that are inclusive of everyone.&nbsp;<hr>What does inclusive design mean to you?<figure class="image image_resized" style="width:50%;"><img src="https://moon-website-prod-images.s3.us-west-1.amazonaws.com/Takuya_Moon_Creative_Lab_0db86155e2.png" alt="Takuya, Senior Design Researcher"><figcaption>Takuya Yamagishi,&nbsp; Senior Design Researcher</figcaption></figure>T.Y. “For me, inclusive design means design that is welcoming for everyone and can apply to many fields, from architecture to consumer product design to employee experience design and more. Sometimes there are conflicts and it is not possible to make everyone happy. However, in my view, we should always strive to maximize the happiness of every user.”<blockquote>Inclusive design is welcoming for everyone.</blockquote><figure class="image image_resized" style="width:50%;"><img src="https://moon-website-prod-images.s3.us-west-1.amazonaws.com/Machi_Moon_Creative_Lab_63026b0b6e.png" alt="Machi, UI/UX Design Lead"><figcaption>Machi Rezende,&nbsp; UI/UX Design Lead</figcaption></figure>M.R. “For me, inclusive design is all about understanding and including the plurality of people and realities we have in the world. You’d be surprised – a recent study showed that only 21% of people are able to fully use most products, which means that inclusive design, which seeks to lower barriers to effective use, is actually for the majority of people.”<blockquote>Inclusive design is about including the plurality of people and realities.</blockquote><hr>What are some examples of inclusive design?T.Y. “When I studied at design school in Europe, I was impressed by the inclusivity of design there compared to design in Japan. Public notices were clear, simple, intuitive, and visual. In Japan, on the other hand, public notices still tend to be extremely wordy, complex, and non-user-friendly. Things are improving little by little, though. I also noticed that train station ticket gates were wider, allowing easier access for people in wheelchairs.Inclusive design encourages us to think about people who are not the same as us, empathize with them, and question our own assumptions. There is always a danger that we will design things that work best for us, the designer – but we are not everyone, and what works for us may not always work for others.”<blockquote>Inclusive design encourages us to think about people who are not the same as us, empathize with them, and question our own assumptions.</blockquote>M.R. “When talking about inclusivity, we usually think about the Physical aspect of design - <a href="https://www.merriam-webster.com/dictionary/ergonomics">ergonomics</a>, accessibility, design for the elderly and the physically challenged, and so on. But there are also cognitive and emotional aspects to consider.From a cognitive perspective, for example, we should consider such things as color blindness, but also dyslexia, which, as studies show, affects up to 12% of people globally. And also consider deepening our understanding of the wide range of neurodiversity that humans exhibit. Not everyone processes information in the same way and our design should take that into account.In terms of emotional inclusivity, we must also consider how people feel when using the products that we design. Recently there have been great improvements. For example, Instagram now provides more pronoun options for people who don’t identify as Male or Female. And you may have noticed that Slack now includes a range of skin color options for emojis so people can represent themselves online in the way that feels most comfortable for them. These changes may seem subtle, but they have a huge positive emotional impact on those who may otherwise feel excluded or ignored.”<blockquote>Not everyone processes information in the same way, and we must also consider how people feel when using the products that we design.</blockquote><hr>In your own work, how do you design for inclusivity?T.Y. “I am currently working on <a href="https://www.goril.jp/">GORIL</a>, a Moon Creative Lab venture that is creating an innovative way for people to improve their English pronunciation. Originally the project was called “Speak Like Native,” but in the process of interviewing potential users, we learned that the main goal of attaining native-like speech excludes many people, and our project has evolved as a result. We decided to avoid idiomatic expressions and use simpler, more direct language so that more people can use the product effectively.<img src="https://moon-website-prod-images.s3.us-west-1.amazonaws.com/GORIL_Logo_4d44bb3542.png" alt="GORIL_Logo.png">In the past, I also worked on a Moon venture that was developing a product for people with epilepsy, and this forced me to consider many new perspectives. We built a journaling system for the users, but learned that after an epileptic seizure, they are exhausted and unable to write. So, we simplified the design to include only icons indicating the most common range of experiences. This way, users could record their condition in a quick and intuitive way, and we later added an audio function which made it even easier for them.What’s important is that the insight for these improvements came from speaking with epileptic users and getting their feedback on our early prototypes. Without actually speaking with those who would use the product, we were designing in the dark.”<blockquote>Without actually speaking with those who would use the product, we were designing in the dark.</blockquote>M.R. “A while ago I was working on an application for visually impaired people in Japan that helped users navigate around train and subway stations. The app allowed them to find the right exit, restrooms, and so on by scanning QR codes in the station and guiding them around the yellow floor paths.What was interesting about this project was that – as a designer – it wasn’t about making something look good (because the users, by definition, had limited visual ability), but instead about making it work well. Because for these users, this app is not for entertainment or simple convenience, but rather a powerful tool that hugely impacts their lives and can, in some sense, change their reality.&nbsp;<blockquote>It wasn’t about making something look good, but about making it work well.</blockquote>To build this, we talked with visually impaired people and consulted with support associations in Japan to get a deeper and more authentic understanding of the users’ experiences with the product prototypes. We couldn’t have done this just based on our own experiences and realities.During this project, I also learned some interesting things about how inclusive design principles can contribute to design in general. Did you know that dark mode, which your phone or PC might switch to in the evening, originally comes from products designed for people with visual impairments? Or that text-to-speech technologies were first developed for people who could not read screens, but now are a major component of AI assistants like Alexa and Siri? In the end, inclusive design helps everyone.”<blockquote>In the end, inclusive design helps everyone.</blockquote><hr>Are the products and services you design for inclusive? Learn more about inclusive design here:<ul><li><a href="https://www.inclusivedesigntoolkit.com/whatis/whatis.html">What is Inclusive Design?</a> (Cambridge University)</li><li><a href="https://inclusivedesignprinciples.org/">Inclusive Design Principles</a> (inclusivedesignprinciples.org)</li><li><a href="https://xd.adobe.com/ideas/principles/design-systems/what-is-inclusive-design-principles-and-examples/">Inclusive Design: Principles and Examples</a> (Adobe)</li></ul>

Seeing Language: How GORIL Helps Visualize Pronunciation for English Learners

Inclusive Design: Building With Everyone in Mind

Join the Moon Community!

GORIL - Moon Stories Blog

Seeing Language: How GORIL Helps Visualize Pronunciation for English Learners

Inclusive Design: Building With Everyone in Mind

Join the Moon Community!