Lemu
Tokyo, Japan- Group Project
Context
This project's scope was to take textbook images and create engaging ways to learn from them. We were required to develop a solution using AI and show proof of concept.
Approach
Make high school textbook images more engaging by designing an app that scans textbook pages and turns them into music videos (AI-powered solution).
App Walkthough
Turn up your volume for the full experience!
How many students remember what they studied at school?
Students forget 95% of what they learn in high school within three days, especially when cramming for tests. Without reinforcement, most information quickly fades.
Active learning, which involves engaging with material through discussion, analysis, and application, can boost retention to 90%. Active learners remember more and develop critical thinking skills, enabling them to analyze, create, and evaluate concepts effectively.
Up-Cycling: A new way of learning
Students often take photos of textbook pages, only for them to be forgotten in their gallery. Instead of letting these images go unused, they can be repurposed in a meaningful way.
By leveraging AI, students can transform these images into interactive and personalized learning tools, making studying more efficient and engaging.
Persona
Meet Ethan, a 17-year-old American student in his junior year of high school. He retains information best when he listens attentively. Whether it's YouTube videos, podcasts, or audiobooks, auditory methods are his preferred mode of learning. However, many of his classes are textbook-based, so he is forced to study in a way that does not benefit him.
Lemu
Lemu is an app that recycles trash data while helping students learn and consolidate school topics. Its new approach involves using music and video to retain information.
The Code
This code uses Google Cloud's Vision API and OpenAI's GPT-3.5 to generate song lyrics based on the text detected from an image. Here's a breakdown of what each part does:
Lemu: Home
In the home of the app the user can find:
The profile button
A clock that keeps track of how many days the user is using the app
A button for playlists and the playlists generated by other users
A button to generate new songs.
Lemu: Song Generator
To generate the desired song, simply upload or take a photo of the book page and wait for the generator to do its job.
Once completed, the user will be able to insert it into one of their playlists on the personal profile page
Lemu: Profile
In the user profile, you can see the playlists created and create new ones.
Based on each subject, a predefined character will be displayed in the player before starting the song, as soon as the song is played, the sound will be accompanied by the video generated by the AI.
In addition to listening, you can read the text to help your memory remember
Lemu:
School Subject Character
Lemu: Profile
The user will also be able to choose their distinctive profile character to make the experience even more unique.
Lemu: Profile
ADV campaign
To make the app known to students, an advertising campaign will also be planned with the aim of introducing students to this new approach using an ironic tone of voice, using an oxymoron that states the opposite of what the app offers.
