Bookprism

In the past few years, we have seen that there is decline of reading books among children. There are many reasons of it but the top most is technology. To resolve the issue of book reading, many researchers have been done work on it. They have tried to make such websites which can solve this problem

Project Title

Bookprism

Project Area of Specialization

Artificial Intelligence

Project Summary

In the past few years, we have seen that there is decline of reading books among children. There are many reasons of it but the top most is technology. To resolve the issue of book reading, many researchers have been done work on it. They have tried to make such websites which can solve this problem. As we all know listening is the first language skill that we acquire. Listening to audiobooks can make learning much easier and entertaining. Therefore, the researchers have combined book reading and technology so that children can develop interest in books and it motivates them towards reading. This project aims to develop a web application that enables the kids to listen to the audio of the story books with the highlighted text. Our application will allow the users to upload the book and listen to it. In addition to uploading the book our application also allows users to search some story book from the category list and listen to it. The purpose of this project is to provide a platform to the kids where they can listen to the contents of their favorite story book. This project will consist of creating a web application for listening audiobooks using speech synthesis and text highlighting. The input data will be given either in the form of text or image. There are five modules on which this application will work. The first is an image processing module which converts the image into text. The second is a voice processing module that generates speech from text. The third module is to remove garbage text from the storybook which includes removal of page numbers and the title of the storybooks from the top of the top of the page. Moreover, in fourth module we will synchronize text and speech. These modules could be done using machine learning (ML). Once the speech is generated, we will do synchronization between text and speech and highlight the word at that time. Furthermore, a video will be made which contains the audio and the highlighted text. When a user uploads the images of the book, he/she has to specify the category of the book. Moreover, the user can mark his book as public if he wants to share his book with other users else he can mark it private. Users can also rate the book.

Project Objectives

The main objective of our project is to make a scalable web application which will help the users to listen the audio of the book. The objective of this project is to provide a platform to the kids where they can listen to the contents of their favorite story book. Our objective is to make the image uploading time and video loading time efficient enough such that the user does not find it slow. Image processing, voice processing, synchronization, garbage text removal and video generation are the main parts of our project. Optical character recognition and speech synthesis are used for image processing and voice processing. After image processing and voice processing synchronization will be performed in order to highlight the text. User will be able to upload book, search book, read book, listen book, rate book, download the video and delete book.

Project Implementation Method

The explanation of modules is given as follows:

• OCR.
• Text to speech synthesizer.
• Synchronization of text and audio and highlighting of text accordingly.
• Video generation.

Firstly, we are getting the input from the user in the form of images and extract text from the image through OCR. With the help of speech synthesizer voice is generated and then we will do synchronization between text and audio and then generate a video with each frame and save the video in database.

Benefits of the Project

We have seen that in the current era children are losing interest in books and they are more attracted towards the gadgets. So we have tried to provide a platform for the kids where they can listen the story books and aslo they can upload any book of their choice.Listening will make the learning easier and entertaining. It is also easy to use by children. They just reuire to make an account and can upload and listen it at any time. Once the bookis uploaded it will be save on their profile so that they can listen it again and again.Another functionality is that the user can download the video that is generated so that he can watch it in ofline mode. 

Technical Details of Final Deliverable

In the final deliverable we will have

1. website that will take images and pdf from user
2. get text using ocr( tesseract) and generate speech (pyttsx)
3. synchronize between text and voice and highlight it
4. made video as a final outcome 
5. the web base application will be provided to the user

Final Deliverable of the Project

Software System

Core Industry

IT

Other Industries

Core Technology

Artificial Intelligence(AI)

Other Technologies

Sustainable Development Goals

Quality Education

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com