Sound localization for video conferencing

Project Title

Sound localization for video conferencing

Project Area of Specialization Electrical/Electronic EngineeringProject Summary

          In this final year project proposal, we propose a novel idea of sound localization for video conferencing, which has become an integral part of the workplace these days. Since, under regular conditions, an individual is employed to record and monitor the whole meeting process, where cost, convenience and security concerns occur. In order to record both the individuals and their interactions on the screen, a camera is typically installed at the edge of the meeting room. It enforces individuals to look in the direction of the camera, making contact uncomfortable.

       To overcome the above deficiency, we are intended to design a system that will be placed at the center of the table and uses microphones to locate the speaker and turns the camera to his face autonomously. All the process can be done in real-time via the user-friendly interface.

Project Objectives

Objectives of the proposed project include: 
•To record a meeting i.e online or offline autonomously without human involvement and with a lower cost. 
•To provide a solution to best capture information exchanges (Q&A, argument, or discussion) between two people between the meeting.
• Auto-generated split-screen simplifies post-production.
• Option for storing and tracking the meeting data for future use.

Project Implementation Method

 The system includes a camera that would be capable to rotate 360 degrees and will be placed at the center. A microphone array includes a plurality of microphones. The microphone array is operable to receive a voice of a speaker and to provide an audio signal representing a voice. The camera controller is operable to receive the speaker position data and to determine an appropriate responsive camera movement. A micro-controller will control a motor to rotate the camera to the intended speaker and focus it. Also, necessary control actions and needed to the camera so that it automatically tracks the position of any speaker. 
The camera will autonomously focus on the person, who is currently speaking.
 
The system will also provide priorities to specific mics/speakers on a demand basis.

Block Diagram

Benefits of the Project

For any organization in this digital world, handling and recording meetings both online (video conferencing) and offline is very critical. The need for such activities has been drastically increased because of the COVID. The systems available in the market for managing and capturing such meetings i.e video conferencing are very costly and have minimal functionality. Our system will be equipped with all the relevant equipment required to meet any workplace need.

Immediate beneficiaries of our projects are the education, media and the corporate sector.

Technical Details of Final Deliverable

We will practically deploy the system in a conference room of our university that will be equipped with all the necessary hardware and software to provide sound localization for video conferencing.

Final Deliverable of the Project Hardware SystemCore Industry EducationOther Industries IT , Medical , Media Core Technology Internet of Things (IoT)Other Technologies Artificial Intelligence(AI), Big DataSustainable Development Goals Quality Education, Decent Work and Economic Growth, Industry, Innovation and InfrastructureRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	80000
amplifier	Equipment	1	12000	12000
Servo motor	Equipment	1	3000	3000
speaker mics	Equipment	12	2000	24000
HD camera	Equipment	1	12000	12000
Arduino	Equipment	2	1700	3400
L.C.D	Equipment	1	12000	12000
Hardware Assembling	Equipment	1	3600	3600
Small electronic components	Miscellaneous	1	10000	10000