The Wearables Voice AI team supports speech-based interaction on wearable devices for on-line and on-device scenarios. As a Research Scientist in Wearables Voice AI, you will have the opportunity to perform ground-breaking research to advance the device-driven AI Assistant effort at Meta – e.g. RayBan Smart Glasses and future Wearable devices. You will build state-of-the-art LLMs, optimize them for natural voice interaction on our unique hardware (multiple microphones, other sensors, on-device inference, etc), deliver knowledge-grounded, actionable, personalized AI through a unique voice user interface. You will collaborate closely with Meta GenAI and FAIR orgs to produce SOTA research and translate this into products.
AI Research Scientist, Language - Reality Labs Responsibilities
- Be a leader in our efforts to understand and synthesize speech, translate between languages, and/ or extract intents, concepts, or other relevant features from speech and link them to downstream tasks.
- Independently design and implement algorithms, train state of the art models on large data, and optimize their performance together with our team and partners.
- Perform research to tackle unsolved real-world problems and advance state of the art research by developing internal tests and mapping them to external benchmarks.
- Develop machine learning models for both server-based and embedded systems.
- Contribute research that can be applied to Meta product development. Publish it.
Minimum Qualifications
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Has PhD in the field of Artificial Intelligence, a related field, or equivalent practical experience. Degree must be completed prior to joining Meta.
- 3+ year(s) of work experience in a university, industry, or government lab with emphasis on AI Research in speech recognition, speech synthesis, natural language understanding, machine learning, deep learning, or related fields.
- Experience with development and implementation of speech recognition algorithm/ systems and model training, including LLMs.
- Experience working with machine learning libraries like Pytorch, Tensorflow, etc.
- Familiar with scripting languages such as Python and shell scripts.
- Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.
Preferred Qualifications
- Experience with developing scalable machine learning models in at least one of the following areas: automatic speech recognition, speech synthesis, LLM, or relevant areas.
- Experience with large scale model training, implementing algorithms, and evaluating speech-based systems.
- Proven track record of achieving significant results as demonstrated by publications at leading workshops, journals or conferences such as ICASSP, INTERSPEECH, NeurIPS, ICML, ICLR, or similar.
- Experience taking ideas from research to production.
- Experience solving complex problems and comparing alternative solutions, tradeoffs, and diverse points of view to determine a path forward.
- Experience working and communicating cross functionally in a team environment