Multimodal AI Applied Scientist, SIML - ISE

Apple's System Intelligence and Machine Learning (SIML) team is seeking a Multimodal AI applied scientist to drive the future of multimodal scene understanding and human-centric device interaction. At the heart of this effort, you will develop multimodal LLMs designed to perceive complex environments and understand nuanced human behaviors, preferences, and interactions.

This role offers a rare opportunity to join a leading applied research team known for its foundational contributions to Apple Intelligence, where you will work across the entire generative model lifecycle, spanning novel architecture design, model training, and deployment.

Description

We are looking for an applied scientist with deep skills in ML and generative modeling to architect, train, and deploy multimodal scene understanding technology that can understand scene from visual and audio data. You will quickly build and demonstrate new user experiences using large foundation models, developing innovative capabilities while partnering with cross-functional teams and iterating rapidly in a dynamic environment.

Your work will advance human interaction and scene understanding modeling across the stack, from system-level architecture to core ML algorithms. Among the many challenges you will address are modeling user behaviors and preferences through device and environmental interactions, retrieving nuanced insights from historical context, handling deeply interleaved streaming data, reasoning across diverse temporal horizons, designing memory systems for long-term adaptation, and learning semantically rich representations for open-ended