Abstract: Many professionals increasingly rely on LLMs and MLLMs, yet current tools behave like black boxes: impressive, hard to steer, and even harder to trust in production. In this talk, I will outline our efforts to iterative and predictable AI-assisted authoring, where models become reliable “helping hands” rather than opaque oracles. I’ll share design patterns and training strategies that make multimodal systems sensitive to intent, controllable over time, and auditable in outcomes.
Speicifically, I’ll present (i) MonetGPT, an image-editing agent that turns natural language into structured edit plans, executes them stepwise, and exposes interpretable checkpoints for reversible iteration; (ii) LAMP a method for directorial camera control in video and 3D, training MLLMs to map high-level cinematic cues (“dolly in on the protagonist, keep horizon level”) to parameterized rigs with guarantees about continuity; (iii) CAD model editing via mixed symbolic–geometric reasoning, enabling constraint-aware revisions from brief natural prompts. Time permitting, I will also talk about our latest efforts towards shape tokenization. Join us on our journey to merge generative with predictable workflows.
More details at: https://geometry.cs.ucl.ac.uk/
Bio: Niloy J. Mitra leads the Smart Geometry Processing group in the Department of Computer Science at University College London and the Adobe Research London Lab. He received his Ph.D. from Stanford University under the guidance of Leonidas Guibas. His research develops machine learning frameworks for generating high-quality geometric and functional content in computer graphics applications. He has received several recognitions, including the ACM SIGGRAPH Significant New Researcher Award (2013), the BCS Roger Needham Award (2015), and the Eurographics Outstanding Technical Contributions Award (2019). He was elected a Eurographics Fellow in 2021, served as Technical Papers Chair for SIGGRAPH in 2022, and was inducted into the SIGGRAPH Academy in 2023. Beyond research, Niloy is an avid DIYer and enjoys reading, cricket, and cooking.





