Seminar - Nic Lane - 11am Thursday 18th October 2018 0.3 MVB
18th Oct 2018 11:00am
Title: Machine Learning Systems: On-device AI and beyond
In just a few short years, breakthroughs from the field of deep learning have transformed how computational models perform a wide-variety of tasks such as recognizing a face, driving a car or the translation of a language. Unfortunately, deep models and algorithms typically exert severe demands on local device resources and this conventionally limits their adoption within mobile and embedded platforms. Because sensor perception and reasoning are so fundamental to this class of computation, I believe the evolution of devices like phones, wearables and things will be crippled until we reach a point where current -- and future -- deep learning innovations can be simply and efficiently integrated into these systems.
In this talk, I will describe our progress towards developing general-purpose support for deep learning on resource-constrained mobile and embedded devices. Primarily, this requires a radical reduction in the resources (viz. energy, memory and computation) consumed by these models -- especially at inference time. I will highlight various, largely complementary, approaches we have invented to achieve this goal including: binary “on-the-fly” networks, sparse layer representations, dynamic forms of compression, and scheduling partitioned model architectures. Collectively, these techniques rethink how deep learning algorithms can execute not only to better cope with mobile and embedded device conditions; but also to increase the utilization of commodity processors (e.g., DSPs, GPUs, CPUs) -- as well as emerging purpose-built deep learning accelerators.
Nic Lane is an Associate Professor in the Computer Science Department at the University of Oxford. Before joining Oxford, he held dual appointments at University College London (UCL) and Nokia Bell Labs; at Nokia, as a Principal Scientist, Nic founded and led DeepX – an embedded focused deep learning unit at the Cambridge location. Nic specializes in the study of efficient machine learning under computational constraints, and over the last three years has pioneered a range of embedded and mobile forms of deep learning. This work formed the basis for his 2017 Google Faculty Award in machine learning. Nic’s work has received multiple best paper awards, including ACM/IEEE IPSN 2017 and two from ACM UbiComp (2012 and 2015). This year he will serve as the PC Chair of ACM SenSys 2018. Prior to moving to England, Nic spent 4-years at Microsoft Research based in Beijing as a Lead Researcher. He received his PhD from Dartmouth College in 2011. More information about Nic is available from http://niclane.org.
< Back to all events