BEGIN:VCALENDAR
VERSION:2.0
METHOD:PUBLISH
CALSCALE:GREGORIAN
PRODID:-//WordPress - MECv7.33.0//EN
X-ORIGINAL-URL:https://dcn.nat.fau.eu/
X-WR-CALNAME:
X-WR-CALDESC:FAU DCN-AvH. Chair for Dynamics, Control, Machine Learning and Numerics -Alexander von Humboldt Professorship
X-WR-TIMEZONE:Europe/Berlin
BEGIN:VTIMEZONE
TZID:Europe/Berlin
X-LIC-LOCATION:Europe/Berlin
BEGIN:DAYLIGHT
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
TZNAME:CEST
DTSTART:20260329T030000
RRULE:FREQ=YEARLY;BYMONTH=03;BYDAY=-1SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
TZNAME:CET
DTSTART:20261025T020000
RRULE:FREQ=YEARLY;BYMONTH=10;BYDAY=4SU
END:STANDARD
END:VTIMEZONE
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-PUBLISHED-TTL:PT1H
X-MS-OLK-FORCEINSPECTOROPEN:TRUE
BEGIN:VEVENT
CLASS:PUBLIC
UID:MEC-d8591042aaf8c8d8b53b7e43085a0587@dcn.nat.fau.eu
DTSTART;TZID=Europe/Berlin:20250502T120000
DTEND;TZID=Europe/Berlin:20250508T140000
DTSTAMP:20241114T121004Z
CREATED:20241114
LAST-MODIFIED:20250430
PRIORITY:5
SEQUENCE:20
TRANSP:OPAQUE
SUMMARY:FAU MoD Course: Towards a Mathematical Foundation of Deep Learning: From Phenomena to Theory
DESCRIPTION:Date: Fri. – Thu. May 2 – 8, 2025\nEvent: FAU MoD Course\nOrganizer: FAU MoD ( http://www.mod.fau.eu ), Research Center for Mathematics of Data at FAU, Friedrich-Alexander-Universität Erlangen-Nürnberg\nFAU MoD Course: Towards a Mathematical Foundation of Deep Learning: From Phenomena to Theory\nSpeaker: Prof. Dr. Yaoyu Zhang\nAffiliation: Institute of Natural Sciences & School of Mathematical Sciences, Shanghai Jiao Tong University\nAbstract. Establishing a mathematical foundation for deep learning is a significant and challenging endeavor in mathematics. Recent theoretical advancements are transforming deep learning from a black box into a more transparent and understandable framework. This course offers an in-depth exploration of these developments, emphasizing a promising phenomenological approach. It is designed for those seeking an intuitive understanding of how neural networks learn from data, as well as an appreciation of their theoretical underpinnings.\nWe begin by introducing deep learning and its intriguing mysteries, setting the stage for deeper theoretical investigation. Key phenomena discussed include the frequency principle (or spectral bias), where neural networks tend to prioritize learning low-frequency components of data, and the condensation phenomenon, in which neurons within a layer cluster together, effectively reducing the number of independent neurons. Delving into these phenomena, we present detailed theoretical results and explore their implications for the capabilities and limitations of deep learning models.\nFurthermore, we demonstrate how the study of condensation motivates novel analyses of the loss landscape and advances in generalization theory. By examining the loss landscape underlying condensation, we uncover a nonconvex hierarchical embedding structure of critical points that influences neural network convergence during training. To explain the generalization advantages of condensation, we introduce the concept of optimistic sample size estimates, highlighting the potential of heavily parameterized neural networks to achieve excellent sample efficiency.\nOverall, this course serves as a gateway to the vibrant field of deep learning theory, inspiring participants to contribute fresh perspectives to its advancement and application.\nSession Titles:\n1. Mysteries of Deep Learning\n2. Frequency Principle/Spectral Bias\n3. Condensation Phenomenon\n4. From Condensation to Loss Landscape Analysis\n5. From Condensation to Generalization Theory\n \nBIO.- Yaoyu Zhang is an associate professor at the Institute of Natural Sciences and the School of Mathematical Sciences, Shanghai Jiao Tong University. He earned his Bachelor’s degree in Physics in 2012, and his Ph.D. in Mathematics in 2016 from Shanghai Jiao Tong University. From 2016 to 2020, he conducted postdoctoral research at New York University Abu Dhabi & Courant Institute, as well as the Institute for Advanced Study in Princeton. His research focuses on the theoretical foundation of deep learning.\n\nSee poster\n \nAUDIENCE\nThis is a hybrid event (on-site/online) designed for advanced master’s students and beyond, focusing on in-depth discussions and technical insights.\nOpen to: Public, Students, Postdocs, Professors, Faculty, Alumni and the scientific community all around the world.\n \nWHEN\nFri. – Thu. May 2 – 8, 2025\nTime-table:\nFri. May 2: H11 (14:00H – 16:00H)\nMon. May 5: H11 (10:00H – 12:00H)\nTue. May 6: H11 (14:00H – 16:00H)\nWed. May 7: H16 (12:00H – 14:00H)\nThu. May 8: H16 (12:00H – 14:00H)\n \nWHERE\nOn-site / Online\n[On-site] FAU, Friedrich-Alexander-Universität Erlangen-Nürnberg\nCauerstraße 7/9, 91058 Erlangen, Bavaria (Germany)\nH11. Felix-Klein building. Mathematik/Informatik\nH16. EEI-Gebäude, Technische Fakultät\nHow to get to Erlangen?\n[Online]\nhttps://www.fau.tv/fau-mod-livestream-2025\n \nShort-link to share this event: https://go.fau.de/1bd–\nThis event @LinkedIn\n \nYou might like:\n• FAU MoD Courses and Workshops\n• FAU MoD Lectures\n• Upcoming events\n  \n_\nDon’t miss out our last news and connect with us!\nLinkedIn | Bluesky | Instagram | YouTube | X (Twitter)\n
URL:https://dcn.nat.fau.eu/events/fau-mod-course-towards-a-mathematical-foundation-of-deep-learning-from-phenomena-to-theory/
ORGANIZER;CN=FAU MoD:MAILTO:
CATEGORIES:FAU MoD Course
LOCATION:Erlangen - Bavaria, Germany
ATTACH;FMTTYPE=image/png:https://dcn.nat.fau.eu/wp-content/uploads/FAUMoDCourse_yZhang_may2025_img.png
END:VEVENT
END:VCALENDAR