Julian Büchel

LinkedIn | Google Scholar

Bio

Julian Büchel is a Pre-Doctoral Researcher in the Analog In-Memory Computing group at IBM Research – Zurich and a PhD student at the Department of Computer Science at ETH Zürich under the supervision of Prof. Martin Vechev. He studied Computer Science and Neural Systems and Computation at ETH Zürich from 2016 to 2022. During his Master's, he worked as a Research Engineer at SynSense, a company focused on digital neuromorphic vision. During his Master's thesis conducted at IBM Research in 2021, he demonstrated that adversarial attacks in the weight domain can be used to enhance the robustness of DNNs (see ICLR paper). After his thesis, he joined IBM Research as a Pre-Doctoral Researcher in 2022. Work co-authored by him has won the 2023 OSS award and an honorable mention in the 2024 Pat Goldberg Memorial Award. His current research interests evolve around the topic of bringing LLMs to Analog In-Memory Computing architectures based on high-density non-volatile memory technology. He primarily focuses on re-training LLMs such as Microsoft's Phi-3 or IBM's Granite so that they are robust against various types of noise such as quantization noise and noise introduced by the analog hardware.

Selected publications

Analog In-Memory Computing:

• "AIHWKIT-Lightning: A Scalable HW-Aware Training Toolkit for Analog In-Memory Computing", Büchel et al., NeurIPS 2024 (MLNCP workshop)
• "Kernel Approximation using Analog In-Memory Computing", Büchel et al., Nature Machine Intelligence 2024
• "Efficient Scaling of Large Language Models with Mixture of Experts and 3D Analog In-Memory Computing", Büchel et al., Nature Computational Science 2024
• "A 64-core mixed-signal in-memory compute chip based on phase-change memory for deep neural network inference", Le Gallo et al., Nature Electronics 2023
• "ML-HW Co-Design of Noise-Robust TinyML Models and Always-On Analog Compute-in-Memory Edge Accelerator", Zhou et al., IEEE Micro 2022
• "Exploiting the State Dependency of Conductance Variations in Memristive Devices for Accurate In-Memory Computing", Vasilopoulos et al., IEEE Transactions on Electron Devices, 2023
• "Gradient Descent-Based Programming of Analog In-Memory Computing Cores", Büchel et al., IEDM Proceedings, 2022
• "Programming Weights to Analog In-Memory Computing Cores by Direct Minimization of the Matrix-Vector Multiplication Error", Büchel et al., IEEE JETCAS (highlighted paper), 2023

Spiking Neural Networks:

• "Supervised Training of Spiking Neural Networks for Robust Deployment on Mixed-Signal Neuromorphic Processors", Büchel et al., Nature Scientific Reports, 2021
• "Adversarial Attacks on Spiking Convolutional Neural Networks for Event-Based Vision", Büchel et al., Frontiers in Neuroscience, 2022
• "Network Insensitivity to Parameter Noise via Adversarial Regularization", Büchel et al., ICLR, 2022

Selected Patents

• US20240160348A1
• US20240127009A1
• US20240086682A1
• US20230305893A1

Get in touch

jub[at]zurich[dot]ibm[dot]com