The ventricular puncture is a critical and challenging brain surgery as the surgeon cannot see the tissue he punctures. Our AR research project HoloMed aims at supporting the surgeon with AR holograms at every step of the procedure. We discuss our iterative HCD approach, UX principles for AR that apply to the medical setting and implications for future use.