In this talk I will discuss modeling compact binaries which are sources for both ground and space-based gravitational wave detectors. I will concentrate on systems with a small mass-ratio between the two components of the binary and discuss the methods we use to model such systems. I will present recent results and in particular our recent work modeling the inspiral of a compact object into a larger black hole that is extremely rapidly rotating.