It's more that black holes are so small... that any sideways velocity will be enough to cause bodies to miss the black hole and fall into orbit.
In Universe Sandbox ², the sequel, we have a simulation called "Center of the Milky Way" that shows the stars actually in orbit around the black hole in the center of our galaxy (based on the actual observations of astronomers).
Check out the animation at the bottom of this page:
http://www.galacticcenter.astro.ucla.edu/science.html... that's the same data we use in Universe Sandbox ².
Big stars like Rigel will often be more satisfying than black holes because their radius is so much larger.