There are existing questions asking about labeling a single geom_abline() in ggplot2:

• 

  For any who want to follow along, it sounds like there is hope for a "true solution" via geomtextpath, which will end getting hjust to "do the right thing" under the hood.