Not even having time for his family and having serious effects on his personal life, Harmon allegedly almost left because of ...