Could not get past the slavery aspect

I have enjoyed the writers previous work but I could not get past the "slavery" aspect in this book. I had to stop listening after three hours.

Simply put, the main character enslaves people against their will. Worse yet, some of the characters are accepting of this situation and the writer suggests that this is morally justifiable because he "treats them well". At best he is a "pimp", at worse he is a slave master. Either way he is morally reprehensible and as time went by I became increasingly uncomfortable listening to the story.