Lay your case out like you are doing here, it may help to write it down so you can go over it with him and leave it with him.
Don't threaten to leave, or let him think you are going to leave, otherwise you may get the boot.
If you do decide to leave, just leave, do not give ultimatums, as they never work.