Should i be mad at him?

ok so my boyfriend of 5 years just found a new job at a restaurant. he got promoted to head cook and now works from 10:30am-10:00pm. 5 days a week,$400 a week. he used to work 3pm to 9pm for $300 a week. he doesn't get paid hourly. and we got into an argument today about how much he works for so little money. i am a manager at a restaurant and i work from 4pm to 12:30am 5 days a week. and i cant change my hours because im a manager and ive worked there for a long time. and since he started these new hours i never get to see him. i come home from work around 12:30 or 1am and hes asleep. i wake up around 11am and hes gone. anyway we get into this fight about how i never get to see him and he says "its none of your business what my hours are or what i do at work just how its none of my business what your hours are at work." i told him that he could at least ask for a raise or have his hours cut or something. and he flipped out saying "my job is easy, most of the time i play pool until a customer comes in" which makes me think that for hours hes just "hanging out" with the people he works with, which most of them are waitresses. should i be mad? if you were me, how would you handle this?