I'll have less
Saying 'I'll have less' is like throwing your hands up and saying you're not going to take any more nonsense.
'You wanna go to the game?'
'I'll have less.'
'You wanna fight me?'
'I'll have less.'
'You wanna talk?'
'I'll have less.'