I wouldn't say no
You're saying you’re not against it, even if you’re not exactly excited about it either.
'I wouldn't say no' when my crush asked me to go to the dance.
'I wouldn't say no' when my friend asked me to help with their project.
'I wouldn't say no' when my teacher asked me to stay after class.